A promotional content display method and device based on live broadcast screen
By identifying the live broadcast screen feature and determining the display area in the online live broadcast, the problem of low efficiency in the display of promotion content in the live broadcast screen is solved, flexible and effective promotion content display is achieved, and interference to the anchor operation is reduced.
Patent Information
- Application Number
- CN202011139952.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-10-22
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2040-11-26
AI Technical Summary
In online live broadcast, it is difficult for the existing technology to flexibly display promotion content in the live broadcast screen, and the promotion content display is likely to interfere with the anchor's operation when the anchor participates, resulting in low efficiency in displaying promotion content.
By identifying the live broadcast screen feature on the live broadcast client, the display area of the target promotion content is determined based on the recognized target scene characteristics, and the promotion content is displayed in the area. Intelligent image recognition technology is used to integrate the promotion content to avoid restrictions on fixed display areas.
It realizes flexible and effective promotion content display in the live broadcast screen, reduces interference to anchor operations, and improves the display efficiency of promotion content.
Smart Images

Figure CN112258232B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer technology, and in particular to a method and device for displaying promotional content based on a live broadcast screen. Background Art
[0002] As a form of online social interaction, live streaming has absorbed and continued the advantages of the Internet. In live streaming, due to the strong real-time interactivity between the anchor and the audience, live streaming can stand out from traditional content promotion channels and become a more suitable channel for content promotion. For example, in game live streaming, in addition to live streaming the game process, content promotion can also be carried out by displaying promotional content in the live broadcast screen.
[0003] In the process of research and practice of related technologies, the inventor of the present application found that when displaying promotional content in a live broadcast screen, in order to avoid interfering with the live broadcast screen watched by the audience, the content to be promoted can be displayed in the corner area of the live broadcast screen. However, this method can only produce a rigid effect and cannot be adjusted flexibly, resulting in the inability to efficiently display promotional content based on the live broadcast screen. In addition, when the live broadcast includes the participation of the anchor, the display of promotional content during the live broadcast will interrupt the anchor's current operation, further making it impossible to efficiently display promotional content based on the live broadcast screen. Summary of the invention
[0004] The embodiments of the present application provide a promotional content display method and device based on a live broadcast screen, which can flexibly display promotional content in a live broadcast screen, so that the promotional content display based on the live broadcast screen can be performed more efficiently.
[0005] The present application provides a method for displaying promotional content based on a live broadcast screen, including:
[0006] Display the live broadcast screen on the live broadcast client;
[0007] Performing feature recognition on the live broadcast scene in the live broadcast picture;
[0008] When a target scene feature is identified in the live broadcast scene, a target display area for target promotion content is determined in the live broadcast screen according to the target scene feature;
[0009] The target promotional content is displayed in the target display area of the live broadcast screen.
[0010] Accordingly, the embodiment of the present application further provides a promotional content display device based on a live broadcast screen, comprising:
[0011] A display unit, used to display the live broadcast screen on the live broadcast client;
[0012] An identification unit, used for performing feature identification on the live scene in the live picture;
[0013] a determination unit, configured to determine a target display area for target promotion content in the live broadcast screen according to the target scene features when a target scene feature is identified in the live broadcast scene;
[0014] The display unit is used to display the target promotion content in the target display area of the live broadcast screen.
[0015] In one embodiment, the determining unit includes:
[0016] A set determination subunit, configured to determine a mapping relationship set for promotional content, wherein the mapping relationship set includes a mapping relationship between preset scene features and preset display areas, and the preset display area is an area for displaying the promotional content during live broadcast;
[0017] The area determination subunit is used to determine the target display area of the target promotion content in the live broadcast screen according to the mapping relationship set and the target scene characteristics.
[0018] In one embodiment, the region determination subunit is used to:
[0019] Determine a target mapping relationship corresponding to the target scene feature in the mapping relationship set, wherein the target mapping relationship is a mapping relationship between the target scene feature and a target display area, and the target display area is an area for displaying target promotional content during live broadcast; based on the target mapping relationship, generate a response event in response to the target scene feature; through the response event, obtain position parameters required to determine the target display area; and determine the target display area in the live broadcast screen according to the position parameters.
[0020] In one embodiment, the identification unit includes:
[0021] A picture acquisition subunit, used for acquiring the live broadcast picture;
[0022] An image extraction subunit, configured to extract a live scene image corresponding to the live scene from the live screen;
[0023] The image input subunit is used to input the live scene image into the target recognition model so as to perform feature recognition on the live scene image through the target recognition model.
[0024] In one embodiment, the image input subunit is used to:
[0025] Obtain a target configuration file, wherein the target configuration file includes feature description information of at least one candidate scene feature; perform feature matching on the live scene image and the feature description information through the target recognition model to obtain a matching result; and determine a feature recognition result of the live scene in the live screen based on the matching result.
[0026] In one embodiment, before the live broadcast screen is displayed on the live broadcast client, the promotion content display device based on the live broadcast screen further includes:
[0027] A setting information acquisition unit, used to acquire live broadcast setting information, scene setting information, and promotion content setting information for target promotion content, wherein the scene setting information corresponds to a live broadcast scene, and the live broadcast scene has target scene characteristics;
[0028] A mapping relationship establishing unit is used to establish a mapping relationship between the target scene feature and the target display area according to the live broadcast setting information, the scene setting information, and the promotion content setting information, wherein the target display area is an area for displaying the target promotion content during the live broadcast.
[0029] In one embodiment, the setting information acquisition unit includes:
[0030] A configuration page display subunit, configured to display a promotion configuration page for target promotion content, wherein the promotion configuration page includes at least one promotion configuration control, and the promotion configuration control includes a live broadcast setting control, a scene setting control, and a promotion content setting control;
[0031] The configuration information acquisition subunit is used to obtain the promotion configuration information for the target promotion content in response to the promotion configuration operation for the promotion configuration control, wherein the promotion configuration information includes live broadcast setting information, scene setting information, and promotion content setting information.
[0032] In one embodiment, the promotion configuration page includes an effect preview window; the setting information acquisition unit further includes:
[0033] The preview effect display subunit is used to display the corresponding promotion display preview effect in the effect preview window in response to the promotion configuration operation on the promotion configuration control.
[0034] In one embodiment, the setting information acquisition unit further includes:
[0035] A process page display subunit, configured to display a live process selection page when a promotion configuration completion operation for the promotion configuration page is detected, wherein the live process selection page includes a selection trigger control for the live process;
[0036] The process window display subunit is used to display a live broadcast process selection window in the live broadcast process selection page in response to a selection trigger operation on the selection trigger control, wherein the live broadcast process selection window includes a live broadcast process selection list, and the live broadcast process selection list includes at least one optional live broadcast process.
[0037] In one embodiment, the setting information acquisition unit further includes:
[0038] A live broadcast window display subunit, configured to display a live broadcast trigger window in response to a selection completion operation on the live broadcast process selection list after a target live broadcast process is selected in the live broadcast process selection list;
[0039] The game live broadcast starting subunit is used to start the live broadcast for the target live broadcast process in response to the live broadcast trigger operation for the live broadcast trigger window.
[0040] In one embodiment, the promotion content display device based on the live broadcast screen further includes:
[0041] The recognition model acquisition unit is used to acquire a target recognition model and a target configuration file required for displaying the target promotion content according to the live broadcast setting information, the scene setting information, and the promotion content setting information.
[0042] In one embodiment, before acquiring the live broadcast setting information, scene setting information, and promotion content setting information for the target promotion content, the promotion content display device based on the live broadcast screen further includes:
[0043] A sample video acquisition unit, used to acquire a live sample video;
[0044] An image set generating unit, configured to generate a target sample image set required for training a target recognition model based on the live sample video, wherein the target sample image set includes at least one target sample image, and the target sample image includes at least one preset scene feature;
[0045] The sample image input unit is used to input the target sample image into the recognition model to be trained, so as to perform model training on the recognition model to be trained and obtain a trained target recognition model.
[0046] In one embodiment, the image set generating unit includes:
[0047] An image extraction subunit, used to extract images from the live sample video to obtain extracted sample images;
[0048] An image screening subunit, used for screening the extracted sample images based on preset scene features to obtain screened candidate sample images;
[0049] An image enhancement subunit, used to perform an image enhancement operation on the candidate sample image to obtain an enhanced target sample image;
[0050] The image combination subunit is used to combine the target sample images to obtain a combined target sample image set.
[0051] In one embodiment, the display unit comprises:
[0052] A content acquisition subunit, used to acquire target promotion content;
[0053] A parameter determination subunit, used to determine the position parameters of the target display area;
[0054] The content display subunit is used to display the target promotion content in the target display area based on the location parameter.
[0055] Correspondingly, an embodiment of the present application further provides a storage medium on which a computer program is stored, wherein when the computer program is executed by a processor, the steps of the promotional content display method based on the live broadcast screen as shown in the embodiment of the present application are implemented.
[0056] Correspondingly, an embodiment of the present application also provides a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the steps of the promotional content display method based on the live broadcast screen as shown in the embodiment of the present application are implemented.
[0057] The embodiments of the present application can display a live broadcast screen on a live broadcast client; perform feature recognition on a live broadcast scene in the live broadcast screen; when a target scene feature is recognized in the live broadcast scene, determine a target display area for target promotional content in the live broadcast screen according to the target scene feature; and display the target promotional content in the target display area of the live broadcast screen.
[0058] This solution can trigger the display of target promotional content by detecting the target scene features in the live broadcast screen, and make the target display area of the target promotional content in the live broadcast screen more flexibly selected. For example, the target promotional content can be integrated into a specific live broadcast scene; for example, it can be displayed in multiple areas. In this way, when displaying promotional content in the live broadcast screen, it is not limited to fixed areas in the live broadcast screen, such as corner areas. In addition, for the live broadcast process that requires the participation of the anchor, this method can make it possible for the anchor to perform a display trigger operation for the target promotional content when displaying the target promotional content during the live broadcast process, so that it will not interfere with the current operation of the anchor, and can further make the display of promotional content based on the live broadcast screen more efficient. Therefore, by combining intelligent image recognition technology, this method can integrate promotional content into specific scenes of the live broadcast, greatly improving the display efficiency of promotional content based on the live broadcast screen. BRIEF DESCRIPTION OF THE DRAWINGS
[0059] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.
[0060] Figure 1 It is a scene schematic diagram of the promotion content display method based on the live broadcast screen provided in an embodiment of the present application;
[0061] Figure 2 is a flow chart of a promotional content display method based on a live broadcast screen provided in an embodiment of the present application;
[0062] Figure 3 It is a schematic diagram of content promotion of a promotion content display method based on a live broadcast screen provided in an embodiment of the present application;
[0063] Figure 4 Schematic diagram of a game live screen according to a promotional content display method based on a live screen provided in an embodiment of the present application;
[0064] Figure 5 It is a schematic diagram of scene characteristics of a promotional content display method based on a live broadcast screen provided in an embodiment of the present application;
[0065] Figure 6 It is another schematic diagram of a game live broadcast screen according to the promotion content display method based on the live broadcast screen provided in an embodiment of the present application;
[0066] Figure 7 This is another schematic diagram of scene characteristics of the promotion content display method based on the live broadcast screen provided in an embodiment of the present application;
[0067] Figure 8 It is a schematic diagram of a display area of a promotional content display method based on a live broadcast screen provided in an embodiment of the present application;
[0068] Fig. 9 is another content promotion schematic diagram of the promotion content display method based on the live broadcast screen provided in an embodiment of the present application;
[0069] Fig.10 It is a promotion configuration diagram of a promotion content display method based on a live broadcast screen provided in an embodiment of the present application;
[0070] Fig.11 It is a deployment practice architecture diagram of the promotion content display method based on the live broadcast screen provided in the embodiment of the present application;
[0071] Fig.12 It is a schematic diagram of game process selection of a promotional content display method based on a live screen provided in an embodiment of the present application;
[0072] Fig.13 It is a schematic diagram of the steps of the promotion content display method based on the live broadcast screen provided in an embodiment of the present application;
[0073] Fig.14 Schematic diagram of another display area of the promotion content display method based on the live broadcast screen provided in an embodiment of the present application;
[0074] Fig.15 Schematic diagram of another display area of the promotion content display method based on the live broadcast screen provided in an embodiment of the present application;
[0075] Fig.16 is another content promotion schematic diagram of the promotion content display method based on the live broadcast screen provided in an embodiment of the present application;
[0076] Fig.17 It is another flow chart of the promotion content display method based on the live broadcast screen provided in the embodiment of the present application;
[0077] Fig.18 It is a structural schematic diagram of a promotional content display device based on a live broadcast screen provided in an embodiment of the present application;
[0078] Fig.19 is another structural schematic diagram of a promotional content display device based on a live broadcast screen provided in an embodiment of the present application;
[0079] Fig. 20 is another structural schematic diagram of a promotional content display device based on a live broadcast screen provided in an embodiment of the present application;
[0080] Fig.21is another structural schematic diagram of a promotional content display device based on a live broadcast screen provided in an embodiment of the present application;
[0081] Fig. 22 is another structural schematic diagram of a promotional content display device based on a live broadcast screen provided in an embodiment of the present application;
[0082] Fig.23 is another structural schematic diagram of a promotional content display device based on a live broadcast screen provided in an embodiment of the present application;
[0083] Fig.24 is another structural schematic diagram of a promotional content display device based on a live broadcast screen provided in an embodiment of the present application;
[0084] Fig.25 is another structural schematic diagram of a promotional content display device based on a live broadcast screen provided in an embodiment of the present application;
[0085] Fig.26 is another structural schematic diagram of a promotional content display device based on a live broadcast screen provided in an embodiment of the present application;
[0086] Fig. 27 is another structural schematic diagram of a promotional content display device based on a live broadcast screen provided in an embodiment of the present application;
[0087] Fig.28 is another structural schematic diagram of a promotional content display device based on a live broadcast screen provided in an embodiment of the present application;
[0088] Fig.29 is another structural schematic diagram of a promotional content display device based on a live broadcast screen provided in an embodiment of the present application;
[0089] Fig.30 It is a schematic diagram of the structure of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0090] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.
[0091] The embodiment of the present application provides a promotional content display method and device based on a live screen. Specifically, the embodiment of the present application provides a promotional content display device based on a live screen suitable for a computer device. The computer device may be a terminal or a server, and the terminal may be a mobile phone, a tablet computer, a laptop computer, or other devices. The server may be a single server or a server cluster composed of multiple servers.
[0092] The embodiment of the present application will be introduced by taking the promotion content display method based on the live broadcast screen executed by the terminal as an example.
[0093] refer to Figure 1 , the live broadcast client can be run on the terminal 10, so the live broadcast screen can be displayed on the terminal 10, and the live broadcast scene in the live broadcast screen can be feature recognized. When the target scene feature is recognized in the live broadcast scene, the target display area of the target promotion content can be determined in the live broadcast screen according to the recognized target scene feature, so that the target promotion content can be displayed in the target display area of the live broadcast screen later. It is worth noting that the above-mentioned live broadcast screen can be a variety of types of live broadcast screens, for example, it can be a game live broadcast screen, a shopping live broadcast screen, a program live broadcast screen; and so on.
[0094] Optionally, before starting the live broadcast on the terminal 10, live broadcast setting information, scene setting information, and promotion content setting information for the target promotion content may be obtained. The scene setting information may correspond to the live broadcast scene in the live broadcast screen, and the live broadcast scene may have target scene features. After obtaining the aforementioned information, a mapping relationship between the target scene features and the target display area may be established, wherein the target display area is the area where the target promotion content is displayed during the live broadcast. For example, the aforementioned information may be obtained and the mapping relationship may be established by providing an interactive interface.
[0095] Furthermore, the terminal 10 can obtain the target recognition model and target configuration file required for displaying the target promotion content according to the obtained live broadcast setting information, scene setting information, and promotion content setting information, so that the live broadcast scene in the live broadcast screen can be subsequently feature-recognized through the obtained target recognition model and target configuration file.
[0096] In another embodiment, a promotional content display method based on a live broadcast screen is jointly executed by a terminal and a server and applied in a game live broadcast as an example for introduction.
[0097] refer to Figure 1Before the terminal 10 obtains the live broadcast setting information, scene setting information, and promotion content setting information for the target promotion content and establishes a mapping relationship between the target scene features and the target display area, the server 20 can train the target recognition model so that the trained target recognition model can be subsequently sent to the terminal 10, so that the terminal 10 can perform feature recognition on the live broadcast scene in the live broadcast screen of the game through the obtained target recognition model.
[0098] For example, the server 20 may obtain a live sample video of a game, and based on the live sample video, generate a target sample image set required for training a target recognition model, wherein the generated target sample image set may include at least one target sample image, and the target sample image may include at least one preset scene feature, for example, a target scene feature for target promotion content. The server 20 may input the target sample image into the recognition model to be trained to perform model training on the recognition model to be trained, and obtain a trained target recognition model.
[0099] It should be noted that the description order of the following embodiments is not intended to limit the preferred order of the embodiments.
[0100] The embodiment of the present application provides a promotional content display method based on a live screen, which can be executed by a terminal or a server, or by both the terminal and the server. The embodiment of the present application takes the promotional content display method based on a live screen executed by a terminal as an example for explanation. Specifically, the promotional content display method based on a live screen is executed by a promotional content display device based on a live screen integrated in the terminal, such as Figure 2 The specific process of the promotion content display method based on the live broadcast screen can be as follows:
[0101] 101. Display the live broadcast screen on the live broadcast client.
[0102] Live broadcasting is a technology that collects broadcasting data through certain equipment, performs a series of processing on the broadcasting data, such as compressing it into a viewable and transmittable video stream through video encoding, and outputs the processed data to the viewing user end. There are many types of live broadcasting, for example, live broadcasting can include classroom live broadcasting, program live broadcasting, shopping live broadcasting, game live broadcasting, etc.
[0103] Correspondingly, the live broadcast picture may be the picture content displayed during the live broadcast process, for example, the live broadcast picture may be a classroom live broadcast picture, a program live broadcast picture, a shopping live broadcast picture, a game live broadcast picture, and so on.
[0104] In one embodiment, the live broadcast screen may be a game live broadcast screen, wherein the game live broadcast is the process of live broadcasting the game process, for example, the game process in an e-sports event may be live broadcasted; for another example, the game process of the game user's own game operation may be live broadcasted; and so on.
[0105] In the live broadcast of the game, the game host may also introduce or explain the game process, and the identity of the game host in the live broadcast of the game can be in various situations. For example, the game host may not be the current operating user of the game, but may explain the current game process as a user outside the game; or the game host may be a game operating user participating in the game, and during the game process, he or she may perform game operations as a game operating user and explain the game process and game operations as a game host.
[0106] In one embodiment, the live broadcast screen may be a game live broadcast screen, wherein the game live broadcast screen may include partial or complete screen content during the game process, for example, it may include game scenes, game characters, game operation instructions, game special effects and other elements. Optionally, when there is a game anchor participating, the game live broadcast screen may also include screen content of the game anchor explaining the game or operating the game. For example, refer to Figure 4 In this game live broadcast screen, the game screen content and the game anchor screen content in the lower right corner of the screen are included.
[0107] In this embodiment, when live broadcasting is being performed, the live broadcast screen may be first displayed on the live broadcast client so that the target promotion content can be subsequently displayed on the live broadcast screen. In order to more efficiently display the target promotion content, some setting information for the target promotion content may be obtained before starting the live broadcast to display the live broadcast screen, and a mapping relationship between the target promotion content and the target scene features in the live broadcast scene may be established through the obtained setting information. Specifically, before the step of "displaying the live broadcast screen on the live broadcast client", the promotion content display method based on the live broadcast screen may also include:
[0108] Acquire live broadcast setting information, scene setting information, and promotion content setting information for target promotion content, wherein the scene setting information corresponds to the live broadcast scene, and the live broadcast scene has target scene characteristics;
[0109] According to the live broadcast setting information, the scene setting information, and the promotion content setting information, a mapping relationship between the target scene feature and the target display area is established, wherein the target display area is an area for displaying the target promotion content during the live broadcast.
[0110] Among them, promotion can be used to expand the scope of influence of things. For example, marketing, publicity, advertising, etc. can all be a type of promotion. Correspondingly, the promotion content can be the content required for promotion. For example, the promotion content can include data in several different forms, that is, the promotion content can exist in multiple forms, for example, it can be text content, image content, video content, audio content, link content, etc. In addition, it is also possible to combine several contents to obtain the combined promotion content, so that the obtained promotion content can include data in several different forms; for example, taking advertisement as an example, the advertisement content can include multiple contents such as advertisement description text, image, video, audio, interactive settings, etc.; and so on.
[0111] In actual applications, the target promotion content may be advertising content, and the live broadcast screen may be a game live broadcast screen. Figure 3 , the advertisement content 201 can be displayed in the game live broadcast screen. Among them, the advertisement content may include multiple contents such as advertisement description text, image, video, audio, or interactive settings.
[0112] Among them, the live broadcast setting information for the target promotional content can be used to describe the target live broadcast where the target promotional content is to be displayed; for example, the target live broadcast can be determined through the live broadcast setting information; for example, the live broadcast setting information can be the live broadcast name, live broadcast icon or live broadcast logo of the target live broadcast, etc., which can identify the target live broadcast.
[0113] In one embodiment, when the type of live broadcast is game live broadcast, the live broadcast setting information may be game setting information, for example, the game setting information may be in the form of information that can identify the game, such as a game name, a game icon, or a game logo. In another embodiment, when the type of live broadcast is program live broadcast, the live broadcast setting information may be program setting information, for example, the program setting information may be in the form of information that can identify the program, such as a program name, a program icon, or a program logo.
[0114] The live broadcast screen during the live broadcast process may include multiple live broadcast scenes. For example, in a game live broadcast, the game live broadcast screen displayed by the game live broadcast client may include multiple game scenes, such as: Figure 4 A game scene corresponding to the "general selection moment" in a turn-based strategy game, and in this game scene, the game user can select the hero he wants in the middle of the game round; another example, Figure 6 It is a game scene corresponding to the "start time" in a round-based strategy game, and the game scene is a game stage at the beginning of the game round and no battle has been carried out; etc. Therefore, in order to determine the specific target display area of the target promotion content in the live broadcast screen, the live broadcast scene can be further set.
[0115] The scene setting information for the target promotion content can be used to describe the target live broadcast scene corresponding to the target promotion content displayed in the live broadcast screen of the target live broadcast. For example, when the present solution is applied to game live broadcast, the scene setting information can be in the form of information that can identify the game scene, such as the game scene name, game scene icon, or game scene logo. Figure 4 The game scene corresponding to the "selection moment" in a turn-based strategy game is shown; another example is, Figure 6 The game scene corresponding to the "start time" in a turn-based strategy game is shown.
[0116] It is worth noting that the scene setting information corresponds to the live broadcast scene, and the live broadcast scene may have corresponding scene features. Among them, the scene features can be the performance of the prominent nature of the live broadcast scene, so the scene features can be used to identify or recognize the live broadcast scene. For example, when the live broadcast type is game live broadcast, in Figure 4 In the game scene corresponding to the "selection moment" shown in the figure, the game scene feature of the game scene can be Figure 5 The octagonal field in the middle of the picture shown, that is, when the octagonal field is detected, it can be determined that the current game scene of the game is the game scene corresponding to the "selection moment"; for example, in Figure 6 In the game scene corresponding to the "start time" shown, the game scene feature of the game scene can be Figure 7 The nearly square field in the middle of the picture shown, that is, when the nearly square field shown in the figure is detected, it can be determined that the current game scene of the game is the game scene corresponding to the "start moment"; and so on.
[0117] In practical applications, in addition to determining scene features based on the characteristic parts of the live broadcast screen, other factors in the live broadcast process can also be combined. For example, when the live broadcast type is a game live broadcast, in addition to the characteristic parts of the game screen, such as Figure 4 The octagonal venue, Figure 6 The nearly square field in the game scene can be used as a game scene feature, and the game scene feature can also be determined by combining multiple elements such as audio, player operation, game plot, game development logic, etc. The embodiment of the present application is not limited to this.
[0118] The target scene feature may be a scene feature of a live scene showing the target promotion content in the live screen. In this embodiment, since the scene setting information for the target promotion content is obtained, the scene feature of the live scene corresponding to the scene setting information is the target scene feature corresponding to the target promotion content.
[0119] The promotion content setting information for the target promotion content may be related setting information describing the target promotion content. For example, the promotion content setting information may be information that can identify the target promotion content, such as the name, icon, logo, or resource address of the target promotion content.
[0120] It is worth noting that, since the target promotional content may be obtained by combining several contents, the promotional content setting information may include relevant setting information describing the several contents. For example, when the target promotional content includes promotional images and promotional audio, the promotional content setting information for the target promotional content may include promotional content setting information for the promotional image and promotional content setting information for the promotional audio.
[0121] In this embodiment, live broadcast setting information, scene setting information, and promotional content setting information for the target promotional content are obtained, that is, the target promotional content to be displayed, the target live broadcast for displaying the target promotional content, and the corresponding target live broadcast scene in the target live broadcast are determined accordingly. Moreover, since the target live broadcast scene has corresponding target scene characteristics, in actual application, the terminal can identify the target live broadcast scene through the target scene characteristics.
[0122] However, after only determining the target live broadcast for displaying the target promotional content and the target live broadcast scene corresponding to the target live broadcast, further settings can be made to determine that the target promotional content is displayed correctly in the live broadcast screen. For example, in one embodiment, after the step of "obtaining live broadcast setting information, scene setting information, and promotional content setting information for the target promotional content, wherein the scene setting information corresponds to the live broadcast scene, and the live broadcast scene has the target scene characteristics", the following steps can also be included:
[0123] Acquire area setting information for a target display area, wherein the target display area is an area for displaying target promotional content in a target live broadcast scene of a target live broadcast.
[0124] Among them, the area setting information for the target display area can be used to describe the position information of the target display area, so that the position of the target display area can be determined in the target live broadcast scene of the target live broadcast based on the position information.
[0125] In actual applications, after determining the target live broadcast and target live broadcast scene for the target promotional content, the target display area in the target live broadcast scene can be determined in a variety of ways, for example, by manual selection; for example, the live broadcast screen including the target live broadcast scene can be input into an image processing model, and the area suitable for displaying the target promotional content can be determined through the image processing model; and so on.
[0126] In one embodiment, when the live broadcast type is a game live broadcast, refer to Figure 8 For the game scene corresponding to the "moment of selecting generals", you can select a rectangular area in the octagonal field in the figure as the target display area.
[0127] Therefore, in addition to determining the target live broadcast and target live broadcast scene for displaying the target promotional content, the terminal can further determine the specific area for displaying the target promotional content in the game live broadcast screen by obtaining the area setting information for the target display area.
[0128] In this embodiment, after determining the live broadcast setting information, scene setting information, and promotional content setting information for the target promotional content, a mapping relationship between the target scene characteristics and the target display area can be further established, wherein the target display area is the area where the target promotional content is displayed during the live broadcast.
[0129] Among them, the mapping relationship between the target scene feature and the target display area can be used to describe the corresponding relationship between the target scene feature and the target display area. For example, when the live broadcast type is game live broadcast, for a target promotion content, when the terminal detects the target scene feature in the game live broadcast scene of the game live broadcast screen, the target display area of the target push content can be determined through the mapping relationship between the target scene feature and the target display area.
[0130] By establishing a mapping relationship between the target scene feature and the target display area, the target display area can be correspondingly determined in the target live broadcast scene, so that different display areas can be flexibly switched during the live broadcast based on the differences in each live broadcast scene. For example, in one embodiment, when the live broadcast type is a game live broadcast, the target promotion content can be a QR code image, and the target live broadcast scene for setting the target promotion content can be the game live broadcast scene corresponding to the "moment of selecting generals". Since the scene feature of the game live broadcast scene corresponding to the "moment of selecting generals" is an octagonal venue, and the target display area that has a mapping relationship with the scene feature is Figure 8 The display area shown, therefore, refers to Fig. 9 When the target live broadcast scene is detected through the target scene feature in the game live broadcast screen, the target display area of the target promotion content can be determined accordingly.
[0131] In actual applications, there are many ways to obtain the live broadcast setting information, scene setting information, and promotion content setting information for the target promotion content, for example, by providing an interactive interface on the terminal; by requesting a database; by parsing a configuration table including this information; etc. Specifically, the step of "obtaining the live broadcast setting information, scene setting information, and promotion content setting information for the target promotion content" may include:
[0132] Displaying a promotion configuration page for the target promotion content, wherein the promotion configuration page includes at least one promotion configuration control, and the promotion configuration control includes a live broadcast setting control, a scene setting control, and a promotion content setting control;
[0133] In response to a promotion configuration operation on a promotion configuration control, promotion configuration information for target promotion content is obtained, wherein the promotion configuration information includes live broadcast setting information, scene setting information, and promotion content setting information.
[0134] The control in this embodiment may be in the form of an icon, an input box, a button, etc.
[0135] The promotion configuration operation in this embodiment may be in the form of a specific touch operation, such as a single-click operation, a long-press operation, a double-click operation, and a sliding operation, etc., or may be triggered by voice; optionally, the login trigger operation may also be a combination of a series of operations, which is not limited in this embodiment.
[0136] In one embodiment, live broadcast setting information for target promotional content can be obtained through a live broadcast setting control, scene setting information for target promotional content can be obtained through a scene setting control, and promotional content setting information for target promotional content can be obtained through a promotional content setting control.
[0137] In one embodiment, the live broadcast type may be a game live broadcast, the target promotion content may be an advertisement content, and the target promotion content may include a QR code image and a promotion audio pre-recorded by the game anchor. Fig.10 The promotion configuration page 202 is shown in FIG. 2 , wherein the promotion configuration page 202 may include at least one promotion configuration control, for example, it may include the live broadcast setting control shown in 203, the scene setting control shown in 204, and the promotion content setting control shown in 205, wherein the scene setting control shown in 204 may include several optional sub-controls; the promotion content setting control shown in 205 may include the promotion image setting control shown in 206, and the promotion audio setting control shown in 207.
[0138] When the user completes various promotion configurations through the promotion configuration page, the terminal can correspondingly obtain promotion configuration information including live broadcast setting information, scene setting information, and promotion content setting information. Fig.10The terminal can obtain the live broadcast setting information of the target promotion content as "Game A", the scene setting information as "Selection Moment" through the promotion configuration page shown in 202, and the promotion content setting information can include the resource path of the QR code image "C:\Picture\QR code.png" and the resource path of the promotion audio "C:\Picture\Promotional Shop.mp3", so that the terminal can obtain the corresponding promotion content through the resource path.
[0139] It is worth noting that in addition to obtaining the live broadcast setting information, scene setting information, and promotion content setting information for the target promotion content, an effect preview window can also be set in the promotion configuration page so that the corresponding promotion preview effect can be displayed in the promotion configuration page. Specifically, the step of "obtaining the live broadcast setting information, scene setting information, and promotion content setting information for the target promotion content" can also include:
[0140] In response to the promotion configuration operation on the promotion configuration control, the corresponding promotion display preview effect is displayed in the effect preview window.
[0141] In one embodiment, since the promotion configuration page may include at least one promotion configuration control, and thus may correspondingly include at least one promotion configuration operation, there may be multiple ways to display the corresponding promotion display preview effect in the effect preview window.
[0142] For example, you can refresh the promotion display preview effect in the effect preview window after each promotion configuration operation; for example, when the live broadcast type is game live broadcast, refer to Fig.10 When "Game A" is selected through the live broadcast setting control 203, the game name, game icon, game poster, game screen and other game materials corresponding to Game A can be displayed in the effect preview window 208; on this basis, when "Selection Moment" is selected through the scene setting control 204, the scene name, scene icon, scene poster or scene screen and other scene materials corresponding to the "Selection Moment" game scene can be further displayed in the effect preview window 208; on this basis, when the resource path of the promotion image is set to "C:\Picture\QR code.png" through the promotion image setting control 206, the QR code image can be further displayed in the target display area in the "Selection Moment" game scene in the effect preview window 208; finally, when the resource path of the promotion audio is set to "C:\Picture\Promotion Shop.mp3" through the promotion audio setting control 207, the corresponding promotion audio can be played through a speaker or a loudspeaker and other devices, so that it can be combined with the existing preview screen in the effect preview window 208 to obtain the final promotion display preview effect.
[0143] For example, the corresponding promotion display preview effect can be displayed in the effect preview window only after some or all promotion configuration operations are completed; for example, when the live broadcast type is game live broadcast, refer to Fig.10 When "Game A" is selected through the live broadcast setting control 203, the "Selection Moment" game live broadcast scene is selected through the scene setting control 204, the resource path of the promotional image is set to "C:\Picture\QR Code.png" through the promotional image setting control 206, and the resource path of the promotional audio is set to "C:\Picture\Promotional Shop.mp3" through the promotional audio setting control 207, the corresponding promotional audio is played through devices such as speakers or loudspeakers, and the corresponding preview effect is displayed in the effect preview window 208 to obtain the final promotion display preview effect.
[0144] It is worth noting that if the target promotion content includes data in at least one format, such as images, audio, video, interactive operations, etc., it can be displayed accordingly through the effect preview window of the promotion configuration page in combination with other devices.
[0145] In actual applications, after completing the promotion settings for the target promotion content, you can further select the live broadcast process to start the live broadcast. Specifically, the step of "obtaining the live broadcast setting information, scene setting information, and promotion content setting information for the target promotion content" can also include:
[0146] When a promotion configuration completion operation on the promotion configuration page is detected, a live broadcast process selection page is displayed, wherein the live broadcast process selection page includes a selection trigger control for the live broadcast process;
[0147] In response to a selection trigger operation on a selection trigger control, a live broadcast process selection window is displayed in the live broadcast process selection page, wherein the live broadcast process selection window includes a live broadcast process selection list, and the live broadcast process selection list includes at least one selectable live broadcast process.
[0148] The control in this embodiment may be in the form of an icon, an input box, a button, etc.
[0149] The promotion configuration completion operation or selection trigger operation in this embodiment can be a specific touch operation, such as a single-click operation, a long-press operation, a double-click operation, and a sliding operation, etc., and can also be triggered by voice; optionally, the login trigger operation can also be a combination of a series of operations, which is not limited in this embodiment.
[0150] The promotion configuration completion operation on the promotion configuration page may be implemented in a variety of ways. For example, a promotion configuration completion control may be provided, and the promotion configuration completion operation may be implemented by triggering the promotion configuration completion control; and so on.
[0151] Among them, a process is a running activity of a program in a computer on a certain data set. It is the basic unit for resource allocation and scheduling of the system and the foundation of the operating system structure. In the early computer structure designed for processes, processes are the basic execution entities of programs; in the contemporary computer structure designed for threads, processes are the containers of threads. A program is a description of instructions, data and their organizational forms, and a process is the entity of a program.
[0152] In one embodiment, the live broadcast type may be a game live broadcast. When it is detected that the promotion configuration operation on the promotion configuration page is completed, refer to Fig.12 , the live broadcast process selection page shown in 209 can be displayed on the terminal, which may include the selection trigger control of the live broadcast process shown in 210.
[0153] like Fig.12 As shown, when a selection trigger operation for the selection trigger control 210 is detected, a live process selection window shown in 211 can be displayed in the live process selection page 209, which may include a live process selection list shown in 212, and the live process selection list may include at least one optional live process, refer to Fig.12 ,The figure shows four optional live broadcast processes: “Game A”, “Process 1”, “Process 2”, and “Process 3”.
[0154] Further, after determining the live broadcast process to be broadcasted, the live broadcast can be started. Specifically, the step of "obtaining live broadcast setting information, scene setting information, and promotion content setting information for the target promotion content" can also include:
[0155] After the target live broadcast process is selected in the live broadcast process selection list, in response to the selection completion operation for the live broadcast process selection list, a live broadcast trigger window is displayed.
[0156] In response to a live broadcast trigger operation on a live broadcast trigger window, a live broadcast on a target live broadcast process is started.
[0157] The game process selection completion operation or the game live broadcast trigger operation in this embodiment can be a specific touch operation, such as a single-click operation, a long-press operation, a double-click operation, and a sliding operation, etc., and can also be triggered by voice; optionally, the login trigger operation can also be a combination of a series of operations, which is not limited in this embodiment.
[0158] In one embodiment, reference Fig.12After selecting "Game A" as the target live process in the live process selection list shown in 212, the live process selection completion operation for the live process selection list 212 can be completed by triggering the live process selection completion control shown in 213, and the live trigger window is displayed.
[0159] Optionally, the live broadcast trigger window may include a live broadcast trigger control, and the live broadcast trigger operation can be implemented by triggering the live broadcast trigger control to start the live broadcast of the target live broadcast process.
[0160] For example, refer to Fig.12 When the target live broadcast process "Game A" is selected in the live broadcast process selection list 212, the live broadcast process selection completion operation for the live broadcast process selection list 212 can be completed by triggering the "Confirm" button shown in 213, and the live broadcast trigger window is displayed. Further, the live broadcast trigger operation can be implemented by triggering the live broadcast trigger control to start the live broadcast for "Game A".
[0161] In addition to obtaining the live broadcast setting information, scene setting information and promotion content setting information for the target promotion content by providing an interactive interface and starting the live broadcast, the terminal can also obtain the target recognition model and target configuration file required for displaying the target promotion content, so that after starting the game live broadcast, the live broadcast screen can be recognized by the obtained target recognition model and target configuration file. Specifically, before the step of "displaying the live broadcast screen on the live broadcast client", the promotion content display method based on the live broadcast screen can also include:
[0162] According to the live broadcast setting information, the scene setting information, and the promotion content setting information, a target recognition model and a target configuration file required for displaying the target promotion content are acquired.
[0163] Before performing feature recognition on the live scene in the live screen, the required target recognition model and target configuration file may be obtained.
[0164] In one embodiment, the target promotional content includes advertising images and sounds, and corresponding components or applications can be developed for displaying promotional content in live broadcast images, for example, Fig.11, a "live broadcast assistant" can be developed and loaded on the terminal. It can be seen that before the "live broadcast assistant" intelligently integrates the target promotion content with the live broadcast screen to obtain the live broadcast screen showing the target promotion content, it can also include loading the required AI recognition model and configuration file through the artificial intelligence (AI) recognition engine, so that when applied, the AI recognition engine loaded with the AI recognition model and configuration file can complete the feature recognition of the live broadcast screen and the subsequent event triggering operation.
[0165] Among them, artificial intelligence (AI) is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results. In other words, artificial intelligence is a comprehensive technology in computer science that attempts to understand the essence of intelligence and produce a new intelligent machine that can respond in a similar way to human intelligence. Artificial intelligence is to study the design principles and implementation methods of various intelligent machines so that machines have the functions of perception, reasoning and decision-making.
[0166] Artificial intelligence technology is a comprehensive discipline that covers a wide range of fields, including both hardware-level and software-level technologies. The basic technologies of artificial intelligence generally include sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technology, operation / interaction systems, mechatronics and other technologies. Artificial intelligence software technology mainly includes computer vision technology, speech processing technology, natural language processing technology, and machine learning / deep learning.
[0167] In one embodiment, the live broadcast setting information of the target promotion content is "Game A", the scene setting information is "Selection Moment", and the promotion content setting information is the resource address of the QR code image "C:\Picture\QR code.png" and the resource address of the promotion audio "C:\Picture\Promotion Shop.mp3", then the terminal can correspondingly obtain the target recognition model and target configuration file required when the QR code image and promotion audio are to be displayed in the "Selection Moment" game scene of Game A during the live broadcast. So that when the QR code image of the target promotion content is to be displayed and the promotion audio is to be played in the "Selection Moment" game scene during the live broadcast of Game A, this can be achieved through the target recognition model and target configuration file.
[0168] Optionally, before the terminal obtains the live broadcast setting information, scene setting information, and promotion content setting information for the target promotion content, it can also train the target recognition model to obtain the trained target recognition model. Specifically, before the step of "obtaining the live broadcast setting information, scene setting information, and promotion content setting information for the target promotion content", the promotion content display method based on the live broadcast screen can also include:
[0169] Get live sample video;
[0170] Based on the live sample video, a target sample image set required for training the target recognition model is generated, wherein the target sample image set includes at least one target sample image, and the target sample image includes at least one preset scene feature;
[0171] The target sample image is input into the recognition model to be trained to perform model training on the recognition model to be trained, thereby obtaining a trained target recognition model.
[0172] Among them, the live broadcast sample video can be a sample video required for training the target recognition model. For example, when the live broadcast type is a game live broadcast, the live broadcast sample video can be an image set including the game screen of the target game in the target game scene.
[0173] There are many ways to obtain live sample videos. For example, you can obtain live sample videos by recording the live broadcast process. Or you can obtain live sample videos by capturing the online live broadcast screen of the authorized user; and so on.
[0174] In one embodiment, reference Fig.13 Before model training, materials can be collected by acquiring live sample videos. Furthermore, the collected materials can be preprocessed so that a target sample image set required for training the target recognition model can be generated based on the acquired live sample videos. There are many methods for generating a target sample image set. For example, it can be achieved by screening, image enhancement, and combination of sample images in live sample videos. Specifically, the step of "generating a target sample image set required for training the target recognition model based on live sample videos, wherein the target sample image set includes at least one target sample image, and the target sample image includes at least one preset scene feature" may include:
[0175] Performing image extraction on the live sample video to obtain an extracted sample image;
[0176] Based on the preset scene features, the extracted sample images are screened to obtain screened candidate sample images;
[0177] Performing an image enhancement operation on the candidate sample image to obtain an enhanced target sample image;
[0178] The target sample images are combined to obtain a combined target sample image set.
[0179] It is worth noting that before image extraction, the steps of regional analysis and regional labeling of the live broadcast scene can also be included. For example, if the live broadcast type is game live broadcast, for each game scene in the game, the display area that can represent the game scene can be analyzed and the display area can be labeled.
[0180] There are many ways to analyze the display area in the live broadcast scene. For example, manual analysis can be used, such as manually analyzing the area in the live broadcast scene that is suitable for displaying promotional content as the display area, and marking the display area; or model analysis can be used, such as inputting the live broadcast screen including the live broadcast scene into the marking model, determining the display area in the live broadcast scene that is suitable for displaying promotional content through the marking model, and marking the display area; and so on.
[0181] It is worth noting that the location of the display area in the game scene can be fixed or flexibly determined within a certain range. For example, if the live broadcast type is a game live broadcast, refer to Figure 8 For the game scene corresponding to the "selection moment" in game A, the display area in the game scene can be fixed to the central area of the octagonal field in the game scene. Figure 6 For the game scene corresponding to the "start time" in game A, since in this game scene, the game characters can freely move around on the field in the scene, therefore, refer to Fig.14 , the venue can be determined as a candidate area for displaying promotional content, and the specific display area can be determined in combination with the distribution of game characters in the game scene during the game live broadcast. For example, Fig.13 , when in a live game broadcast, the game characters in the game scene are like Fig.15 As shown, you can Fig.15 Select the display area as shown.
[0182] There are many ways to mark the display area. For example, it can be achieved by recording the position parameters of the display area, or by recording the regional features of the display area, and so on.
[0183] In one embodiment, the display area can be marked by recording the position parameters of the display area. For example, if the marked display area is a rectangle, the value of the coordinates of the upper left corner of the display area and the width and height of the display area can be recorded; for another example, if the marked display area is a circle, the value of the coordinates of the center of the display area and the radius value can be recorded; and so on.
[0184] There are many ways to extract images from live sample videos. For example, you can use multimedia processing software to extract sample images from live sample videos. For example, you can use FFmpeg to capture images from live sample videos at a rate of one image per second to extract images from the live sample videos and obtain the extracted sample images. FFmpeg is an open source computer program that can be used to record and convert digital audio and video and convert them into streams. It provides a complete solution for recording, converting, and streaming audio and video.
[0185] It is worth noting that the extracted sample images may include those with scene features or those without scene features. Therefore, the extracted sample images may be subsequently screened to obtain candidate sample images including scene features.
[0186] For example, an automated tool may be designed to remove those sample images without scene features from the extracted sample images based on preset scene features, so that the screened candidate sample images all include at least one preset scene feature.
[0187] Furthermore, the obtained candidate sample images can be subjected to image enhancement operations, wherein image enhancement can be used to enhance useful information in the image. It can be a distortion process, the purpose of which is to improve the visual effect of the image, for the application of a given image. Moreover, image enhancement can purposefully emphasize the overall or local characteristics of the image, make the originally unclear image clear or emphasize certain features of interest, expand the differences between the features of different objects in the image, suppress features of no interest, so as to improve the image quality, enrich the amount of information, enhance the image interpretation and recognition effect, and meet the needs of certain special analysis.
[0188] There are many ways to perform image enhancement. For example, it can be achieved through frequency domain method or spatial domain method. The former regards the image as a two-dimensional signal and performs signal enhancement based on two-dimensional Fourier transform. Low-pass filtering (i.e., only low-frequency signals are allowed to pass) can remove noise from the image; high-pass filtering can enhance high-frequency signals such as edges to make blurred images clear. Representative algorithms in the latter spatial domain method include local averaging method and median filtering (taking the middle pixel value in the local neighborhood), which can be used to remove or reduce noise.
[0189] In one embodiment, the imgaug library of Python can be used to perform image enhancement operations such as contrast transformation and noise addition on the obtained candidate sample images to expand the data set to obtain enhanced target sample images, wherein imgaug is an image enhancement library used for machine learning experiments.
[0190] Furthermore, after obtaining the enhanced target sample images, the target sample images may be combined to obtain a combined target sample image set.
[0191] After obtaining the target sample image set, refer to Fig.13 , the target sample image can be input into the recognition model to be trained to perform model training on the recognition model to be trained.
[0192] There are many ways to perform model training. For example, based on the combination of a deep learning framework and a deep learning model, the target sample image can be input into the recognition model to be trained to perform model training on the recognition model to be trained.
[0193] In one embodiment, the deep learning framework caffee and the lightweight model SqueezeNet can be used. Since the neural network performs network deep compression on the model, the number of parameters is significantly reduced by 50X compared with the neural network model AlexNet, and the deep compression technology can be used to further achieve a compression ratio of 461X. Further, after adjusting the convolution output layer parameters of the network to adapt the number of classes to be identified, the target sample images in the target sample image set can be converted into lmdb files through the image data conversion tool convert_imageset provided by caffe, and the order is disrupted during the conversion process, wherein lmdb is the abbreviation of Lightning Memory-MappedDatabaseManager, which refers to a lightning-like memory-mapped database manager. Its main role in Caffe is to provide data management, converting various raw data into a unified key-value pair storage, so that Caffe can obtain these data. Subsequently, the width and height applicability of the converted target sample image can be adjusted to 256, and the model can be trained using a GPU (graphics processing unit, the full name of which is Graphics Processing Unit) machine (P40) and fine-tuning.
[0194] 102. Perform feature recognition on the live broadcast scene in the live broadcast screen.
[0195] It is worth noting that reference Fig.13Before performing feature recognition on the live scene in the live screen, the trained recognition model can also be deployed on the terminal so that the terminal can perform feature recognition on the live scene in the live screen based on the deployed recognition model. For example, an OpenCV-based AI recognition engine can be implemented to load the trained recognition model, and the recognition environment can be deployed on the terminal to perform feature recognition on the live scene in the live screen.
[0196] Furthermore, after deployment, the live broadcast screen can be identified. Specifically, the step of "identifying features of the live broadcast scene in the live broadcast screen" may include:
[0197] Get live screen;
[0198] Extracting a live scene image corresponding to the live scene from the live screen;
[0199] The live scene image is input into the target recognition model so as to perform feature recognition on the live scene image through the target recognition model.
[0200] In one embodiment, reference Fig.11 , the game screen can be input into the AI recognition engine deployed on the terminal, so that correspondingly, the terminal can obtain the live broadcast screen, and the AI recognition engine can perform feature recognition on the live broadcast scene in the live broadcast screen.
[0201] In actual applications, there are many ways to obtain live broadcast images. For example, it can be obtained by requesting a server; for example, it can be obtained by the terminal itself by capturing, recording, etc. the live broadcast images on the terminal; for example, it can be obtained through other terminal devices; and so on.
[0202] Among them, since the acquired live screen may include a live scene image corresponding to the live scene, and may also include other image content, such as a background image, etc. Therefore, after acquiring the live screen, the live scene image corresponding to the live scene can be extracted from the live screen, for example, the live scene part can be cut out to obtain the live scene image.
[0203] Further, refer to Fig.11 The obtained live scene image can be input into a target recognition engine to perform feature recognition on the live scene image through the target recognition engine. Specifically, the step of “inputting the live scene image into a target recognition model to perform feature recognition on the live scene image through the target recognition model” can include:
[0204] Acquire a target configuration file, wherein the target configuration file includes feature description information of at least one candidate scene feature;
[0205] Through the target recognition model, the live scene image is matched with the feature description information to obtain the matching result;
[0206] Based on the matching results, a feature recognition result of the live scene in the live screen is determined.
[0207] The configuration file is a computer file that can configure parameters and initial settings for some computer programs. For example, in this embodiment, the configuration file may include feature description information of at least one candidate scene feature.
[0208] Since the target configuration file includes feature description information of at least one candidate scene feature, when the target recognition model recognizes the scene feature to be matched in the live scene image, the scene feature can be matched with the candidate scene feature in the target configuration file to obtain the matching result of the live scene image. For example, the live scene image can be feature matched with all the candidate scene features in the target configuration file by traversing until a hit is found or the traversal ends.
[0209] Among them, the matching results can be in various forms. For example, when the live scene image is feature matched with the feature description information of the candidate scene features, the matching result can be determined only in the form of a hit or a miss; for example, the matching result can be presented in the form of a matching score; and so on.
[0210] In one embodiment, the matching result may be described in the form of a matching score. Therefore, through feature matching, the matching score between the live scene in the live screen and the features of each candidate scene may be obtained.
[0211] There may be a variety of ways to determine the feature recognition results of the live scene in the live screen based on the matching results. For example, when the matching results are described by matching scores, the candidate scene feature with the highest score may be determined as the scene feature that hits the live scene. For another example, the highest matching score may be selected, and the matching score may be judged in combination with a preset threshold. If the highest matching score meets the preset threshold, the scene feature corresponding to the matching score may be considered to be the candidate scene feature that hits the live scene. Otherwise, it is considered that the live scene does not hit any candidate scene feature. And so on.
[0212] 103. When a target scene feature is identified in the live broadcast scene, a target display area for the target promotion content is determined in the live broadcast screen according to the target scene feature.
[0213] Since the target scene features are identified in the live broadcast scene by the target recognition model, the target display area of the target promotion content can be determined by determining the target mapping relationship corresponding to the target scene features. Specifically, the step of "when the target scene features are identified in the live broadcast scene, determine the target display area of the target promotion content in the live broadcast screen according to the target scene features" may include:
[0214] Determine a mapping relationship set for the promotional content, wherein the mapping relationship set includes a mapping relationship between a preset scene feature and a preset display area, and the preset display area is an area for displaying the promotional content during live broadcast;
[0215] According to the mapping relationship set and the target scene characteristics, the target display area of the target promotion content is determined in the live broadcast screen.
[0216] In actual applications, there may be multiple promotional contents to be displayed, so the corresponding mapping relationship may be determined for each promotional content to be displayed, wherein the mapping relationship is the mapping relationship between the display area of the promotional content and the scene feature of the live broadcast scene where the display area is located. After the mapping relationships corresponding to the multiple promotional contents to be displayed are determined, a mapping relationship set for the promotional content is obtained.
[0217] Furthermore, the target display area of the target promotion content can be determined in the live broadcast screen according to the mapping relationship set and the target scene characteristics. Specifically, the step of "determining the target display area of the target promotion content in the live broadcast screen according to the mapping relationship set and the target scene characteristics" may include:
[0218] Determine a target mapping relationship corresponding to the target scene feature in the mapping relationship set, wherein the target mapping relationship is a mapping relationship between the target scene feature and a target display area, and the target display area is an area for displaying target promotional content during live broadcast;
[0219] Based on the target mapping relationship, generating a response event in response to the target scene feature;
[0220] Through the response event, the position parameters required to determine the target display area are obtained;
[0221] According to the position parameter, the target display area is determined in the live broadcast screen.
[0222] Since the mapping relationship set includes the mapping relationships between display areas of multiple promotional contents and scene features, the target mapping relationship corresponding to the target scene feature in the mapping relationship set can be determined by query or search, so that the target display area when displaying the target promotional content in the live broadcast screen can be determined through the target mapping relationship.
[0223] In one embodiment, reference Fig.11 When the target recognition engine performs feature recognition on the live scene image in the live screen, when the target scene feature is hit, a response event responsive to the target scene feature can be triggered. In addition, the corresponding target display area can be determined based on the target mapping relationship, and a response event responsive to the target scene feature and carrying the location information of the target display area can be generated. Since the response event can send information such as location information and live scene identification to the system, the location parameters required to determine the target display area can be obtained through the response event.
[0224] Furthermore, after obtaining the position parameter, the position of the target display area in the live broadcast screen can be determined based on the position parameter to determine the target display area in the live broadcast screen. It is worth noting that since the target display area is determined by the target scene feature, accordingly, the target promotion content can be further displayed in the game live broadcast screen by applying the determined target mapping relationship.
[0225] 104. Display the target promotional content in the target display area of the live broadcast screen.
[0226] After determining the target display area of the target promotion content in the live broadcast screen, the target promotion content can be displayed in the target display area. Specifically, the step of "displaying the target promotion content in the target display area of the live broadcast screen" may include:
[0227] Obtain targeted promotional content;
[0228] Determine the location parameters of the target display area;
[0229] Based on the location parameter, the target promotion content is displayed in the target display area.
[0230] In one embodiment, reference Fig.11 , the terminal's live broadcast assistant obtains the target promotional content by loading the target promotional content, such as advertisements, promotional audio, etc., and after obtaining the position parameters of the target display area by responding to the response event of the target scene feature, the target promotional content can be displayed in the target display area according to the position parameters. For example, the advertising content can be rendered on the canvas and the promotional audio can be played. Finally, by integrating the live broadcast picture and the sound, a final integrated picture can be obtained, in which the live broadcast picture of the advertisement and the promotional audio played by the terminal are integrated in the final picture. Subsequently, the final picture can be pushed to the server, for example, it can be pushed to the server through the Real Time Messaging Protocol (RTMP), thereby completing the display of the target promotional content in the target display area of the live broadcast picture.
[0231] In another embodiment, when the live broadcast type is a game, and the live broadcast scene in the live broadcast screen is a game scene corresponding to the "start time" of game A, when displaying a promotional image of "new store opening" in the live broadcast scene, it can be as follows: Fig.16 As shown, the target promotion content is displayed in the target display area shown in the figure.
[0232] As can be seen from the above, this embodiment can display a game live broadcast screen on a game live broadcast client; perform feature recognition on a game scene in the game live broadcast screen; when a target game scene feature is recognized in the game scene, a target display area for target promotional content is determined in the game live broadcast screen according to the target game scene feature; and the target promotional content is displayed in the target display area of the game live broadcast screen.
[0233] This solution can trigger the display of target promotional content by detecting the target scene features in the live broadcast screen, and make the target display area of the target promotional content in the live broadcast screen more flexibly selected. For example, the target promotional content can be integrated into a specific live broadcast scene; for example, it can be displayed in multiple areas. In this way, when displaying promotional content in the live broadcast screen, it is not limited to fixed areas in the live broadcast screen, such as corner areas. In addition, for the live broadcast process that requires the participation of the anchor, this method can make it possible for the anchor to perform a display trigger operation for the target promotional content when displaying the target promotional content during the live broadcast process, so that it will not interfere with the current operation of the anchor, and can further make the display of promotional content based on the live broadcast screen more efficient. Therefore, by combining intelligent image recognition technology, this method can integrate promotional content into specific scenes of the live broadcast, greatly improving the display efficiency of promotional content based on the live broadcast screen.
[0234] Secondly, by using this solution to display promotional content in the live broadcast screen, the live broadcast screen can be processed efficiently. For example, when applied to game live broadcast, the time required to process the game live broadcast screen is approximately between 50ms and 100ms, so that the game live broadcast screen can be basically processed in real time. In addition, this solution provides a variety of ways to determine the target display area of the target promotional content, so that the position of the display area in the live broadcast scene can be fixed or flexibly determined within a certain range. Therefore, it can provide more display possibilities on the basis of improving the display efficiency of promotional content based on the live broadcast screen.
[0235] According to the method described in the above embodiment, the following will give an example to further illustrate in detail.
[0236] In this embodiment, a promotional content display device based on a live broadcast screen is integrated in a server and a terminal as an example for explanation. The server can be a single server or a server cluster composed of multiple servers; the terminal can be a mobile phone, a tablet computer, a laptop computer and other devices.
[0237] like Fig.17 As shown, a promotion content display method based on live broadcast screen, the specific process is as follows:
[0238] 301. The terminal obtains live broadcast setting information, scene setting information, and promotion content setting information for target promotion content, wherein the scene setting information corresponds to a live broadcast scene, and the live broadcast scene has target scene characteristics.
[0239] In one embodiment, the live broadcast setting information, scene setting information, and promotion content setting information for the target promotion content may be obtained by displaying a promotion configuration page for the target promotion content on the terminal.
[0240] For example, the promotion configuration page provided by the terminal may include live broadcast setting controls, game scene setting controls, and promotion content setting controls, and when a live broadcast setting operation is detected for the live broadcast setting control, live broadcast setting information for the target promotion content can be obtained; when a scene setting operation is detected for the scene setting control, scene setting information for the target promotion content can be obtained; when a promotion content setting operation is detected for the promotion content setting control, promotion content setting information for the target promotion content can be obtained.
[0241] It is worth noting that the control in this embodiment can be in the form of an icon, an input box, a button, etc. The trigger operation in this embodiment can be in the form of a specific touch operation, such as a single-click operation, a long-press operation, a double-click operation, and a sliding operation, etc., and can also be triggered by voice; optionally, the login trigger operation can also be a combination of a series of operations, which is not limited in this embodiment.
[0242] 302. The terminal establishes a mapping relationship between a target scene feature and a target display area according to the live broadcast setting information, the scene setting information, and the promotion content setting information, wherein the target display area is an area for displaying the target promotion content during the live broadcast.
[0243] The mapping relationship between the target scene feature and the target display area can be used to describe the corresponding relationship between the target scene feature and the target display area. For example, for a target promotion content, when the terminal detects the target scene feature in the live scene of the live screen, the target display area of the target promotion content can be determined through the mapping relationship between the target scene feature and the target display area.
[0244] In this embodiment, since the live broadcast setting information, scene setting information, and promotional content setting information for the target promotional content are obtained, the target promotional content to be displayed, the target live broadcast for displaying the target promotional content, and the target live broadcast scene during the target live broadcast are determined accordingly. Moreover, since the target live broadcast scene has corresponding target scene characteristics, a mapping relationship between the target scene characteristics and the target display area can be established, so that in actual application, the terminal can identify the target scene through the target scene characteristics.
[0245] 303. The terminal generates a model request for the target recognition model according to the live broadcast setting information, the scene setting information, and the promotion content setting information, and sends the model request to the server.
[0246] In one embodiment, the terminal can determine the target live broadcast that displays the target promotion content through the live broadcast setting information. The server can train different recognition models for different live broadcast types. Therefore, the terminal can generate a model request based on the obtained live broadcast setting information to request the server for the target recognition model required for recognizing the live broadcast screen in the target live broadcast.
[0247] In another embodiment, the terminal can determine the target live broadcast that displays the target promotion content and the corresponding target live broadcast scene through the live broadcast setting information and the scene setting information. The server can train different recognition models for different live broadcast types and live broadcast scenes. Therefore, the terminal can generate a model request based on the obtained live broadcast setting information and the scene setting information to request the server to recognize the target recognition model required for the live broadcast screen including the target live broadcast scene in the target live broadcast.
[0248] In another embodiment, the terminal can determine the target promotional content to be displayed and the target live broadcast to display the target promotional content through the live broadcast setting information and the promotional content setting information. The server can train different recognition models for different live broadcast types and promotional content. Therefore, the terminal can generate a model request based on the obtained live broadcast setting information and promotional content setting information to request the server for the target recognition model required for recognizing the live broadcast screen of the target live broadcast.
[0249] 304. The server receives the model request and sends the target recognition model and target configuration file required for displaying the target promotion content to the terminal.
[0250] The server side can respond to the model request sent by the terminal and send the required target recognition model and target configuration file to the terminal. The configuration file is a computer file that can configure parameters and initial settings for some computer programs. For example, in this embodiment, the configuration file can include feature description information of at least one candidate scene feature.
[0251] 305. The terminal uses the target recognition model and the target configuration file to perform feature recognition on the live scene in the live screen.
[0252] In one embodiment, since the target configuration file includes feature description information of at least one candidate scene feature, the terminal can extract a live scene image corresponding to the live scene from the live screen after acquiring the live screen, and input the live scene image into the target recognition model to perform feature recognition on the live scene image through the target recognition model.
[0253] 306. When a target scene feature is identified in the live broadcast scene, the terminal determines a target display area for the target promotion content in the live broadcast screen according to the target scene feature.
[0254] In one embodiment, the terminal may determine a mapping relationship set for promotional content, wherein the mapping relationship set includes a mapping relationship between a preset scene feature and a preset display area, and the preset display area is an area for displaying the promotional content during live broadcast. Further, a target mapping relationship corresponding to a target scene feature may be determined from the mapping relationship set, and a target display area for the target promotional content may be determined in the game live broadcast screen according to the target mapping relationship.
[0255] 307. The terminal displays the target promotion content in the target display area of the live broadcast screen.
[0256] In one embodiment, after acquiring the target promotion content, the terminal may determine the position parameters of the target display area, and based on the position parameters, display the target promotion content in the target display area.
[0257] As can be seen from the above, the embodiments of the present application can trigger the display of target promotion content by detecting the target scene features in the live broadcast screen, and make the target display area of the target promotion content in the live broadcast screen more flexibly selectable, for example, the target promotion content can be integrated into a specific live broadcast scene; for example, it can be displayed in multiple areas. In this way, when displaying promotion content in the live broadcast screen, it is not limited to a fixed area in the live broadcast screen, such as a corner area. In addition, for the live broadcast process that requires the participation of the anchor, the method can make it possible for the anchor to perform a display trigger operation for the target promotion content when displaying the target promotion content during the live broadcast process, so that it will not interfere with the current operation of the anchor, and can further make the display of promotion content based on the live broadcast screen more efficient. Therefore, the embodiments of the present application can integrate promotion content into specific scenes of the live broadcast by combining intelligent image recognition technology, greatly improving the display efficiency of promotion content based on the live broadcast screen.
[0258] In order to better implement the above method, the embodiment of the present application also provides a promotional content display device based on a live broadcast screen, wherein the promotional content display device based on a live broadcast screen can be integrated in a server or a terminal. The server can be a single server or a server cluster composed of multiple servers; the terminal can be a mobile phone, a tablet computer, a laptop computer, and other devices.
[0259] For example, Fig.18 As shown, the promotion content display device based on the live broadcast screen may include a display unit 401, an identification unit 402, a determination unit 403, and a display unit 304, as follows:
[0260] Display unit 401, used to display the live broadcast screen on the live broadcast client;
[0261] The recognition unit 402 is used to perform feature recognition on the live scene in the live picture;
[0262] A determination unit 403 is configured to determine a target display area for target promotion content in the live broadcast screen according to the target scene feature when a target scene feature is identified in the live broadcast scene;
[0263] The display unit 404 is used to display the target promotion content in the target display area of the live broadcast screen.
[0264] In one embodiment, reference Fig.19 , the determining unit 403 may include:
[0265] The set determination subunit 4031 may be used to determine a mapping relationship set for promotional content, wherein the mapping relationship set includes a mapping relationship between a preset scene feature and a preset display area, and the preset display area is an area for displaying the promotional content during live broadcast;
[0266] The area determination subunit 4032 may be configured to determine a target display area for target promotional content in the live broadcast screen according to the mapping relationship set and the target scene features.
[0267] In one embodiment, the region determination subunit 4032 may be specifically used for:
[0268] Determine a target mapping relationship corresponding to the target scene feature in the mapping relationship set, wherein the target mapping relationship is a mapping relationship between the target scene feature and a target display area, and the target display area is an area for displaying target promotional content during live broadcast; based on the target mapping relationship, generate a response event in response to the target scene feature; through the response event, obtain position parameters required to determine the target display area; and determine the target display area in the live broadcast screen according to the position parameters.
[0269] In one embodiment, reference Fig. 20 , the identification unit 402 may include:
[0270] The picture acquisition subunit 4021 can be used to acquire the live broadcast picture;
[0271] The image extraction subunit 4022 may be used to extract a live scene image corresponding to the live scene from the live screen;
[0272] The image input subunit 4023 may be used to input the live scene image into a target recognition model so as to perform feature recognition on the live scene image through the target recognition model.
[0273] In one embodiment, the image input subunit 4023 may be specifically used for:
[0274] Obtain a target configuration file, wherein the target configuration file includes feature description information of at least one candidate scene feature; perform feature matching on the live scene image and the feature description information through the target recognition model to obtain a matching result; and determine a feature recognition result of the live scene in the live screen based on the matching result.
[0275] In one embodiment, reference Fig.21 Before the live broadcast screen is displayed on the live broadcast client, the promotion content display device based on the live broadcast screen may further include:
[0276] The setting information acquisition unit 405 may be used to acquire live broadcast setting information, scene setting information, and promotion content setting information for the target promotion content, wherein the scene setting information corresponds to the live broadcast scene, and the live broadcast scene has the target scene characteristics;
[0277] The mapping relationship establishing unit 406 can be used to establish a mapping relationship between the target scene feature and the target display area according to the live broadcast setting information, the scene setting information, and the promotion content setting information, wherein the target display area is the area where the target promotion content is displayed during the live broadcast.
[0278] In one embodiment, reference Fig. 22 The setting information acquisition unit 405 may include:
[0279] The configuration page display subunit 4051 may be used to display a promotion configuration page for target promotion content, wherein the promotion configuration page includes at least one promotion configuration control, and the promotion configuration control includes a live broadcast setting control, a scene setting control, and a promotion content setting control;
[0280] The configuration information acquisition subunit 4052 can be used to obtain promotion configuration information for the target promotion content in response to the promotion configuration operation for the promotion configuration control, wherein the promotion configuration information includes live broadcast setting information, scene setting information, and promotion content setting information.
[0281] In one embodiment, reference Fig.23 The promotion configuration page includes an effect preview window; the setting information acquisition unit 405 may also include:
[0282] The preview effect display subunit 4053 may be used to display the corresponding promotion display preview effect in the effect preview window in response to the promotion configuration operation on the promotion configuration control.
[0283] In one embodiment, reference Fig.24 The setting information acquisition unit 405 may further include:
[0284] The process page display subunit 4054 may be used to display a live process selection page when a promotion configuration completion operation for the promotion configuration page is detected, wherein the live process selection page includes a selection trigger control for the live process;
[0285] The process window display subunit 4055 can be used to display a live broadcast process selection window in the live broadcast process selection page in response to a selection trigger operation on the selection trigger control, wherein the live broadcast process selection window includes a live broadcast process selection list, and the live broadcast process selection list includes at least one optional live broadcast process.
[0286] In one embodiment, reference Fig.25 The setting information acquisition unit 405 may further include:
[0287] The live broadcast window display subunit 4056 may be configured to display a live broadcast trigger window in response to a selection completion operation on the live broadcast process selection list after a target live broadcast process is selected in the live broadcast process selection list;
[0288] The game live broadcast start subunit 4057 can be used to start the live broadcast for the target live broadcast process in response to the live broadcast trigger operation for the live broadcast trigger window.
[0289] In one embodiment, reference Fig.26 The promotion content display device based on the live broadcast screen may also include:
[0290] The recognition model acquisition unit 407 can be used to acquire a target recognition model and a target configuration file required for displaying the target promotion content according to the live broadcast setting information, the scene setting information, and the promotion content setting information.
[0291] In one embodiment, reference Fig. 27 Before acquiring the live broadcast setting information, scene setting information, and promotion content setting information for the target promotion content, the promotion content display device based on the live broadcast screen may further include:
[0292] The sample video acquisition unit 408 may be used to acquire a live sample video;
[0293] The image set generating unit 409 may be used to generate a target sample image set required for training a target recognition model based on the live sample video, wherein the target sample image set includes at least one target sample image, and the target sample image includes at least one preset scene feature;
[0294] The sample image input unit 410 may be used to input the target sample image into the recognition model to be trained, so as to perform model training on the recognition model to be trained and obtain a trained target recognition model.
[0295] In one embodiment, reference Fig.28 , the image set generating unit 409 may include:
[0296] The image extraction subunit 4091 may be used to extract images from the live sample video to obtain extracted sample images;
[0297] The image screening subunit 4092 may be used to screen the extracted sample images based on preset scene features to obtain screened candidate sample images;
[0298] The image enhancement subunit 4093 may be used to perform an image enhancement operation on the candidate sample image to obtain an enhanced target sample image;
[0299] The image combination subunit 4094 may be used to combine the target sample images to obtain a combined target sample image set.
[0300] In one embodiment, reference Fig.29 , the display unit 404 may include:
[0301] The content acquisition subunit 4041 can be used to acquire target promotion content;
[0302] The parameter determination subunit 4042 may be used to determine the position parameters of the target display area;
[0303] The content display subunit 4043 may be configured to display the target promotion content in the target display area based on the location parameter.
[0304] In specific implementation, the above units can be implemented as independent entities, or can be arbitrarily combined to be implemented as the same or several entities. The specific implementation of the above units can refer to the previous method embodiments, which will not be repeated here.
[0305] As can be seen from the above, in the promotional content display device based on the live broadcast screen of this embodiment, the display unit 401 displays the live broadcast screen on the live broadcast client; the identification unit 402 performs feature recognition on the live broadcast scene in the live broadcast screen; when the determination unit 403 recognizes the target scene feature in the live broadcast scene, according to the target scene feature, the target display area of the target promotional content in the live broadcast screen is determined; and the display unit 404 displays the target promotional content in the target display area of the live broadcast screen.
[0306] This solution can trigger the display of target promotional content by detecting the target scene features in the live broadcast screen, and make the target display area of the target promotional content in the live broadcast screen more flexibly selected. For example, the target promotional content can be integrated into a specific live broadcast scene; for example, it can be displayed in multiple areas. In this way, when displaying promotional content in the live broadcast screen, it is not limited to fixed areas in the live broadcast screen, such as corner areas. In addition, for the live broadcast process that requires the participation of the anchor, this method can make it possible for the anchor to perform a display trigger operation for the target promotional content when displaying the target promotional content during the live broadcast process, so that it will not interfere with the current operation of the anchor, and can further make the display of promotional content based on the live broadcast screen more efficient. Therefore, by combining intelligent image recognition technology, this method can integrate promotional content into specific scenes of the live broadcast, greatly improving the display efficiency of promotional content based on the live broadcast screen.
[0307] In addition, the embodiment of the present application also provides a computer device, which can be a server or a terminal. Fig.30 As shown, it shows a schematic diagram of the structure of the computer device involved in the embodiment of the present application, specifically:
[0308] The computer device may include a memory 501 having one or more computer-readable storage media, an input unit 502, a display unit 503, an audio circuit 504, a wireless fidelity (WiFi) module 505, a processor 506 having one or more processing cores, and a power supply 507. Those skilled in the art will appreciate that Fig.30 The computer device structure shown in the figure does not constitute a limitation on the computer device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently. Among them:
[0309] The memory 501 can be used to store software programs and modules, and the processor 506 executes various functional applications and data processing by running the software programs and modules stored in the memory 501. The memory 501 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the computer device (such as audio data, a phone book, etc.), etc. In addition, the memory 501 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory 501 may also include a memory controller to provide the processor 506 and the input unit 502 with access to the memory 501.
[0310] The input unit 502 can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control. Specifically, in a specific embodiment, the input unit 502 may include a touch-sensitive surface and other input devices. The touch-sensitive surface, also known as a touch display screen or a touch pad, can collect the user's touch operations on or near it (such as the user's operation on or near the touch-sensitive surface using any suitable object or accessory such as a finger, a stylus, etc.), and drive the corresponding connection device according to a pre-set program. Optionally, the touch-sensitive surface may include a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 506, and can receive and execute the command sent by the processor 506. In addition, the touch-sensitive surface can be implemented using multiple types such as resistive, capacitive, infrared and surface acoustic waves. In addition to the touch-sensitive surface, the input unit 502 may also include other input devices. Specifically, other input devices may include, but are not limited to, one or more of a physical keyboard, function keys (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, and the like.
[0311] The display unit 503 can be used to display information input by the user or information provided to the user and various graphical user interfaces of the computer device, which can be composed of graphics, text, icons, videos and any combination thereof. The display unit 503 may include a display panel. Optionally, the display panel may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc. Further, the touch-sensitive surface may cover the display panel. When the touch-sensitive surface detects a touch operation on or near it, it is transmitted to the processor 506 to determine the type of touch event. Subsequently, the processor 506 provides a corresponding visual output on the display panel according to the type of touch event. Although in Fig.30 In the embodiment, the touch-sensitive surface and the display panel are used as two independent components to realize input and output functions, but in some embodiments, the touch-sensitive surface and the display panel can be integrated to realize input and output functions.
[0312] The audio circuit 504, the speaker, and the microphone can provide an audio interface between the user and the computer device. The audio circuit 504 can transmit the electrical signal converted from the received audio data to the speaker, which is converted into a sound signal for output; on the other hand, the microphone converts the collected sound signal into an electrical signal, which is received by the audio circuit 504 and converted into audio data, and then the audio data is processed by the output processor 506 and sent to, for example, another computer device through the RF circuit 601, or the audio data is output to the memory 501 for further processing. The audio circuit 504 may also include an earphone jack to provide communication between an external headset and the computer device.
[0313] WiFi is a short-range wireless transmission technology. Computer devices can help users send and receive emails, browse web pages, and access streaming media through WiFi module 505. It provides users with wireless broadband Internet access. Fig.30 A WiFi module 505 is shown, but it is understandable that it is not an essential component of the computer device and can be omitted as needed without changing the essence of the invention.
[0314] The processor 506 is the control center of the computer device, which uses various interfaces and lines to connect various parts of the entire mobile phone, and executes various functions of the computer device and processes data by running or executing software programs and / or modules stored in the memory 501, and calling data stored in the memory 501. Optionally, the processor 506 may include one or more processing cores; preferably, the processor 506 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 506.
[0315] The computer device also includes a power supply 507 (such as a battery) for supplying power to various components. Preferably, the power supply can be logically connected to the processor 506 through a power management system, so that the power management system can manage charging, discharging, and power consumption management. The power supply 507 can also include one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, power status indicators, and other arbitrary components.
[0316] Although not shown, the computer device may also include a camera, a Bluetooth module, etc., which will not be described in detail here. Specifically in this embodiment, the processor 506 in the computer device will load the executable files corresponding to the processes of one or more application programs into the memory 501 according to the following instructions, and the processor 506 will run the application programs stored in the memory 501, thereby realizing various functions, as follows:
[0317] Display a live broadcast screen on a live broadcast client; perform feature recognition on a live broadcast scene in the live broadcast screen; when a target scene feature is recognized in the live broadcast scene, determine a target display area for target promotional content in the live broadcast screen according to the target scene feature; and display the target promotional content in the target display area of the live broadcast screen.
[0318] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.
[0319] The computer device of this embodiment can trigger the display of target promotion content by detecting the target scene features in the live broadcast screen, and make the target display area of the target promotion content in the live broadcast screen more flexibly selected, for example, the target promotion content can be integrated into a specific live broadcast scene; for example, it can be displayed in multiple areas. In this way, when displaying promotion content in the live broadcast screen, it is not limited to a fixed area in the live broadcast screen, such as a corner area. In addition, for the live broadcast process that requires the participation of the anchor, the method can make it possible for the anchor to perform a display trigger operation for the target promotion content when displaying the target promotion content during the live broadcast process, so that it will not interfere with the current operation of the anchor, and can further make the display of promotion content based on the live broadcast screen more efficient. Therefore, the computer device of this embodiment can integrate promotion content into specific scenes of the live broadcast by combining intelligent image recognition technology, greatly improving the display efficiency of promotion content based on the live broadcast screen.
[0320] A person of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.
[0321] To this end, an embodiment of the present application provides a storage medium in which a plurality of instructions are stored, and the instructions can be loaded by a processor to execute the steps in any one of the promotional content display methods based on live broadcast images provided in the embodiment of the present application. For example, the instructions can execute the following steps:
[0322] Display a live broadcast screen on a live broadcast client; perform feature recognition on a live broadcast scene in the live broadcast screen; when a target scene feature is recognized in the live broadcast scene, determine a target display area for target promotional content in the live broadcast screen according to the target scene feature; and display the target promotional content in the target display area of the live broadcast screen.
[0323] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.
[0324] The storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.
[0325] Since the instructions stored in the storage medium can execute the steps in any one of the promotional content display methods based on live broadcast images provided in the embodiments of the present application, the beneficial effects that can be achieved by any one of the promotional content display methods based on live broadcast images provided in the embodiments of the present application can be achieved. For details, please refer to the previous embodiments and will not be repeated here.
[0326] According to one aspect of the present application, a computer program product or a computer program is provided, the computer program product or the computer program including computer instructions, the computer instructions being stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the method provided in various optional implementations of the above-mentioned promotional content display based on live screen.
[0327] The above is a detailed introduction to a promotional content display method, device and system based on live broadcast screen provided in the embodiments of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for technical personnel in this field, according to the idea of the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.
Claims
1. A promotional content display method based on live broadcast screen, characterized in that: include: Configure the target promotion content through a promotion configuration page, wherein the promotion configuration page includes an effect preview window, and the effect preview window is used to display the promotion preview effect of the target promotion content; When a promotion configuration completion operation for the promotion configuration page is detected, a live broadcast process selection page is displayed, the live broadcast process selection page is used to display at least one optional live broadcast process, and the live broadcast process is used to start the live broadcast and enter the live broadcast screen; Display the live broadcast screen on the live broadcast client; The live scene in the live screen is characterized by using a target recognition model, and the live screen includes live screens of multiple live types; the target recognition model is used to perform feature recognition according to features, audio, player operations, and game plots in the live screen when the live type is game live broadcast; display areas suitable for displaying promotional content are pre-marked in the live scene, and the number of the display areas is one or more, and the multiple display areas are used to display multiple promotional contents to be displayed; When a target scene feature is identified in the live broadcast scene, a target display area for target promotion content is determined in the live broadcast screen according to the target scene feature; The step of determining a target display area for target promotional content in the live broadcast screen according to the target scene feature includes: if the live broadcast scene is determined to be a game scene according to the target scene feature, determining a candidate area in the live broadcast screen, wherein the candidate area is an activity area of a game character in the game scene; obtaining a current distribution position of the game character in the candidate area, and determining the target display area in the candidate area according to the current distribution position, wherein the target display area does not overlap with the game character; The target promotion content corresponding to the target scene feature is displayed in the target display area of the live broadcast screen, and the target promotion content includes text, image, video, audio, and interactive settings.
2. The promotion content display method based on live broadcast screen according to claim 1 is characterized in that: When a target scene feature is identified in the live broadcast scene, determining a target display area of the target promotion content in the live broadcast screen according to the target scene feature includes: Determine a mapping relationship set for the promotional content, wherein the mapping relationship set includes a mapping relationship between a preset scene feature and a preset display area, and the preset display area is an area where the promotional content is displayed during live broadcast; According to the mapping relationship set and the target scene characteristics, a target display area for the target promotion content is determined in the live broadcast screen.
3. The promotion content display method based on live broadcast screen according to claim 2 is characterized in that: Determining a target display area of target promotion content in the live broadcast screen according to the mapping relationship set and the target scene feature includes: Determine a target mapping relationship corresponding to the target scene feature in the mapping relationship set, wherein the target mapping relationship is a mapping relationship between the target scene feature and a target display area, and the target display area is an area for displaying target promotional content during live broadcast; Based on the target mapping relationship, generating a response event responsive to the target scene feature; Obtaining the position parameters required for determining the target display area through the response event; According to the position parameters, a target display area is determined in the live broadcast screen.
4. The promotion content display method based on live broadcast screen according to claim 1 is characterized in that: Performing feature recognition on the live scene in the live screen includes: Acquire the live broadcast picture; Extracting a live scene image corresponding to the live scene from the live screen; The live scene image is input into a target recognition model so as to perform feature recognition on the live scene image through the target recognition model.
5. The promotion content display method based on live broadcast screen according to claim 4 is characterized in that: Inputting the live scene image into a target recognition model to perform feature recognition on the live scene image through the target recognition model includes: Acquire a target configuration file, wherein the target configuration file includes feature description information of at least one candidate scene feature; By using the target recognition model, feature matching is performed on the live scene image and the feature description information to obtain a matching result; Based on the matching result, a feature recognition result of the live scene in the live screen is determined.
6. The promotion content display method based on live broadcast screen according to claim 1 is characterized in that: Before displaying the live broadcast picture on the live broadcast client, the method further includes: Acquire live broadcast setting information, scene setting information, and promotion content setting information for target promotion content, wherein the scene setting information corresponds to a live broadcast scene, and the live broadcast scene has target scene characteristics; A mapping relationship between the target scene feature and the target display area is established according to the live broadcast setting information, the scene setting information, and the promotion content setting information, wherein the target display area is an area for displaying the target promotion content during the live broadcast.
7. The promotion content display method based on live broadcast screen according to claim 6 is characterized in that: Obtain live broadcast setting information, scene setting information, and promotion content setting information for the target promotion content, including: Displaying a promotion configuration page for the target promotion content, wherein the promotion configuration page includes at least one promotion configuration control, and the promotion configuration control includes a live broadcast setting control, a scene setting control, and a promotion content setting control; In response to a promotion configuration operation on the promotion configuration control, promotion configuration information for the target promotion content is acquired, wherein the promotion configuration information includes live broadcast setting information, scene setting information, and promotion content setting information.
8. The promotion content display method based on live broadcast screen according to claim 7 is characterized in that: The promotion configuration page includes an effect preview window; the method further includes: In response to the promotion configuration operation on the promotion configuration control, the corresponding promotion display preview effect is displayed in the effect preview window.
9. The promotion content display method based on live broadcast screen according to claim 7, characterized in that: The method further comprises: When a promotion configuration completion operation for the promotion configuration page is detected, a live broadcast process selection page is displayed, wherein the live broadcast process selection page includes a selection trigger control for the live broadcast process; In response to a selection trigger operation on the selection trigger control, a live broadcast process selection window is displayed in the live broadcast process selection page, wherein the live broadcast process selection window includes a live broadcast process selection list, and the live broadcast process selection list includes at least one optional live broadcast process.
10. The promotion content display method based on live broadcast screen according to claim 9, characterized in that: The method further comprises: After the target live broadcast process is selected in the live broadcast process selection list, in response to the selection completion operation on the live broadcast process selection list, a live broadcast trigger window is displayed; In response to a live broadcast trigger operation on the live broadcast trigger window, start live broadcast on the target live broadcast process.
11. The promotion content display method based on live broadcast screen according to claim 6, characterized in that: The method further comprises: According to the live broadcast setting information, the scene setting information, and the promotion content setting information, a target recognition model and a target configuration file required for displaying the target promotion content are acquired.
12. The promotion content display method based on live broadcast screen according to claim 6, characterized in that: Before acquiring the live broadcast setting information, scene setting information, and promotion content setting information for the target promotion content, the method further includes: Get live sample video; Based on the live sample video, a target sample image set required for training a target recognition model is generated, wherein the target sample image set includes at least one target sample image, and the target sample image includes at least one preset scene feature; The target sample image is input into the recognition model to be trained to perform model training on the recognition model to be trained, thereby obtaining a trained target recognition model.
13. The promotion content display method based on live broadcast screen according to claim 12, characterized in that: Based on the live sample video, a target sample image set required for training the target recognition model is generated, including: Performing image extraction on the live sample video to obtain an extracted sample image; Based on the preset scene features, the extracted sample images are screened to obtain screened candidate sample images; Performing an image enhancement operation on the candidate sample image to obtain an enhanced target sample image; The target sample images are combined to obtain a combined target sample image set.
14. The promotion content display method based on live broadcast screen according to claim 1, characterized in that: Displaying target promotional content in the target display area of the live broadcast screen includes: Obtain targeted promotional content; Determining position parameters of the target display area; Based on the location parameter, the target promotion content is displayed in the target display area.
15. A promotional content display device based on live broadcast screen, characterized in that: include: A display unit is used to configure target promotion content through a promotion configuration page, wherein the promotion configuration page includes an effect preview window, and the effect preview window is used to display the promotion preview effect of the target promotion content; when it is detected that the promotion configuration operation for the promotion configuration page is completed, a live broadcast process selection page is displayed, and the live broadcast process selection page is used to display at least one optional live broadcast process, and the live broadcast process is used to start the live broadcast and enter the live broadcast screen; Display the live broadcast screen on the live broadcast client; The recognition unit is used to perform feature recognition on the live scene in the live screen through a target recognition model, and the live screen includes live screens of multiple live types; the target recognition model is used to perform feature recognition according to the features, audio, player operations, and game plots in the live screen when the live type is game live broadcast; the live scene is pre-marked with display areas suitable for displaying promotional content, the number of the display areas is one or more, and the multiple display areas are used to display multiple promotional contents to be displayed; A determination unit is configured to determine a target display area for target promotional content in the live screen according to the target scene features when a target scene feature is identified in the live scene; wherein the determination of the target display area for target promotional content in the live screen according to the target scene features comprises: if the live scene is determined to be a game scene according to the target scene features, determining a candidate area in the live screen, the candidate area being an activity area of a game character in the game scene; obtaining a current distribution position of the game character in the candidate area, and determining the target display area in the candidate area according to the current distribution position, wherein the target display area does not overlap with the game character; A display unit is used to display target promotion content corresponding to the target scene feature in the target display area of the live broadcast screen, and the target promotion content includes text, image, video, audio, and interactive settings.
16. A storage medium, characterized in that: include: A computer program is stored thereon, wherein when the computer program is executed by a processor, the steps of the promotional content display method based on a live broadcast screen as shown in any one of claims 1-14 are implemented.
17. A computer device, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the steps of the promotional content display method based on the live broadcast screen as shown in any one of items 1-14 are implemented.
