Media data playing method and device, electronic equipment and storage medium

Abstract

This application provides a media data playback method, apparatus, electronic device, and storage medium, comprising: acquiring a media stream to be played and the current user's permission level; performing image layer recognition processing on the media stream to distinguish between a main video layer and an advertisement layer, extracting main video content data from the main video layer, and extracting advertisement content data from the advertisement layer; when the permission level is a first level, determining that the advertisement filtering authorization scope only includes pre-boot advertisements; when the permission level is a second level, determining that the advertisement filtering authorization scope includes all advertisement types; scheduling the main video content data to the main TV screen for rendering output; according to the advertisement filtering authorization scope, scheduling the advertisement content data that matches the advertisement filtering authorization scope to a mobile secondary screen for rendering output, wherein the main TV screen and the mobile secondary screen are communicatively connected.

Description

Technical Field

[0001] This application relates to the field of image communication technology, and in particular to a media data playback method, apparatus, electronic device, and storage medium. Background Technology

[0002] With the continuous development of smart TV technology, televisions have evolved from simple audio-visual playback devices into the center of home entertainment and information interaction. In recent years, as users' demands for television viewing experiences have increased, paid membership systems have become an important model for television operators and content providers to recoup content costs and achieve sustainable commercial development. Providing paid members with ad-blocking privileges to enhance the viewing experience is one of the core benefits of paid membership systems. At the same time, television advertising remains a key business means for platforms and advertisers to generate revenue. How to ensure paid members' ad-blocking rights and improve their viewing experience while maintaining advertisers' commercial revenue has become a pressing technical problem to be solved in this field.

[0003] An existing technology involves using a second-screen device to assist in displaying advertisements. This solution pushes supplementary advertising information related to the current program content to the user through a second-screen device (such as a mobile phone or tablet) while the main display device is playing the program content. The second-screen device is configured separately from the main display device, and the supplementary advertisements are pushed to the user based on their information. However, in this solution, the main display device itself still needs to play the advertising content, and the advertisements still interfere with the viewing experience on the main screen.

[0004] However, in existing technical solutions, when users enable ad filtering, ad content is completely discarded, causing both the platform and advertisers to lose all advertising revenue, thus failing to achieve a balance between user experience and advertising revenue. Summary of the Invention

[0005] This application provides a media data playback method, apparatus, electronic device, and storage medium to solve the problem in the prior art where, when a user enables the ad filtering function, the ad content is completely discarded, causing the platform and advertisers to lose all advertising revenue, thus failing to achieve a balance between user experience and advertising revenue.

[0006] Firstly, this application provides a method for playing media data, including: Get the media stream to be played and the current user's permission level; The media stream is subjected to image layer recognition processing to distinguish between the main film layer and the advertisement layer. The main film content data is extracted from the main film layer, and the advertisement content data is extracted from the advertisement layer. When the permission level is Level 1, the ad filtering authorization scope is determined to include only the pre-boot ad type; when the permission level is Level 2, the ad filtering authorization scope is determined to include all ad types. The video content data is scheduled to the TV main screen for rendering and output. According to the ad filtering authorization range, the ad content data that matches the ad filtering authorization range is scheduled to the mobile secondary screen for rendering output, wherein the TV main screen and the mobile secondary screen are connected in communication.

[0007] In one possible implementation, the method further includes: When the permission level is the second level, during the process of scheduling the movie content data to the TV main screen for rendering output, the presence of an advertising layer in the media stream is monitored in real time. When the ad layer is detected, the ad content data corresponding to the ad layer is extracted; The extracted advertising content data is scheduled to the mobile secondary screen for rendering output, while maintaining the continuous rendering output of the main TV screen.

[0008] In one possible implementation, the method further includes: When the advertising content data is scheduled to the mobile secondary screen for rendering output, the audio output of the mobile secondary screen is set to mute, while the original audio output of the main TV screen's movie content data is maintained.

[0009] In one possible implementation, the method further includes: Obtain the advertiser's ad placement configuration information; The type of advertising content data to be delivered is identified based on the advertising delivery configuration information. When the delivery type is a small screen ad delivery type, the ad content data is scheduled to the mobile secondary screen for rendering output; When the delivery type is a large screen ad delivery type, the step of scheduling the ad content data that matches the ad filtering authorization range in the ad content data to the mobile secondary screen for rendering output is executed.

[0010] In one possible implementation, the method further includes: During the process of rendering and outputting the advertising content data on the mobile secondary screen, the playback progress information of the advertising content data is obtained; When the playback progress information indicates that the advertisement content data has finished playing, the rendering output of the advertisement content data by the mobile secondary screen is stopped, and the default display interface of the mobile secondary screen is restored.

[0011] Secondly, this application provides a media data playback device, comprising: The acquisition module is used to acquire the media stream to be played and the current user's permission level; The extraction module is used to perform image layer recognition processing on the media stream to distinguish between the main film layer and the advertisement layer, extract the main film content data from the main film layer, and extract the advertisement content data from the advertisement layer. The determination module is used to determine that when the permission level is the first level, the authorized scope of ad filtering only includes pre-boot ads; and when the permission level is the second level, the authorized scope of ad filtering includes all ad types. The first scheduling module is used to schedule the film and television content data to the main screen of the TV for rendering output; The second scheduling module is used to schedule the advertising content data that matches the advertising filtering authorization range to the mobile secondary screen for rendering output, according to the advertising filtering authorization range. The main TV screen and the mobile secondary screen are connected in communication.

[0012] In one possible implementation, the device further includes a monitoring module for: When the permission level is the second level, during the process of scheduling the movie content data to the TV main screen for rendering output, the presence of an advertising layer in the media stream is monitored in real time. When the ad layer is detected, the ad content data corresponding to the ad layer is extracted; The extracted advertising content data is scheduled to the mobile secondary screen for rendering output, while maintaining the continuous rendering output of the main TV screen.

[0013] In one possible implementation, the device further includes a setting module for: When the advertising content data is scheduled to the mobile secondary screen for rendering output, the audio output of the mobile secondary screen is set to mute, while the original audio output of the main TV screen's movie content data is maintained.

[0014] In one possible implementation, the apparatus further includes an execution module for: Obtain the advertiser's ad placement configuration information; The type of advertising content data to be delivered is identified based on the advertising delivery configuration information. When the delivery type is a small screen ad delivery type, the ad content data is scheduled to the mobile secondary screen for rendering output; When the delivery type is a large screen ad delivery type, the step of scheduling the ad content data that matches the ad filtering authorization range in the ad content data to the mobile secondary screen for rendering output is executed.

[0015] In one possible implementation, the device further includes a recovery module for: During the process of rendering and outputting the advertising content data on the mobile secondary screen, the playback progress information of the advertising content data is obtained; When the playback progress information indicates that the advertisement content data has finished playing, the rendering output of the advertisement content data by the mobile secondary screen is stopped, and the default display interface of the mobile secondary screen is restored.

[0016] Thirdly, this application provides an electronic device, including: a processor and a memory, wherein the processor is configured to execute a media data playback program stored in the memory to implement the media data playback method described in any one of the first aspects.

[0017] Fourthly, this application provides a storage medium storing one or more programs that can be executed by one or more processors to implement the media data playback method described in any one aspect.

[0018] Fifthly, this application provides a computer program product containing instructions that, when run on a computer, causes the computer to perform any of the media data playback methods described above.

[0019] Compared with the prior art, the technical solution provided in this application has the following advantages: The method provided in this application first obtains the media stream to be played and the current user's permission level, and parses the media stream to extract the main film content data and advertising content data, providing a data foundation for subsequent differentiated processing; then, based on the obtained user permission level, it determines the user's corresponding advertising filtering authorization range, thereby clarifying the advertising content that the user has the right to block, and realizing accurate identification of user rights; on this basis, the main film content data is scheduled to the TV main screen for rendering output, ensuring that the main screen plays program content normally without advertising interference; at the same time, according to the advertising filtering authorization range, only the advertising content data that matches the authorization range is scheduled to the mobile secondary screen for rendering output. Thus, it not only ensures a pure viewing experience on the main screen, but also allows advertising content to still reach users through the mobile secondary screen, thereby improving the user experience without completely sacrificing advertising revenue, and effectively solving the technical problem of balancing user experience and advertising revenue. Attached Figure Description

[0020] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0021] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0022] One or more embodiments are illustrated by way of example with reference numerals in the accompanying drawings. These illustrations do not constitute a limitation on the embodiments. Elements with the same reference numerals in the drawings are denoted as similar elements. Unless otherwise stated, the figures in the drawings are not to be limited by scale.

[0023] Figure 1 A flowchart illustrating an embodiment of a media data playback method provided in this application; Figure 2 A flowchart illustrating an embodiment of another media data playback method provided in this application; Figure 3 A block diagram illustrating an embodiment of a media data playback device provided in this application; Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0024] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0025] The following disclosure provides numerous different embodiments or examples for implementing various structures of this application. To simplify the disclosure, specific examples of components and arrangements are described below. These are merely examples and are not intended to limit the scope of this application. Furthermore, reference numerals and / or letters may be repeated in different examples. Such repetition is for simplification and clarity and does not in itself indicate a relationship between the various embodiments and / or arrangements discussed.

[0026] To address the technical problem in existing technologies where advertising content is completely discarded when users enable ad filtering, resulting in the loss of all advertising revenue for both the platform and advertisers and an inability to balance user experience with advertising revenue, this application provides a media data playback method that ensures a clean viewing experience on the main screen while allowing advertising content to still reach users through the mobile secondary screen. This improves user experience without completely sacrificing advertising revenue, effectively solving the technical problem of balancing user experience and advertising revenue.

[0027] Figure 1 This is a flowchart illustrating an embodiment of a media data playback method provided in this application. Figure 1 As shown, the method includes the following steps: S101. Obtain the media stream to be played and the current user's permission level.

[0028] Media stream: refers to the audio and video data stream to be played on the main TV screen, including the main movie content and the advertisements interspersed within it. It can be the original source content data stored locally on the TV terminal or streamed online, or it can be the screen casting content data received from external devices through the screen casting protocol.

[0029] Current user: refers to the user who is currently operating the TV system and making a playback request. Specifically, it can be a member user who has been authenticated by logging in or a non-member user who has not been authenticated by logging in. Different users have different permission levels and corresponding different ad filtering authorization ranges.

[0030] Permission Level: This refers to the membership level information of the current user in the TV system, which is used to identify what level of ad filtering rights the user enjoys. Different permission levels correspond to different ad filtering authorization ranges.

[0031] In this embodiment, the television system responds to the user's playback command by reading the permission level of the currently logged-in user from the system cache or database. Simultaneously, based on the content source indicated by the playback command, the television system obtains the media stream to be played from local storage, a network streaming media server, or an external projection device, using the obtained media stream and permission level as input data for subsequent advertisement identification and distribution processing.

[0032] S102. Perform image layer recognition processing on the media stream to distinguish between the main film layer and the advertisement layer, extract the main film content data from the main film layer, and extract the advertisement content data from the advertisement layer.

[0033] Film and television content data: refers to the visual and audio data of the film and television program that the user requests, that is, the main content that the user expects to watch. It is the core content of the user's viewing needs, as opposed to advertising content data.

[0034] Advertising content data: refers to commercial promotional information data interspersed or superimposed during the broadcast of film and television programs. It is mixed or superimposed with the main film and television content data in the media stream, and requires identification and processing to separate the two.

[0035] Image layer recognition processing: refers to the process of parsing the layers of each frame in the media stream and classifying different layers into main content layers or advertising layers.

[0036] Film / TV main content layer: refers to the image layer in the media stream that carries the content data of the film / TV main content.

[0037] Ad layer: refers to the image layer in the media stream that carries the data of advertising content. It is either superimposed on or presented independently of the main video layer in the image.

[0038] In this embodiment, the system activates a built-in intelligent layered image recognition algorithm to analyze and decompose each frame of the media stream into layers. Specifically, the system first obtains the layer composition information of each frame in the media stream, and uses an image feature recognition model to analyze the feature attributes of each layer. This model can identify the position coordinates, size, layer order, transparency, content features, and other attribute information of each layer in the image, and determine whether each layer belongs to the main feature layer or the advertisement layer based on these attribute information. For example, when a layer presents image content that is floating in a specific area of ​​the image, contains commercial promotion information, and is unrelated to the main plot, the system identifies it as an advertisement layer; when a layer presents continuously playing images of the main feature, the system identifies it as a main feature layer. After distinguishing between the main feature layer and the advertisement layer, the system extracts the main feature content data from the main feature layer and the advertisement content data from the advertisement layer, so that the two obtain independent data carriers at the data source.

[0039] This application, through the above-mentioned scheme, can achieve accurate separation of main content and advertising content through image layer recognition processing, effectively improving the accuracy and real-time performance of advertising recognition, and providing a reliable data foundation for subsequently scheduling main content and advertising to different display devices.

[0040] S103. When the permission level is the first level, the scope of ad filtering authorization is determined to include only the pre-boot ad type; when the permission level is the second level, the scope of ad filtering authorization is determined to include all ad types.

[0041] Ad filtering authorization scope: refers to the range of ad content that the current user is authorized to block, used to define which ad content the user is entitled to remove from the TV home screen to obtain a clean viewing experience.

[0042] Level 1: This refers to the ordinary level in the user permission level, corresponding to the ordinary paid member status, and enjoys basic ad filtering rights.

[0043] Level 2: This refers to the higher level of user privileges, corresponding to a premium paid membership, which grants the user the right to filter ads across all scenarios.

[0044] Pre-boot ads: These are ads displayed before the TV system starts up or before a movie or TV show begins playing. They are placed before the main movie or TV show's playback timeline and are the first type of ads that users encounter before watching the content.

[0045] All advertising types: refers to all forms of advertising that may appear during the playback of film and television programs, including but not limited to pre-boot ads, timed in-show ads (i.e. ads that are forcibly inserted when the film or television program reaches a specific time point), dynamic pop-up ads on the playback interface (i.e. ad windows that randomly pop up and float above the playback screen during playback), and floating promotional ads (i.e. promotional information that is continuously or intermittently superimposed on a designated area of ​​the playback screen), covering all types of advertising forms in the entire film and television playback scenario.

[0046] In this embodiment, the television system matches the user's permission level obtained in S101 with the system's preset permission-scope mapping rules. When the user's permission level is the first level, the system determines that the user's ad filtering authorization scope only includes pre-boot ads. That is, the system only performs traffic diversion processing on pre-boot ads, scheduling them to the mobile secondary screen. Other ad types, such as in-show ads, dynamic pop-up ads, and floating promotional ads, are not diverted because they exceed the user's ad filtering authorization scope and remain played on the main television screen. When the user's permission level is the second level, the system determines that the user's ad filtering authorization scope includes all ad types. That is, the system performs traffic diversion processing on all ad types, scheduling them to the mobile secondary screen.

[0047] This application achieves refined, tiered filtering of television advertisements through the aforementioned scheme. First-tier users can enjoy an ad-free start-up experience before the broadcast begins, while second-tier users can enjoy a pure viewing experience without ad interference throughout the entire playback of the film and television program, effectively meeting the differentiated ad filtering needs of users at different levels.

[0048] S104. The video content data is scheduled to the TV main screen for rendering and output.

[0049] Rendering output: refers to the process of converting decoded audio and video data into images and sounds that can be displayed on a display device, specifically including the rendering and display of video images and the playback and output of audio sounds.

[0050] Scheduling: refers to the act of allocating and transmitting specific data to designated output devices according to preset rules. In this application, it is specifically manifested as cross-device data routing operation that allocates the main video content data to the TV main screen output channel and the advertising content data to the mobile secondary screen output channel.

[0051] TV main screen: refers to the main display screen of a television set, which is used to present the main content of movies and TV shows to users. It is the core visual output device when users watch programs.

[0052] In this embodiment, the television system allocates the movie / TV show content data extracted in step S102 to the video rendering channel and audio output channel of the main screen of the television. The decoding and rendering module of the main screen of the television decodes, renders and outputs the data, so that the main screen and original sound are played on the main screen of the television, ensuring that the user can watch the movie / TV show content normally. Moreover, this scheduling process is not affected by the user's permission level, that is, no matter what permission level the user has, the main screen content is always scheduled to be played on the main screen of the television.

[0053] S105. According to the advertising filtering authorization range, the advertising content data that matches the advertising filtering authorization range in the advertising content data is scheduled to the mobile secondary screen for rendering output, wherein the TV main screen and the mobile secondary screen are connected in communication.

[0054] Mobile secondary screen: refers to a mobile display device (such as a mobile phone) separate from the main TV screen, used to receive and display advertising content data diverted from the main TV screen. It establishes a data transmission channel with the main TV screen through a communication connection. As a centralized terminal for advertising content, the mobile secondary screen releases and occupies independent advertising display space while the main TV screen blocks advertisements, forming a secondary screen advertising delivery channel parallel to the main TV screen.

[0055] In this embodiment, the television system filters the advertising content data extracted in step S102 according to the advertising filtering authorization range determined in step S103: Advertising content data matching the authorization range is transmitted to the mobile secondary screen for rendering output via a pre-established communication connection between the main television screen and the mobile secondary screen; after receiving the advertising content data, the mobile secondary screen independently displays the advertising content on its screen. For example, a regular VIP user's advertising filtering authorization range only includes pre-boot ads; therefore, only pre-boot ads are scheduled for rendering output on the mobile secondary screen, while other ad types such as in-show ads and dynamic pop-up ads remain on the main television screen. For non-VIP users, their advertising filtering authorization range is empty, and there is no advertising content data matching this authorization range; therefore, all ads remain on the main television screen. Meanwhile, the mobile secondary screen serves as an independent advertising display window. While the main TV screen blocks advertisements, the secondary screen releases independent advertising display resources, allowing large-screen advertisements that were originally blocked from reaching users to continue to be displayed through the secondary screen. This enables the cross-device continuation of the commercial value of advertising content and expands the platform's advertising resources without affecting the main screen viewing experience.

[0056] The technical solution provided in this application first obtains the media stream to be played and the current user's permission level, and then parses the media stream to extract the main video content data and advertising content data, providing a data foundation for subsequent differentiated processing. Next, based on the obtained user permission level, the user's corresponding advertising filtering authorization range is determined, thereby clarifying the advertising content that the user has the right to block and achieving accurate identification of user rights. On this basis, the main video content data is scheduled to the main TV screen for rendering output, ensuring that the main screen plays program content normally without advertising interference. Simultaneously, according to the advertising filtering authorization range, only advertising content data matching the authorized range is scheduled to the mobile secondary screen for rendering output. Thus, a clean viewing experience on the main screen is guaranteed while advertising content can still reach users through the mobile secondary screen, thereby improving the user experience without completely sacrificing advertising revenue and effectively solving the technical problem of balancing user experience and advertising revenue.

[0057] In one embodiment, to achieve full-scene ad isolation for second-level users, the method may further include the following steps: when the permission level is second level, during the process of scheduling the movie content data to the TV main screen for rendering output, the presence of an ad layer in the media stream is monitored in real time; when the ad layer is detected, the ad content data corresponding to the ad layer is extracted; the extracted ad content data is scheduled to the mobile secondary screen for rendering output, while maintaining the continuous rendering output of the TV main screen.

[0058] Ad layer: refers to the screen layer in the media stream that carries the advertising content data. It is either superimposed or presented independently on the screen with the main movie layer. It includes independent screen layers corresponding to timed advertisements in the movie, floating layers corresponding to dynamic pop-up advertisements, and superimposed layers corresponding to floating promotional advertisements. They usually appear in the screen in a specific position, size and hierarchical order.

[0059] In this embodiment, when the user's permission level is Level 2, the system continuously monitors the media stream in real time throughout the entire process of scheduling the main video content data to the TV main screen for rendering output, in order to identify whether an advertising layer appears. Specifically, the system uses a screen feature recognition model to analyze the layer composition of each frame in the media stream in real time. When the system detects that the feature attributes of a certain layer (such as position coordinates, size, layer order, transparency, content features, etc.) meet the judgment conditions of an advertising layer, it confirms that an advertising layer has been detected. At this time, the system immediately extracts the advertising content data corresponding to the advertising layer, and through the pre-established communication connection between the TV main screen and the mobile secondary screen, schedules the extracted advertising content data to the mobile secondary screen for rendering output in real time. The entire extraction and scheduling process is completed instantly during playback, and the rendering output of the TV main screen remains continuous, without interruption, stuttering, or black screen due to the appearance and migration of advertising layers.

[0060] This application achieves real-time ad diversion for second-tier users throughout the entire movie and TV program playback process through the above-mentioned solution. That is, the ad content is identified, extracted and migrated to the mobile secondary screen the moment it appears, and the main TV screen always presents pure movie and TV program content without interrupting playback or refreshing the page, resulting in a zero-interference viewing experience on the main screen.

[0061] In one embodiment, to achieve cross-device audio and video separation rendering and sound field priority locking, the method may further include the following steps: when the advertising content data is scheduled to the mobile secondary screen for rendering output, the audio output of the mobile secondary screen is set to mute, while maintaining the original audio output of the main TV screen's movie content data.

[0062] Audio output: refers to the process by which a display device processes the received audio data and then plays the sound to the user through a speaker or audio output interface.

[0063] Mute: This refers to setting the volume of the device's audio output channel to zero or turning off the audio output channel, so that the device does not play any sound signals.

[0064] Original audio: refers to the original audio signal corresponding to the content data of the film and television program, that is, the original sound of the dubbing, dialogue, background music, etc. in the film and television program itself without processing.

[0065] In this embodiment, when the television system schedules advertising content data to the mobile secondary screen for rendering output, the system simultaneously controls the audio output of the mobile secondary screen, setting the volume of its audio output channel to zero or directly shutting down the audio output channel, so that the mobile secondary screen does not emit any advertising sound effects while displaying the advertising image. Meanwhile, the original audio output of the main television screen's movie / TV show content remains unchanged; that is, the main television screen continues to play the sound of the movie / TV show normally, unaffected by the advertising rendering output from the mobile secondary screen.

[0066] This application achieves cross-device separation of advertising visuals and audio through the above solution—although the advertising visuals are displayed on the mobile secondary screen, their audio is forcibly muted, so as not to cause auditory interference to users; what users hear on the main TV screen is always the original audio of the movie content data, and the immersive viewing experience is fully preserved.

[0067] Figure 2 A flowchart illustrating another embodiment of a media data playback method provided in this application. Figure 2 The process shown is in Figure 1 Based on the illustrated process, the following steps are included: S201. Obtain the advertiser's ad placement configuration information; S202. Identify the delivery type of the current advertising content data based on the advertising delivery configuration information; S203. When the delivery type is a small screen ad delivery type, the ad content data is scheduled to the mobile secondary screen for rendering output. S204. When the delivery type is a large screen advertising delivery type, the step of scheduling the advertising content data that matches the advertising filtering authorization range in the advertising content data to the mobile secondary screen for rendering output is executed.

[0068] For ease of understanding, the following provides a unified explanation of S201-S204: Advertisers: These are commercial entities that place commercial promotional content on television systems. They purchase advertising placement rights to embed advertising content into the broadcast of film and television programs in order to reach users.

[0069] Ad placement configuration information: refers to the configuration data of the ad placement rights purchased by advertisers in the TV system, which is used to identify the placement type corresponding to each ad content data. The placement type includes two types: small screen ad placement type and large screen ad placement type.

[0070] Small screen ad placement type: This refers to the type of ad placement rights purchased by advertisers for displaying ads on mobile secondary screens. The ad content data of this type is scheduled to be rendered and output on the mobile secondary screen, and its display does not affect the program playback on the main TV screen.

[0071] Large-screen ad placement type: This refers to the type of ad placement rights purchased by advertisers for display on the main TV screen. The ad content data of this type involves the display resources occupied by the main TV screen, and whether it can be displayed on the large screen is limited by the user's ad filtering authorization scope.

[0072] In this embodiment, the television system obtains advertising placement configuration information pre-configured or purchased in real-time by advertisers within the television system. This configuration information includes a placement type identifier purchased by the advertiser, used to indicate whether each advertising content data is a small-screen advertising placement type or a large-screen advertising placement type. Based on the obtained advertising placement configuration information, the system identifies the placement type corresponding to the current advertising content data. When the placement type of the current advertising content data is identified as a small-screen advertising placement type, the system directly schedules the corresponding advertising content data to the mobile secondary screen for rendering output. When the system identifies the current ad content data as a large-screen ad, it executes a step of scheduling ad content data matching the ad filtering authorization range to the mobile secondary screen for rendering output. That is, for ad content data of the large-screen ad type, the system does not directly deliver it to the main TV screen, but needs to further determine it based on the user's ad filtering authorization range. When the user's permission level is high enough (such as level 2), the ad is identified as matching the authorization range, and the system schedules it to the mobile secondary screen for rendering output. When the user's permission level is low (such as non-VIP or level 1), the ad is not authorized for filtering, and the system retains it for rendering output on the main TV screen.

[0073] This application, through the aforementioned solution, enables advertisers to independently configure and differentiate their dual-screen advertising permissions. Advertisers can purchase two independent commercial resource slots: small-screen advertising permissions and large-screen advertising permissions. Small-screen ads are not affected by user permission filtering and are displayed directly on the small screen, while large-screen ads are constrained by the user's ad filtering authorization scope. User permissions determine their final destination, thus providing advertisers with commercial advertising resource slots in two dimensions: the main screen and the secondary screen, while ensuring the ad filtering rights of paying users. This increases the flexibility of advertising channels and achieves two-way compatibility between user rights and advertising commercial value.

[0074] In one embodiment, to release display resources and restore the interface after the mobile secondary screen advertisement has finished playing, the method may further include the following steps: during the process of rendering and outputting the advertisement content data on the mobile secondary screen, obtaining playback progress information of the advertisement content data; when the playback progress information indicates that the advertisement content data has finished playing, stopping the rendering and output of the advertisement content data on the mobile secondary screen, and restoring the default display interface of the mobile secondary screen.

[0075] Playback progress information: This refers to the status data used to identify the duration of the advertisement content data played on the mobile secondary screen. The system can use this information to know whether the current advertisement content data has been played.

[0076] Default display interface: refers to the regular display interface of the mobile secondary screen when no advertising content is displayed. It can be the system main interface, standby interface, screensaver interface of the mobile secondary screen, or non-advertising information interface pushed by the TV system (such as home device status, schedule, family messages and other home digital dashboard interfaces).

[0077] In this embodiment, during the process of rendering and outputting advertising content data to the mobile secondary screen, the system obtains the playback progress information of the advertising content data in real time and monitors whether the current advertisement has finished playing based on the playback progress information. When the system determines that the advertising content data has finished playing based on the playback progress information, the system stops the rendering and output of the current advertising content data to the mobile secondary screen and restores the display interface of the mobile secondary screen from the advertising display interface to its default display interface.

[0078] This application achieves the automatic release of display resources on the mobile secondary screen after the advertisement playback is completed through the above solution, ensuring that the secondary screen can promptly resume normal display when there are no more advertisements to play. This avoids the secondary screen remaining on the advertisement end screen for a long time, which would affect the user's use of other functions of the secondary screen. At the same time, it also prepares display resources for the arrival of new advertisement content data.

[0079] Figure 3 This is a block diagram illustrating an embodiment of a media data playback device provided in this application. Figure 3 As shown, the device includes: The acquisition module 31 is used to acquire the media stream to be played and the current user's permission level; Extraction module 32 is used to perform image layer recognition processing on the media stream to distinguish between the main film layer and the advertisement layer, extract the main film content data from the main film layer, and extract the advertisement content data from the advertisement layer; The determining module 33 is used to determine that when the permission level is the first level, the ad filtering authorization scope only includes the pre-boot ad type; and when the permission level is the second level, the ad filtering authorization scope includes all ad types. The first scheduling module 34 is used to schedule the film and television content data to the main screen of the TV for rendering output. The second scheduling module 35 is used to schedule the advertising content data that matches the advertising filtering authorization range to the mobile secondary screen for rendering output, according to the advertising filtering authorization range, wherein the TV main screen and the mobile secondary screen are connected in communication.

[0080] In one possible implementation, the device further includes a monitoring module for: When the permission level is the second level, during the process of scheduling the movie content data to the TV main screen for rendering output, the presence of an advertising layer in the media stream is monitored in real time. When the ad layer is detected, the ad content data corresponding to the ad layer is extracted; The extracted advertising content data is scheduled to the mobile secondary screen for rendering output, while maintaining the continuous rendering output of the main TV screen.

[0081] In one possible implementation, the device further includes a setting module for: When the advertising content data is scheduled to the mobile secondary screen for rendering output, the audio output of the mobile secondary screen is set to mute, while the original audio output of the main TV screen's movie content data is maintained.

[0082] In one possible implementation, the apparatus further includes an execution module for: Obtain the advertiser's ad placement configuration information; The type of advertising content data to be delivered is identified based on the advertising delivery configuration information. When the delivery type is a small screen ad delivery type, the ad content data is scheduled to the mobile secondary screen for rendering output; When the delivery type is a large screen ad delivery type, the step of scheduling the ad content data that matches the ad filtering authorization range in the ad content data to the mobile secondary screen for rendering output is executed.

[0083] In one possible implementation, the device further includes a recovery module for: During the process of rendering and outputting the advertising content data on the mobile secondary screen, the playback progress information of the advertising content data is obtained; When the playback progress information indicates that the advertisement content data has finished playing, the rendering output of the advertisement content data by the mobile secondary screen is stopped, and the default display interface of the mobile secondary screen is restored.

[0084] like Figure 4 As shown in the figure, this application provides a device including a processor 111, a communication interface 112, a memory 113, and a communication bus 114, wherein the processor 111, the communication interface 112, and the memory 113 communicate with each other through the communication bus 114. Memory 113 is used to store computer programs; In one embodiment of this application, when the processor 111 executes the program stored in the memory 113, it implements the media data playback method provided in any of the foregoing method embodiments, including: Get the media stream to be played and the current user's permission level; The media stream is subjected to image layer recognition processing to distinguish between the main film layer and the advertisement layer. The main film content data is extracted from the main film layer, and the advertisement content data is extracted from the advertisement layer. When the permission level is Level 1, the ad filtering authorization scope is determined to include only the pre-boot ad type; when the permission level is Level 2, the ad filtering authorization scope is determined to include all ad types. The video content data is scheduled to the TV main screen for rendering and output. According to the ad filtering authorization range, the ad content data that matches the ad filtering authorization range is scheduled to the mobile secondary screen for rendering output, wherein the TV main screen and the mobile secondary screen are connected in communication.

[0085] This application also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the steps of the media data playback method provided in any of the foregoing method embodiments.

[0086] This application also provides a computer program product containing instructions that, when run on a computer, cause the computer to execute any of the media data playback methods described in the above embodiments.

[0087] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs.

[0088] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented using software plus a general-purpose hardware platform, or of course, using hardware. Based on this understanding, the above technical solutions, in essence or the parts that contribute to the related technology, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0089] It should be understood that the terminology used herein is for the purpose of describing particular exemplary embodiments only and is not intended to be limiting. Unless the context clearly indicates otherwise, the singular forms “a,” “an,” and “described” as used herein may also include the plural forms. The terms “comprising,” “including,” “containing,” and “having” are inclusive and therefore indicate the presence of the stated features, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, steps, operations, elements, components, and / or combinations thereof. The method steps, processes, and operations described herein are not construed as requiring them to be performed in a particular order described or illustrated unless the order of performance is explicitly indicated. It should also be understood that additional or alternative steps may be used.

[0090] The above description is merely a specific embodiment of this application, enabling those skilled in the art to understand or implement this application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this application. Therefore, this application is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features claimed herein.

Claims

1. A method for playing media data, characterized in that, The method includes: Get the media stream to be played and the current user's permission level; The media stream is subjected to image layer recognition processing to distinguish between the main film layer and the advertisement layer. The main film content data is extracted from the main film layer, and the advertisement content data is extracted from the advertisement layer. When the permission level is Level 1, the ad filtering authorization scope is determined to include only the pre-boot ad type; when the permission level is Level 2, the ad filtering authorization scope is determined to include all ad types. The video content data is scheduled to the TV main screen for rendering and output. According to the ad filtering authorization range, the ad content data that matches the ad filtering authorization range is scheduled to the mobile secondary screen for rendering output, wherein the TV main screen and the mobile secondary screen are connected in communication.

2. The method according to claim 1, characterized in that, The method further includes: When the permission level is the second level, during the process of scheduling the movie content data to the TV main screen for rendering output, the presence of an advertising layer in the media stream is monitored in real time. When the ad layer is detected, the ad content data corresponding to the ad layer is extracted; The extracted advertising content data is scheduled to the mobile secondary screen for rendering output, while maintaining the continuous rendering output of the main TV screen.

3. The method according to claim 1, characterized in that, The method further includes: When the advertising content data is scheduled to the mobile secondary screen for rendering output, the audio output of the mobile secondary screen is set to mute, while the original audio output of the main TV screen's movie content data is maintained.

4. The method according to claim 1, characterized in that, The method further includes: Obtain the advertiser's ad placement configuration information; The type of advertising content data to be delivered is identified based on the advertising delivery configuration information. When the delivery type is a small screen ad delivery type, the ad content data is scheduled to the mobile secondary screen for rendering output; When the delivery type is a large screen ad delivery type, the step of scheduling the ad content data that matches the ad filtering authorization range in the ad content data to the mobile secondary screen for rendering output is executed.

5. The method according to claim 1, characterized in that, The method further includes: During the process of rendering and outputting the advertising content data on the mobile secondary screen, the playback progress information of the advertising content data is obtained; When the playback progress information indicates that the advertisement content data has finished playing, the rendering output of the advertisement content data by the mobile secondary screen is stopped, and the default display interface of the mobile secondary screen is restored.

6. A media data playback device, characterized in that, The device includes: The acquisition module is used to acquire the media stream to be played and the current user's permission level; The extraction module is used to perform image layer recognition processing on the media stream to distinguish between the main film layer and the advertisement layer, extract the main film content data from the main film layer, and extract the advertisement content data from the advertisement layer. The determination module is used to determine that when the permission level is the first level, the authorized scope of ad filtering only includes pre-boot ads; and when the permission level is the second level, the authorized scope of ad filtering includes all ad types. The first scheduling module is used to schedule the film and television content data to the main screen of the TV for rendering output; The second scheduling module is used to schedule the advertising content data that matches the advertising filtering authorization range to the mobile secondary screen for rendering output, according to the advertising filtering authorization range. The main TV screen and the mobile secondary screen are connected in communication.

7. An electronic device, characterized in that, include: A processor and a memory, the processor being configured to execute a media data playback program stored in the memory to implement the media data playback method according to any one of claims 1-5.

8. A storage medium, characterized in that, The storage medium stores one or more programs, which can be executed by one or more processors to implement the media data playback method according to any one of claims 1-5.

Images