Playback control method and device
By using artificial intelligence technology on Internet TV to determine whether the video projected by external devices is suitable for children's mode, the problem that the existing technology cannot completely limit the content playback of children is achieved, and a safer user experience is achieved.
Patent Information
- Application Number
- CN202111065621.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-09-10
- Publication Date
- 2025-06-06
- Estimated Expiration
- 2041-09-10
AI Technical Summary
Existing Internet TV video applications cannot completely limit content playback that is not suitable for children when casting videos through external devices.
By using artificial intelligence technology to determine whether the content projected by external devices is suitable for playback in children's mode, and the restricted playback of non-child videos in children's mode is achieved.
When a user casts video on the playback device through an external device, blocking the content that is not suitable for a specific playback mode is achieved, improving the user experience.
Smart Images

Figure CN115802110B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of artificial intelligence, and more specifically, to a playback control method, apparatus, device, computer program product, and storage medium. Background Art
[0002] At present, Internet TV is developing rapidly as a new content service mode. It is rich in content, multi-functional, extensible, selective and interactive, which brings users a good viewing experience and is very popular among the public. Internet TV can install various application software, among which video application software is an indispensable software for Internet TV. It has changed the habits and methods of audio-visual entertainment in the living room of the public and provided users with more services and choices for audio-visual entertainment.
[0003] Video application software usually needs to take into account the use of all members of the user's family, and especially needs to consider the viewing environment of children. This is because children have relatively few channels to obtain information, and the relatively open and safe Internet TV is very attractive to them. However, the content of video application software on Internet TV is currently mixed, and there may be content that is not suitable for children. Therefore, some video application software currently has multiple user modes set for the various user types that may exist in the family. Users can select the desired user mode (for example, children's mode) to filter the displayed content, so that children can stay away from inappropriate video content to a certain extent.
[0004] However, although these video application software can switch to child mode so that only content suitable for children is displayed on their display interface, when videos are projected to the playback devices of these video application software through external devices, even if the projected content is not suitable for children, it can still be played normally on the playback device, and it is impossible to completely restrict the playback of videos that are not suitable for children.
[0005] Therefore, there is a need for an effective playback control method that can shield the playback of non-children's videos when a user projects a video to a playback device through an external device. Summary of the invention
[0006] In order to solve the above problems, the present disclosure utilizes artificial intelligence technology to determine whether the content of multimedia projection by an external device to a playback device is suitable for playback in children's mode, thereby achieving restricted playback of non-children's videos in children's mode.
[0007] Embodiments of the present disclosure provide a playback control method for a playback device, a playback control method for controlling a playback device, and corresponding apparatus, equipment, computer program product, and computer-readable storage medium.
[0008] An embodiment of the present disclosure provides a playback control method for a playback device, the method comprising: obtaining a playback request for controlling the playback device from an external device, the playback request being used to indicate content to be played; obtaining a current playback mode of the playback device, wherein the playback device has multiple playback modes, and each playback mode has a playback content restriction corresponding to it; based on determining that the current playback mode is a preset mode among the multiple playback modes, determining whether the content to be played satisfies the playback content restriction corresponding to the preset mode; and determining whether to play the content to be played on the playback device based on the determination of whether the content to be played satisfies the playback content restriction corresponding to the preset mode.
[0009] According to an embodiment of the present disclosure, the multiple playback modes include a standard mode and also include at least one restriction mode, wherein each restriction mode has its corresponding playback content restriction, and the preset mode is one of the at least one restriction mode; wherein the method further includes: in a case where it is determined that the current playback mode of the playback device is the standard mode, in response to the playback request for the playback device, determining to play the content to be played on the playback device.
[0010] According to an embodiment of the present disclosure, the at least one restriction mode is at least one age mode, wherein each age mode corresponds to a specific age group.
[0011] According to an embodiment of the present disclosure, the play request indicates an initiation method of the play request, and the initiation method of the play request includes private projection and public projection; wherein, in a case where the play request indicates that the initiation method of the play request is private projection, the determination of whether the content to be played meets the playback content restriction corresponding to the preset mode includes determining the content attribute of the content to be played; and in a case where the play request indicates that the initiation method of the play request is public projection, the determination of whether the content to be played meets the playback content restriction corresponding to the preset mode includes playback content analysis of the content to be played.
[0012] According to an embodiment of the present disclosure, the playback request includes identification information of the content to be played, and the identification information of the content to be played indicates that the playback request is initiated as private projection; wherein, determining the content attributes of the content to be played includes: based on the identification information of the content to be played, obtaining attribute indication information related to the content to be played, the attribute indication information is used to indicate whether the content to be played satisfies the playback content restriction corresponding to the preset mode; and based on the obtained attribute indication information, determining whether the content to be played satisfies the playback content restriction corresponding to the preset mode.
[0013] According to an embodiment of the present disclosure, the playback request includes playback address information of the content to be played, and the playback address information of the content to be played indicates that the playback request is initiated by public projection; wherein, the playback content analysis of the content to be played includes: based on the playback address information of the content to be played, obtaining a video fragment list and / or an audio fragment list of the content to be played, the video fragment list of the content to be played includes multiple video fragments of the content to be played, and the audio fragment list of the content to be played includes multiple audio fragments of the content to be played; based on at least a part of the multiple video fragments in the video fragment list and / or at least a part of the multiple audio fragments in the audio fragment list, determining whether the content to be played meets the playback content restriction corresponding to the preset mode.
[0014] According to an embodiment of the present disclosure, for each video segment in the at least part of the video segments and / or each audio segment in the at least part of the audio segments, the correlation between the video segment and / or the audio segment and the preset mode is determined; when the correlation satisfies a first predetermined condition, it is determined that the content to be played satisfies the playback content restriction corresponding to the preset mode; when the correlation does not satisfy the first predetermined condition, it is determined that the video segment and / or the audio segment does not satisfy the playback content restriction corresponding to the preset mode; when the video segment and / or the audio segment that does not satisfy the playback content restriction corresponding to the preset mode satisfies a second predetermined condition, it is determined that the content to be played does not satisfy the playback content restriction corresponding to the preset mode.
[0015] According to an embodiment of the present disclosure, the video segment includes multiple video frames, and the audio segment includes multiple audio frames; wherein, determining the correlation between the video segment and the preset mode includes performing image recognition on at least a part of the multiple video frames; determining the correlation between the audio segment and the preset mode includes performing sound recognition on at least a part of the multiple audio frames; wherein, the first predetermined condition is that the correlation is greater than a first predetermined threshold; and the second predetermined condition is that the number of video segments and / or audio segments that do not meet the playback content restriction corresponding to the preset mode is greater than a second predetermined threshold.
[0016] An embodiment of the present disclosure also provides a playback control method for controlling a playback device, the method comprising: obtaining a current playback mode of the playback device, wherein the playback device has multiple playback modes, and each playback mode has a corresponding playback content restriction; obtaining a playback request for controlling the playback device, the playback request being used to indicate content to be played; based on determining that the current playback mode is a preset mode among the multiple playback modes, determining whether the content to be played meets the playback content restriction corresponding to the preset mode; and based on the determination of whether the content to be played meets the playback content restriction corresponding to the preset mode, sending a playback instruction to the playback device to control whether the content to be played is played on the playback device.
[0017] According to an embodiment of the present disclosure, the multiple playback modes include a standard mode and also include at least one restricted mode, wherein each restricted mode has its corresponding playback content restriction, and the preset mode is one of the at least one restricted mode; wherein the method also includes: in a case where it is determined that the current playback mode of the playback device is the standard mode, in response to the playback request for the playback device, sending a playback instruction to the playback device to control the playback device to play the content to be played.
[0018] According to an embodiment of the present disclosure, the play request indicates an initiation method of the play request, and the initiation method of the play request includes private projection and public projection; wherein, in a case where the play request indicates that the initiation method of the play request is private projection, the determination of whether the content to be played meets the playback content restriction corresponding to the preset mode includes determining the content attribute of the content to be played; and in a case where the play request indicates that the initiation method of the play request is public projection, the determination of whether the content to be played meets the playback content restriction corresponding to the preset mode includes playback content analysis of the content to be played.
[0019] An embodiment of the present disclosure provides a playback control device for a playback device, the device comprising: a request acquisition module, configured to acquire a playback request for controlling the playback device from an external device, the playback request being used to indicate content to be played; a mode acquisition module, configured to acquire a current playback mode of the playback device, wherein the playback device has multiple playback modes, and each playback mode has a playback content restriction corresponding to it; a playback analysis module, configured to determine whether the content to be played satisfies the playback content restriction corresponding to the preset mode based on determining that the current playback mode is a preset mode among the multiple playback modes; and a playback determination module, configured to determine whether to play the content to be played on the playback device based on determining whether the content to be played satisfies the playback content restriction corresponding to the preset mode.
[0020] An embodiment of the present disclosure provides a playback control device, including: one or more processors; and one or more memories, wherein a computer executable program is stored in the one or more memories, and when the computer executable program is executed by the processor, the method described above is performed.
[0021] An embodiment of the present disclosure provides a computer-readable storage medium having computer-executable instructions stored thereon. When the instructions are executed by a processor, the instructions are used to implement the method described above.
[0022] The embodiments of the present disclosure provide a computer program product or a computer program, which includes a computer instruction stored in a computer-readable storage medium. A processor of a computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes a method according to an embodiment of the present disclosure.
[0023] The method provided in the embodiments of the present disclosure adds restriction processing related to a specific playback mode at a playback device or an external device. When it is determined that the current playback mode of the playback device is a preset specific playback mode, the content to be played related to the playback request is analyzed based on the initiation method of the playback request from the external device, and it is automatically and accurately determined whether the content to be played is suitable for the specific playback mode of the playback device, thereby implementing the shielding operation of content that is not suitable for the specific playback mode when the user performs multimedia projection on the playback device through the external device.
[0024] Through the method disclosed in the present invention, when a user initiates multimedia projection from an external device to a playback device in various ways, video screening and filtering for a set specific playback mode can be achieved, and through appropriate adjustment of the method disclosed in the present invention, it can be applied to video screening and filtering for more specific playback modes, so that the user's choices are more diverse and the application scenarios are richer, thereby achieving the effect of improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0025] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some exemplary embodiments of the present disclosure, and a person of ordinary skill in the art can obtain other drawings based on these drawings without creative work.
[0026] Figure 1A is an exemplary schematic diagram showing a scenario of processing a play request initiated by a user terminal to a target terminal according to an embodiment of the present disclosure;
[0027] Figure 1B is an exemplary schematic diagram showing a current playback mode of a playback device selected according to an embodiment of the present disclosure;
[0028] Figure 2 is a flowchart illustrating a playback control method for a playback device according to an embodiment of the present disclosure;
[0029] Figure 3A A schematic diagram showing the interaction between a user terminal and a target terminal through a private protocol;
[0030] Figure 3B A schematic diagram showing a playback control process in a private projection case;
[0031] Figure 3C A schematic diagram showing a display interface of a user terminal initiating a playback request through private projection;
[0032] Figure 4A A schematic diagram showing the playback control process in the case of public projection;
[0033] Figure 4B A schematic diagram of a display interface in which a user terminal initiates a playback request through public projection is shown.
[0034] Figure 5 A schematic diagram showing display interfaces of a user terminal and a destination terminal when it is determined not to play the content to be played is shown;
[0035] Figure 6 A schematic flow chart of a playback control method for a playback device is shown;
[0036] Figure 7 is a flowchart illustrating a playback control method for controlling a playback device according to an embodiment of the present disclosure;
[0037] Figure 8 is a schematic diagram showing a playback control apparatus for a playback device according to an embodiment of the present disclosure;
[0038] Fig. 9 A schematic diagram of a playback control device according to an embodiment of the present disclosure is shown;
[0039] Fig.10 shows the architecture of a computing device according to an embodiment of the present disclosure; and
[0040] Fig.11 A schematic diagram of a storage medium according to the present disclosure is shown. DETAILED DESCRIPTION
[0041] In order to make the purpose, technical solution and advantages of the present disclosure more obvious, the exemplary embodiments according to the present disclosure will be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all the embodiments of the present disclosure, and it should be understood that the present disclosure is not limited to the exemplary embodiments described here.
[0042] In this specification and the accompanying drawings, substantially the same or similar steps and elements are represented by the same or similar reference numerals, and repeated descriptions of these steps and elements will be omitted. At the same time, in the description of the present disclosure, the terms "first", "second", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance or ranking.
[0043] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which the present disclosure pertains. The terms used herein are only for the purpose of describing the embodiments of the present invention and are not intended to limit the present invention.
[0044] To facilitate description of the present disclosure, concepts related to the present disclosure are introduced below.
[0045] The method disclosed in the present invention may be based on artificial intelligence (AI). Artificial intelligence is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results. In other words, artificial intelligence is a comprehensive technology in computer science that attempts to understand the essence of intelligence and produce a new intelligent machine that can respond in a similar way to human intelligence. For example, for methods based on artificial intelligence, it can identify whether a video projected from an external device to a playback device is suitable for a specific user group to watch, similar to how humans identify with the naked eye, thereby determining whether to play the video to be projected on the playback device. By studying the design principles and implementation methods of various intelligent machines, artificial intelligence enables the method disclosed in the present invention to automatically and accurately analyze whether the video projected by the user through an external device to the playback device is suitable for the preset mode of the playback device to filter the video for the preset mode.
[0046] The method disclosed in the present invention can also be based on wireless multimedia sharing technology. Due to the explosive growth of personal portable smart devices, and the display screens thereof cannot grow synchronously due to the requirement of portability, it can be foreseen that real-time projection of multi-device screens through home wireless networks to share multimedia content and realize multi-person entertainment and collaboration will be a trend of Internet TV. Existing wireless multimedia sharing technologies can be mainly divided into public sharing and private sharing (or public projection and private projection) based on their sharing methods (such as the privacy of the communication protocol used for projection). For example, public sharing can be implemented based on sharing technologies using public protocols such as wireless screen projection Airplay and Digital Living Network Alliance DLNA (Digital Living Network Alliance), while private sharing is implemented based on sharing technologies using private protocols specific to developers or users. Airplay is a wireless technology developed by Apple Inc., which can transmit multimedia content including pictures, audio, video, etc. on devices with its specific operating system to devices supporting the sharing technology wirelessly through a local area network. DLNA is a protocol for interconnection between computers, mobile devices, consumer electronics, etc., which is similar to Airplay in function and has substantially the same protocol. For public projection, the external device can project the playback URL of the content to be played to the target playback device, or project the device image to share the entire device screen image to the target playback device (including the status bar, menu, etc.) to transmit real-time data stream to the target playback device. For private projection, the external device only needs to send the identification information of the content to be played to the target playback device, so that the target information related to the content to be played can be obtained from its database based on the identification information.
[0047] In summary, the solutions provided by the embodiments of the present disclosure involve technologies such as artificial intelligence and wireless multimedia sharing technology. The embodiments of the present disclosure will be further described below in conjunction with the accompanying drawings.
[0048] Figure 1A 1 is an exemplary schematic diagram showing a scenario 100 of processing a play request initiated by a user terminal to a target terminal according to an embodiment of the present disclosure. Figure 1B is an exemplary schematic diagram showing the selection of the current playback mode of the playback device according to an embodiment of the present disclosure.
[0049] like Figure 1A As shown, a user can send a play request from his user terminal to a play device on a destination terminal. At this time, for the play device on the destination terminal, the user terminal or the play device on it can be regarded as an external device. The user terminal is connected to the destination terminal through a network, so that the play request initiated by the user terminal can be sent to the destination terminal for processing. Depending on the different ways of initiating the play request, for example, different ways of projecting the content to be played from the user terminal to the play device of the destination terminal, the way of processing the play request can be different.
[0050] Optionally, the user terminal may specifically include a smart phone, a tablet computer, an MP3 player, an MP4 player, a laptop computer, a vehicle terminal, a wearable device, etc. The user terminal may also be a client that installs a browser or various applications (including system applications and third-party applications).
[0051] Optionally, the destination terminal may be a client that is capable of receiving content projection (e.g., video projection, audio projection, etc.) from a user terminal and has a browser or various applications (including system applications and third-party applications) installed as described above. For example, in an embodiment of the present disclosure, the destination terminal may be a television (TV) client that has a video application installed.
[0052] Optionally, the network can be an Internet of Things (IoT) based on the Internet and / or telecommunication network, which can be a wired network or a wireless network, for example, it can be a local area network (LAN), a metropolitan area network (MAN), a wide area network (WAN), a cellular data communication network, or other electronic network that can realize information exchange functions.
[0053] Optionally, the server can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, as well as big data and artificial intelligence platforms.
[0054] In an embodiment of the present disclosure, the destination terminal may be a television (TV) (e.g., an Internet TV) terminal, and various application software installed thereon may have corresponding playback devices (e.g., players of various video application software or audio application software). Due to the particularity of users of TV terminals, various application software thereon, especially video application software, are usually used by almost all members of the user's family, so for such application software, the usage scenarios of all members of the user's family need to be considered.
[0055] Currently, some application software has set up multiple user modes for various user types that may exist in a family. Users can filter the displayed content by selecting the desired user mode, thereby achieving their desired audio-visual environment.
[0056] For example, children are already a large user group of this type of application software. Since this group has relatively few channels to obtain information, the relatively open and secure Internet TV is very attractive to them, and it is necessary to consider their usage scenarios and audio-visual environment for this group. However, the content of application software such as video application software is currently mixed, and there may be content that is not suitable for children. Therefore, a children's mode is set for this user group. Figure 1B As shown, in Figure 1B In (a), a desired playback mode may be selected from the listed mode list as the current playback mode of the playback device of the video software application, such as a children's mode.
[0057] Correspondingly, after the current playback mode is selected, the display interface of the video software application should display the playback content corresponding to the current playback mode. Figure 1B (b) shows the display interface of the video software application after the children's mode is selected. The recommended playback contents displayed in the display interface are all children's animations corresponding to the children's mode.
[0058] The above-mentioned processing can keep children away from inappropriate video content to a certain extent. However, although these video application software can switch to child mode so that only content suitable for children is displayed on their display interface, when the video is projected to the playback device of these video application software through an external device, even if the projected content is not suitable for children, it can still be played normally on the playback device, and it is impossible to completely restrict the playback of videos that are not suitable for children.
[0059] Similarly, for other playback modes of the playback device, video projection can also be performed through an external device to achieve the purpose of normally playing content that is not suitable for the current playback mode on the playback device, which obviously goes against the expectation of setting various playback modes.
[0060] Based on this, the present disclosure provides a playback control method, which adds restriction processing related to a specific playback mode at a playback device or an external device. When it is determined that the current playback mode of the playback device is a preset specific playback mode, the to-be-played content related to the playback request is analyzed based on the initiation method of the playback request from the external device, and whether the to-be-played content is suitable for the specific playback mode of the playback device is automatically and accurately determined, thereby implementing a shielding operation on content that is not suitable for the specific playback mode when a user performs multimedia projection on the playback device through an external device.
[0061] Through the method disclosed in the present invention, when a user initiates multimedia projection from an external device to a playback device in various ways, video screening and filtering for a set specific playback mode can be achieved, and through appropriate adjustment of the method disclosed in the present invention, it can be applied to video screening and filtering for more specific playback modes, so that the user's choices are more diverse and the application scenarios are richer, thereby achieving the effect of improving the user experience.
[0062] Figure 2 is a flowchart illustrating a playback control method 200 for a playback device according to an embodiment of the present disclosure.
[0063] Optionally, the playback control method 200 adds restriction processing related to a specific playback mode at the playback device.
[0064] like Figure 2 As shown, in step S201, a play request for controlling the play device may be obtained from an external device, where the play request is used to indicate content to be played.
[0065] Optionally, the play request may be a multimedia projection initiated by an external device to a playback device via a wireless network, which may include information indicating the content to be played. The content to be played may be various types of multimedia content, such as pictures, audio, video, etc. In the embodiments of the present disclosure, video and audio are used as examples rather than limitations to illustrate the playback control method for a playback device of the present disclosure.
[0066] Optionally, according to different initiation methods of the multimedia projection, the information included in the playback request for indicating the content to be played may be correspondingly different. Therefore, the initiation method of the playback request may be determined at the playback device based on the content of the received playback request.
[0067] For example, when the multimedia projection is initiated based on a public protocol, the play request may include the play URL of the content to be played as described above, and when the multimedia projection is initiated based on a private protocol, the play request may include identification information of the content to be played.
[0068] In step S202, the current playback mode of the playback device may be acquired, wherein the playback device has multiple playback modes, and each playback mode has a corresponding playback content restriction.
[0069] According to an embodiment of the present disclosure, the plurality of playback modes may include a standard mode, and may further include at least one restriction mode, wherein each restriction mode has its corresponding playback content restriction.
[0070] Optionally, the standard mode may be a default mode of the playback device, which may be a factory mode set by a developer. In the standard mode, all types of multimedia content may be allowed to be played by default.
[0071] Optionally, the at least one restriction mode can be designed based on actual application scenarios and specific needs. For example, in the embodiments of the present disclosure, as described above, for a playback device such as a video application software or an audio application software, it is expected that the at least one restriction mode it has can cover the usage scenarios and usage needs of all members in the user's family, and each restriction mode has its corresponding playback content restriction to achieve playback content screening and filtering for a specific type of user.
[0072] Optionally, taking into account the age distribution of each member in the user's family and their preferences for the playback content of the playback device, the at least one restriction mode can be set based on the user's age group.
[0073] According to an embodiment of the present disclosure, the at least one restriction mode may be at least one age mode, wherein each age mode corresponds to a specific age group.
[0074] For example, the content preferences for playback devices may include the selection preferences of users of different age groups for playback content, etc. In addition, for special user groups such as children, additional factors may be considered in their corresponding restriction modes for the purpose of protection, such as whether the content to be played is suitable for viewing by the user group.
[0075] In step S203, based on determining that the current playback mode is a preset mode among the multiple playback modes, it is determined whether the to-be-played content satisfies the playback content restriction corresponding to the preset mode.
[0076] According to an embodiment of the present disclosure, the preset mode may be one of the at least one restriction mode. For example, the preset mode may be set to a child mode, an elderly mode, etc. based on the user's age, and may also be set to a male mode, a female mode, etc. based on the user's gender.
[0077] Optionally, after determining that the current playback mode of the playback device is a preset mode, it may be determined whether the content to be played is suitable for playback in the preset mode, that is, whether the content to be played meets the playback content restriction corresponding to the preset mode.
[0078] Since the information for indicating the content to be played included in the play request is different depending on the initiation method thereof, the method for performing the above-mentioned determination of whether the content to be played satisfies the play content restriction corresponding to the preset mode based on the information also changes accordingly. Therefore, the determination of whether the content to be played satisfies the play content restriction corresponding to the preset mode can be performed differently based on the initiation method of the play request.
[0079] According to an embodiment of the present disclosure, the play request may indicate a mode of initiating the play request, and the mode of initiating the play request may include private projection and public projection.
[0080] As previously mentioned, since currently the only way for users to initiate playback requests to playback devices through external devices is multimedia projection, and multimedia projection can be divided into private projection and public projection, which correspond to different contents of playback requests sent to playback devices, the playback device can determine the method for initiating the playback request based on the content of the received playback request.
[0081] According to an embodiment of the present disclosure, the play request may include identification information of the content to be played, and the identification information of the content to be played may indicate that the play request is initiated in a private projection manner.
[0082] Optionally, in the case of private projection, the external device and the playback device communicate through the same local area network using a private protocol. The private protocol may be a communication protocol unique to the external device and the playback device, which is usually developed and applied by the developer or user, and the same multimedia resource library may be shared on both ends of the external device and the playback device to which the private protocol is applied. For any resource in the resource library, a unified identity (ID) may be used on both ends of the external device and the playback device to refer to the same resource. The identity is the identification information of the content to be played, which may be the specific ID of the content to be played (e.g., video ID, audio ID, etc.), or it may be the ID of the album in which the content to be played is located. For example, in the case where the content to be played is a video, its identification information may be the ID of the video album in which the video is located (such as if the content to be played is an episode of a TV series, then the corresponding album is the album of the TV series).
[0083] According to an embodiment of the present disclosure, when the play request indicates that the play request is initiated in a private projection manner, determining whether the to-be-played content satisfies the play content restriction corresponding to the preset mode may include determining a content attribute of the to-be-played content.
[0084] Optionally, when an external device sends ID information indicating content to be played to the playback device, the playback device can obtain resource information corresponding to the ID information from its resource library based on the ID information, that is, relevant information about the content to be played. The relevant information can be pre-written by the developer or user, and can directly include parameters for indicating whether the content to be played meets the playback content restrictions corresponding to the preset mode, that is, the content attribute field of the content to be played.
[0085] In addition, according to an embodiment of the present disclosure, the play request may include play address information of the content to be played, and the play address information of the content to be played may indicate that the play request is initiated in a public projection manner.
[0086] Optionally, in the case of public projection, the external device and the playback device communicate via a public protocol, such as DLNA and Airplay, which are commonly used by most wireless devices.
[0087] Optionally, the external device and the playback device communicating via a public protocol may indicate the content to be played by sending playback address information of the content to be played.
[0088] For example, the playback address information of the content to be played sent can be a Uniform / Universal Resource Locator (URL) (also known as a web page address), which is the address of a standard resource on the Internet. After receiving this playback address information, the playback device can directly obtain the content to be played through it.
[0089] Optionally, the external device and the playback device that communicate through a public protocol can also indicate the content to be played by the external device directly projecting its screen image to the playback device. That is, the external device can directly send its real-time data stream to the playback device, and the real-time data stream is the content to be played.
[0090] According to an embodiment of the present disclosure, when the playback request indicates that the playback request is initiated in a public projection manner, determining whether the to-be-played content satisfies the playback content restriction corresponding to the preset mode may include analyzing the playback content of the to-be-played content.
[0091] In the case of public projection, the playback device can only obtain the content to be played and determine whether it meets the playback content restrictions corresponding to the preset mode based on the content to be played, and cannot directly perform this determination through the above-mentioned information such as the content attribute field. Therefore, it is necessary to analyze its content (for example, the picture content of the video, the sound content of the audio, etc.).
[0092] Therefore, the following determination of whether the content to be played satisfies the content restriction corresponding to the preset mode can be described in detail based on private projection and public projection respectively. Figures 3A-3C For a private projection, see Figure 4A-4B The case of public projection is shown and will not be described in detail herein.
[0093] In step S204, it is determined whether to play the content to be played on the playback device based on whether the content to be played satisfies the playback content restriction corresponding to the preset mode. For example, if the content to be played satisfies the playback content restriction corresponding to the preset mode, it is determined to play the content to be played on the playback device.
[0094] Optionally, after determining that the current playback mode is a preset mode and the content to be played meets the playback content restriction corresponding to the preset mode, it may be determined to play the content to be played on the playback device.
[0095] Optionally, when it is determined that the current playback mode is a preset mode and the content to be played does not meet the playback content restrictions corresponding to the preset mode, it can be determined not to play the content to be played on the playback device, and indications of this determination are sent to the playback device and the external device respectively so as to display prompt information related to this determination to the user on their respective display interfaces.
[0096] In addition, according to an embodiment of the present disclosure, the method may further include step S205, in which, when it is determined that the current playback mode of the playback device is the standard mode, in response to the playback request to the playback device, it may be determined to play the content to be played on the playback device.
[0097] Optionally, the playback content restriction corresponding to the standard mode may be set by default to allow all types of multimedia content to be played on the playback device. Therefore, when it is determined that the current playback mode of the playback device is the standard mode, the corresponding content playback may be directly started in response to any playback request.
[0098] Below, reference Figure 3A-Figure 5 To illustrate the determination of whether the content to be played satisfies the content restriction corresponding to the preset mode, Figures 3A-3Cshows the determination of the case of private projection, Figure 4A-4B The determination in the case of a public projection is shown.
[0099] in, Figure 3A A schematic diagram showing the interaction between a user terminal and a target terminal through a private protocol is shown. Figure 3B A schematic diagram showing a playback control process in a private projection case. Figure 3C A schematic diagram of a display interface in which a user terminal initiates a playback request through private projection is shown.
[0100] like Figure 3A As shown, before performing private projection, the user terminal and the target terminal need to be connected to the same WiFi device to be in the same local area network.
[0101] Optionally, the application software on the target terminal can start a multicast DNS (mDNS) discovery service, so that the corresponding application software on the user terminal can search for the mDNS service of the target terminal through the mDNS protocol, and parse the information of the target terminal included in the mDNS protocol, including information such as the name of the target terminal, the service port of the private projection protocol, etc.
[0102] Therefore, the user terminal can be connected to the service port of the private protocol of the target terminal through the local area network, so that the private protocol can be used to perform private projection on the target terminal.
[0103] like Figure 3B As shown, the private projection of the user terminal to the target terminal can actually be a private projection of the playback device (ie, external device) corresponding to the application software on the user terminal to the playback device of the corresponding application software on the target terminal.
[0104] Therefore, after the external device corresponding to the application software of the user terminal is started, the external device can perform private projection on the target terminal through a private protocol to initiate a play request. The private projection can carry identification information indicating the content to be played, such as the ID information described above.
[0105] Optionally, after receiving the above identification information, the target terminal may parse the identification information of the content to be played from the received private projection, and package the identification information and transmit it to the playback device for determining the content attributes of the content to be played.
[0106] According to an embodiment of the present disclosure, determining the content attributes of the content to be played may include: based on the identification information of the content to be played, obtaining attribute indication information related to the content to be played, the attribute indication information being used to indicate whether the content to be played satisfies the playback content restriction corresponding to the preset mode; and based on the obtained attribute indication information, determining whether the content to be played satisfies the playback content restriction corresponding to the preset mode.
[0107] Optionally, after the playback device is started, based on the identification information of the content to be played extracted from the packaged data, the attribute indication information of the content to be played can be requested from the background of the application software. For example, the background of the application software can only be used by devices that can use its corresponding private protocol, such as an application server associated with the application software.
[0108] Optionally, based on the acquired attribute indication information, it can be determined whether the content to be played meets the playback content restriction corresponding to the preset mode.
[0109] For example, when the preset mode is the children's mode, the attribute indication information of the video information corresponding to the content to be played can be obtained through the video information interface. The attribute indication information can be a field related to the preset mode (for example, the isChildModel field). When the field indication is true, it can be determined that the content to be played meets the playback content restrictions corresponding to the preset mode. Otherwise, it is determined that the content to be played does not meet the playback content restrictions corresponding to the preset mode.
[0110] After the content attributes of the content to be played are determined, corresponding results can be displayed based on the results of the determination, and the result display includes but is not limited to: when it is determined that the content to be played meets the playback content restrictions corresponding to the preset mode, it is determined to play the content to be played on the playback device, and optionally a prompt related to the successful projection is sent to the external device on the user terminal; and when it is determined that the content to be played does not meet the playback content restrictions corresponding to the preset mode, it is determined not to play the content to be played on the playback device, and optionally prompts related to the failure of projection are displayed on the playback devices on the destination terminal and the user terminal respectively.
[0111] Specifically, Figure 3C In the figure, the children's mode is used as the preset mode, and video projection is taken as an example to show the display interface corresponding to initiating private projection in two example ways.
[0112] like Figure 3CAs shown, interface A is a video playback page on a playback device (ie, an external device) corresponding to the video application software of the user terminal. In this interface, the currently playing video is the second video in the children's animation album, which includes a total of 6 videos.
[0113] Optionally, a projection request for the currently playing video may be initiated through the TV icon on the upper right side of the playing screen displayed in the current interface, as shown in interface B.
[0114] In interface B, you can select private projection, for example, select the device "Living Room TV (B2BC)", where "B2BC" represents the device number of the living room TV, and when the device is not followed by an identifier indicating public projection (for example, a "DLNA" identifier corresponding to the DLNA protocol), selecting the device corresponds to selecting private projection with the device.
[0115] In addition to initiating private projection through the video playback page, private projection can also be initiated in the video details page. For example, in interface C, the details page of the video album "Children's Animation" is displayed, where the device "Living Room TV (B2BC)" can be selected through the inverted triangle icon at the top of the page, and a specific video in the video album can be selected for projection playback.
[0116] Therefore, as described above, when performing private projection, the identification information of the content to be played sent by the external device may include the album ID information of the video album "Children's Animation" and the video ID information of the selected specific video.
[0117] Corresponding to the above two example initiation methods of private projection, interface D is the display interface on the external device after the projection is confirmed to be successful, wherein the playback device in the private projection state is the device "Living Room TV (B2BC)". As shown in interface D, during video projection, the playback device of the target terminal can be controlled by the user terminal, such as controlling the image quality type of the displayed picture, switching the playback device, stopping video projection, and switching the projection video in the album list to which the currently projected video belongs.
[0118] In addition, a similar method can be used to implement other types of multimedia projection such as audio projection, and the preset mode can also be other modes besides the children's mode. The above embodiments of the present disclosure are only described using video projection and children's mode as examples, which should not be regarded as limitations on these contents.
[0119] Figure 4A A schematic diagram showing the playback control process in a public projection case is shown. Figure 4B A schematic diagram of a display interface in which a user terminal initiates a playback request through public projection is shown.
[0120] As described above, when the external device initiates a public projection, the public projection may include playback address information indicating the content to be played, so as to be used for playback content analysis of the content to be played.
[0121] According to an embodiment of the present disclosure, the playback content analysis of the content to be played may include: performing at least image recognition or audio recognition on the content to be played to determine whether the content to be played meets the playback content restriction corresponding to the preset mode.
[0122] Specifically, according to an embodiment of the present disclosure, the playback content analysis of the content to be played may include: based on the playback address information of the content to be played, obtaining a video segment list and / or an audio segment list of the content to be played, the video segment list of the content to be played including multiple video segments of the content to be played, and the audio segment list of the content to be played including multiple audio segments of the content to be played; based on at least a part of the multiple video segments in the video segment list and / or at least a part of the multiple audio segments in the audio segment list, determining whether the content to be played meets the playback content restriction corresponding to the preset mode.
[0123] Correspondingly, if Figure 4A As shown, after receiving the playback address information of the content to be played, the playback device can access the server based on the playback address information to obtain the address of the segment list (eg, video / audio segment list) of the content to be played for subsequent caching and analysis.
[0124] It should be understood that the server can be shared by all network devices, and is different from the background in the above private projection, which can only be used by devices that can use its corresponding private protocol. For example, the server can be a server that provides the content to be played.
[0125] Optionally, before starting content analysis of the video / audio segment list included in the content to be played, in order to make the analysis more efficient, the data of a video / audio segment in the video / audio segment list can be cached in the memory to facilitate subsequent extraction of video / audio frame data therefrom.
[0126] According to an embodiment of the present disclosure, for each video segment in the at least part of the video segments and / or each audio segment in the at least part of the audio segments, the correlation between the video segment and / or the audio segment and the preset mode can be determined; when the correlation satisfies a first predetermined condition, it is determined that the content to be played satisfies the playback content restriction corresponding to the preset mode; when the correlation does not satisfy the first predetermined condition, it is determined that the video segment and / or the audio segment does not satisfy the playback content restriction corresponding to the preset mode; when the video segment and / or the audio segment that does not satisfy the playback content restriction corresponding to the preset mode satisfies a second predetermined condition, it is determined that the content to be played does not satisfy the playback content restriction corresponding to the preset mode.
[0127] Optionally, determining the correlation between the video segment and / or the audio segment and the preset mode may be based on the correlation between at least a portion of the video segment and / or the audio segment and the preset mode.
[0128] According to an embodiment of the present disclosure, the video slice may include a plurality of video frames, and the audio slice may include a plurality of audio frames.
[0129] Optionally, a number of video / audio frame data may be extracted from the cached video / audio segments and compressed to be sent to an analysis backend for content analysis. For example, the analysis backend may be an analysis server associated with the shared projection, or the external device itself may serve as the analysis backend.
[0130] For example, the picture / sound data of several (for example, 7) key frames can be randomly extracted from the cache data. Since the uncompressed data will occupy more bandwidth resources and affect the transmission efficiency, the data can be compressed at the playback device before each transmission to improve the transmission efficiency.
[0131] Optionally, after receiving the compressed video / audio frame data, the analysis background may perform decompression and picture / sound analysis.
[0132] According to an embodiment of the present disclosure, determining the correlation between the video segment and the preset mode may include performing image recognition on at least a portion of the multiple video frames; determining the correlation between the audio segment and the preset mode includes performing sound recognition on at least a portion of the multiple audio frames; wherein the first predetermined condition is that the correlation is greater than a first predetermined threshold; and the second predetermined condition is that the number of video segment and / or audio segment that do not meet the playback content restriction corresponding to the preset mode is greater than a second predetermined threshold.
[0133] For example, for video projection, the analysis background may perform image recognition processing on the decompressed video frames to determine the relevance of these video frames with the preset mode, thereby determining the relevance of the video segments to which they belong with the preset mode.
[0134] Optionally, the image recognition may include a plurality of recognition methods, and these recognition methods may be commonly applied to the same video frame to accurately recognize whether the content to be played is suitable for playing in a preset mode.
[0135] For example, when the preset mode is a children's mode, these recognition methods may include but are not limited to face recognition, scene recognition, and object recognition. Among them, face recognition can be used to determine whether there are real people in the picture, because if a real person appears in the video frame, it can be considered that the video is not a children's animation. Scene recognition can identify the text in the picture, and by analyzing whether the text is suitable for children, it can be determined whether the video is a children's animation. In addition, object recognition can identify whether there are toys or animation characters in the picture, thereby determining whether the video is a children's animation.
[0136] Optionally, based on the above-mentioned multiple identification methods, the relevance between these video frames and the preset mode may be scored, and then the relevance between the video segments to which they belong and the preset mode may be scored.
[0137] For example, for any of the three recognition methods, if all of the video frames can be identified as children's animation, then for the recognition method, the video segment to which the video frames belong can obtain one point, otherwise it can obtain zero points. For all recognition methods, the sum of the scores obtained by the video segment can be considered as the relevance of the video segment to the preset mode.
[0138] Therefore, when the sum of the obtained scores is greater than the expected score (ie, the first predetermined threshold, such as one point), it can be considered that the to-be-played content meets the playback content restriction corresponding to the preset mode.
[0139] On the contrary, when the sum of the obtained scores is not greater than the expected score, it can be determined that the video segment or the audio segment does not meet the playback content restriction corresponding to the preset mode.
[0140] At this time, optionally, the next video segment or audio segment can be continuously analyzed, and when multiple consecutive video segments or audio segments do not meet the playback content restrictions corresponding to the preset mode, it is determined that the content to be played does not meet the playback content restrictions corresponding to the preset mode.
[0141] For audio projection or other types of multimedia projection, a method similar to the above may be used to determine the correlation between the corresponding audio segment or other types of segment and the preset mode, and the present disclosure does not limit this.
[0142] Similar to Figure 3C , Figure 4B The children's mode is also used as the preset mode, and video projection is taken as an example to illustrate the display interface corresponding to initiating public projection in two example ways.
[0143] like Figure 4B As shown, similar to Figure 3C In interface A, users can initiate video projection from the video playback page and Figure 4B For example, in interface A, a device “Living Room TV (DLNA)” is selected. The device has a “DLNA” identifier corresponding to the DLNA protocol, so selecting the device corresponds to selecting public projection with the device.
[0144] Similarly, in addition to initiating public projection through the video playback page, public projection can also be initiated in the video details page. For example, in interface B, the details page of the video album "Children's Animation" is displayed, where the device "Living Room TV (DLNA)" can be selected through the inverted triangle icon at the top of the page, and a specific video in the video album can be selected for projection playback.
[0145] Corresponding to the above-mentioned initiation method of public projection, interface D is the display interface on the external device after the projection is confirmed to be successful, wherein the playback device in the public projection state is the device "Living Room TV (DLNA)". As shown in interface D, similar to the case of private projection, during video projection, the playback device of the target terminal can also be controlled by the user terminal.
[0146] In addition, users can also directly initiate public projection through wireless screen projection (Airplay), as shown in interface C. In interface C, by selecting Airplay, users can select the target playback device in the searched list of available devices, such as "Living Room TV", and then directly transmit its real-time data stream to the target playback device through screen mirroring. After receiving the data stream, the target playback device can analyze the data stream through a playback content analysis operation similar to the above, so as to determine whether to display the screen corresponding to the real-time data stream on the target playback device.
[0147] Figure 5 A schematic diagram showing display interfaces of a user terminal and a destination terminal when it is determined not to play the content to be played is shown.
[0148] Figure 5Taking the children's mode as the preset mode and video projection as an example, the projection result of attempting to initiate video projection of an "adult series" to a playback device in this preset mode is shown.
[0149] in, Figure 5 (a) and Figure 5 (b) can correspond to Figure 3B and Figure 4A When it is determined that the content to be played will not be played, the processing result is prompted to the external device (for example, the playback device on the mobile phone end) and the display interface of the projection failure is prompted to the playback device (for example, the playback device on the TV end).
[0150] Since the method disclosed herein determines that the "adult series" does not meet the playback content restrictions corresponding to the children's mode, the playback device refuses to play this video thereon, so the video projection fails and the projection content that is not suitable for the preset mode is successfully blocked.
[0151] Figure 6 A schematic flow chart of a playback control method 200 for a playback device is shown.
[0152] Figure 6 The processing flow shown may correspond to the playback control method 200 for a playback device described above, and mainly includes determining the current playback mode and the initiation method (ie, projection method) of the playback request in response to an external playback request to the playback device.
[0153] Next, determining whether to play the content to be played on the playback device may mainly include the following steps:
[0154] When the current playback mode is the standard mode, determining to play the content to be played on the playback device;
[0155] When the current playback mode is the preset mode:
[0156] When the projection mode is private projection, determining the content attributes of the content to be played;
[0157] When the projection mode is public projection, performing a playback content analysis on the content to be played;
[0158] Based on the result of determining the content attributes / playing content analysis of the content to be played, determine
[0159] Whether the content to be played meets the playback content restrictions corresponding to the preset mode:
[0160] If the content to be played meets the content restriction corresponding to the preset mode, determining to play the content to be played on the playback device;
[0161] When the content to be played does not satisfy the content playback restriction corresponding to the preset mode, it is determined not to play the content to be played on the playback device.
[0162] According to an embodiment of the present disclosure, in addition to adding restriction processing related to a specific playback mode at the playback device as shown in the playback control method 200, restriction processing related to a specific playback mode may also be added at an external device.
[0163] Figure 7 is a flowchart illustrating a playback control method 700 for controlling a playback device according to an embodiment of the present disclosure.
[0164] like Figure 7 As shown, in step S701, the current playback mode of the playback device is obtained, wherein the playback device has multiple playback modes, and each playback mode has its corresponding playback content restriction.
[0165] According to an embodiment of the present disclosure, the multiple playback modes include a standard mode and also include at least one restriction mode, wherein each restriction mode has its corresponding playback content restriction, and the preset mode is one of the at least one restriction mode.
[0166] For example, considering the age distribution of each member in the user's family and their preferences for the playback content of the playback device, the at least one restriction mode can be set based on the user's age group.
[0167] In step S702, a play request for controlling the play device is obtained, where the play request is used to indicate content to be played.
[0168] It should be understood that the playback control method 700 is executed on the external device side, so the current playback mode of the playback device can be obtained from the playback device, and the playback request can be obtained from the external device.
[0169] According to an embodiment of the present disclosure, the play request indicates a mode of initiating the play request, and the mode of initiating the play request may include private projection and public projection.
[0170] Optionally, the determination of whether the content to be played satisfies the playback content restriction corresponding to the preset mode can be performed differently based on the initiation method of the playback request, and the initiation method of the playback request does not need to be determined based on the content of the playback request received by the playback device as in the playback control method 200, but can be determined directly at the external device, for example, according to the above reference Figure 3C and 4B Determined by the equipment selection.
[0171] In step S703, based on determining that the current playback mode is a preset mode among the multiple playback modes, it is determined whether the to-be-played content satisfies the playback content restriction corresponding to the preset mode.
[0172] According to an embodiment of the present disclosure, when the play request indicates that the play request is initiated in a private projection, the determining whether the content to be played satisfies the play content restriction corresponding to the preset mode includes determining a content attribute of the content to be played; and when the play request indicates that the play request is initiated in a public projection, the determining whether the content to be played satisfies the play content restriction corresponding to the preset mode includes analyzing the play content of the content to be played.
[0173] Since this operation is performed at the external device, the playback control method 700 does not need to transmit information related to the playback request to the playback device. In addition, the remaining operations can be similar to the playback control method 200, and will not be repeated herein.
[0174] In step S704, based on the determination of whether the content to be played meets the playback content restriction corresponding to the preset mode, a play instruction is sent to the playback device to control whether to play the content to be played on the playback device. For example, if the content to be played meets the playback content restriction corresponding to the preset mode, a play instruction is sent to the playback device to control the playback device to play the content to be played.
[0175] Optionally, after determining that the current playback mode of the playback device is a preset mode and the content to be played meets the playback content restriction corresponding to the preset mode, it can be determined that the content to be played can be played on the playback device.
[0176] Optionally, after determining that the current playback mode of the playback device is a preset mode and the content to be played does not satisfy the playback content restriction corresponding to the preset mode, it may be determined not to play the content to be played on the playback device.
[0177] Therefore, the external device can send a corresponding playback instruction to the playback device to control the playback device to play / not play the content to be played, and display prompt information related to the above determination to the user on the display interface of the playback device.
[0178] In addition, similar to the playback control method 200, the playback control method 700 may also include step 705. When it is determined that the current playback mode of the playback device is the standard mode, in response to the playback request for the playback device, a playback instruction may be sent to the playback device to control the playback device to play the content to be played.
[0179] Optionally, the playback content restriction corresponding to the standard mode may be defaulted to allow all types of multimedia content to be played on the playback device. Therefore, when it is determined that the current playback mode of the playback device is the standard mode, the external device may send a playback instruction to the playback device to control the playback device to play any content.
[0180] Figure 8 is a schematic diagram showing a playback control apparatus 800 for a playback device according to an embodiment of the present disclosure.
[0181] According to an embodiment of the present disclosure, a playback control apparatus 800 for a playback device may include a request acquisition module 801 , a mode acquisition module 802 , a playback analysis module 803 and a playback determination module 804 .
[0182] The request acquisition module 801 may be configured to acquire a play request for controlling the play device from an external device, wherein the play request is used to indicate content to be played.
[0183] Optionally, the play request may be a multimedia projection initiated by an external device to a play device via a wireless network, which may include information indicating the content to be played. The content to be played may be various types of multimedia content, such as pictures, audio, video, and the like.
[0184] The mode acquisition module 802 may be configured to acquire the current playback mode of the playback device, wherein the playback device has multiple playback modes, and each playback mode has a corresponding playback content restriction.
[0185] Optionally, taking into account the age distribution of each member in the user's family and their preferences for the playback content of the playback device, the at least one restriction mode can be set based on the user's age group.
[0186] For example, the content preferences for playback devices may include the selection preferences of users of different age groups for playback content, etc. In addition, for special user groups such as children, additional factors may be considered in their corresponding restriction modes for the purpose of protection, such as whether the content to be played is suitable for viewing by the user group.
[0187] The play analysis module 803 may be configured to determine whether the to-be-played content satisfies the play content restriction corresponding to the preset mode based on determining that the current play mode is a preset mode among the multiple play modes.
[0188] For example, the preset mode can be set to a child mode, an elderly mode, etc. based on the user's age, and can also be set to a male mode, a female mode, etc. based on the user's gender.
[0189] Optionally, after determining that the current playback mode of the playback device is a preset mode, it may be determined whether the content to be played is suitable for playback in the preset mode, that is, whether the content to be played meets the playback content restriction corresponding to the preset mode.
[0190] Optionally, the determination of whether the content to be played satisfies the content restriction corresponding to the preset mode may be performed differently based on the initiation mode of the play request.
[0191] The play determination module 804 may be configured to determine whether to play the content to be played on the playback device according to whether the content to be played satisfies the playback content restriction corresponding to the preset mode. For example, if the content to be played satisfies the playback content restriction corresponding to the preset mode, it is determined to play the content to be played on the playback device.
[0192] Optionally, after determining that the current playback mode is a preset mode and the content to be played meets the playback content restriction corresponding to the preset mode, it may be determined to play the content to be played on the playback device.
[0193] Optionally, when it is determined that the current playback mode is a preset mode and the content to be played does not meet the playback content restrictions corresponding to the preset mode, it can be determined not to play the content to be played on the playback device, and indications of this determination are sent to the playback device and the external device respectively so as to display prompt information related to this determination to the user on their respective display interfaces.
[0194] According to yet another aspect of the present disclosure, a playback control device is provided. Fig. 9 A schematic diagram of a playback control device 2000 according to an embodiment of the present disclosure is shown.
[0195] like Fig. 9 As shown, the playback control device 2000 may include one or more processors 2010 and one or more memories 2020. The memory 2020 stores computer readable codes, and when the computer readable codes are run by the one or more processors 2010, the method described above may be executed.
[0196] The processor in the embodiments of the present disclosure may be an integrated circuit chip having signal processing capabilities. The processor may be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present application may be implemented or executed. The general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc., and may be an X86 architecture or an ARM architecture.
[0197] In general, various example embodiments of the present disclosure may be implemented in hardware or dedicated circuits, software, firmware, logic, or any combination thereof. Certain aspects may be implemented in hardware, while other aspects may be implemented in firmware or software that may be executed by a controller, microprocessor, or other computing device. When various aspects of the embodiments of the present disclosure are illustrated or described as block diagrams, flow charts, or using some other graphical representation, it will be understood that the blocks, devices, systems, techniques, or methods described herein may be implemented in hardware, software, firmware, dedicated circuits or logic, general purpose hardware or controllers or other computing devices, or some combination thereof as non-limiting examples.
[0198] For example, the method or device according to the embodiment of the present disclosure may also be implemented by Fig.10 The architecture of the computing device 3000 shown in FIG. Fig.10 As shown, the computing device 3000 may include a bus 3010, one or more CPUs 3020, a read-only memory (ROM) 3030, a random access memory (RAM) 3040, a communication port 3050 connected to a network, an input / output component 3060, a hard disk 3070, etc. The storage device in the computing device 3000, such as the ROM 3030 or the hard disk 3070, may store various data or files used for processing and / or communication of the method provided in the present disclosure and program instructions executed by the CPU. The computing device 3000 may also include a user interface 3080. Of course, Fig. 9 The architecture shown is only exemplary and can be omitted according to actual needs when implementing different devices. Fig.10 One or more components of a computing device are shown.
[0199] According to yet another aspect of the present disclosure, a computer-readable storage medium is provided. Fig.11 A schematic diagram 4000 of a storage medium according to the present disclosure is shown.
[0200] like Fig.11As shown, the computer storage medium 4020 stores computer readable instructions 4010. When the computer readable instructions 4010 are executed by the processor, the method according to the embodiment of the present disclosure described with reference to the above figures can be executed. The computer readable storage medium in the embodiment of the present disclosure can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. The non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM) or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous connection dynamic random access memory (SLDRAM) and direct memory bus random access memory (DR RAM). It should be noted that memory of the methods described herein is intended to include, but is not limited to, these and any other suitable types of memory. It should be noted that memory of the methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.
[0201] The embodiments of the present disclosure also provide a computer program product or a computer program, which includes a computer instruction stored in a computer-readable storage medium. The processor of the computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the method according to the embodiments of the present disclosure.
[0202] Embodiments of the present disclosure provide a playback control method, apparatus, device, computer program product, and computer-readable storage medium.
[0203] The method provided in the embodiments of the present disclosure adds restriction processing related to a specific playback mode at a playback device or an external device. When it is determined that the current playback mode of the playback device is a preset specific playback mode, the content to be played related to the playback request is analyzed based on the initiation method of the playback request from the external device, and it is automatically and accurately determined whether the content to be played is suitable for the specific playback mode of the playback device, thereby implementing the shielding operation of content that is not suitable for the specific playback mode when the user performs multimedia projection on the playback device through the external device.
[0204] Through the method disclosed in the present invention, when a user initiates multimedia projection from an external device to a playback device in various ways, video screening and filtering for a set specific playback mode can be achieved, and through appropriate adjustment of the method disclosed in the present invention, it can be applied to video screening and filtering for more specific playback modes, so that the user's choices are more diverse and the application scenarios are richer, thereby achieving the effect of improving the user experience.
[0205] It should be noted that the flowcharts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, a program segment, or a part of a code, and the module, program segment, or a part of the code contains at least one executable instruction for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of boxes in the block diagram and / or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0206] In general, various example embodiments of the present disclosure may be implemented in hardware or dedicated circuits, software, firmware, logic, or any combination thereof. Certain aspects may be implemented in hardware, while other aspects may be implemented in firmware or software that may be executed by a controller, microprocessor, or other computing device. When various aspects of the embodiments of the present disclosure are illustrated or described as block diagrams, flow charts, or using some other graphical representation, it will be understood that the blocks, devices, systems, techniques, or methods described herein may be implemented in hardware, software, firmware, dedicated circuits or logic, general purpose hardware or controllers or other computing devices, or some combination thereof as non-limiting examples.
[0207] The exemplary embodiments of the present disclosure described in detail above are merely illustrative and not restrictive. It should be understood by those skilled in the art that various modifications and combinations may be made to these embodiments or their features without departing from the principles and spirit of the present disclosure, and such modifications should fall within the scope of the present disclosure.
Claims
1. A playback control method for a playback device, include: Acquire a playback request for controlling the playback device from an external device, wherein the playback request is a multimedia projection initiated by the external device to the playback device, the playback request is used to indicate content to be played, and the playback request further indicates a mode of initiating the playback request, and the mode of initiating the playback request includes private projection and public projection; Acquire the current playback mode of the playback device, wherein the playback device has multiple playback modes, and each playback mode has a corresponding playback content restriction; Based on determining that the current playback mode is a preset mode among the multiple playback modes, determining whether the to-be-played content satisfies a playback content restriction corresponding to the preset mode; and Determining whether to play the content to be played on the playback device according to whether the content to be played satisfies the playback content restriction corresponding to the preset mode; Wherein, when the play request indicates that the initiation mode of the play request is private projection, the determining whether the to-be-played content satisfies the play content restriction corresponding to the preset mode includes: determining the content attribute of the to-be-played content; and In a case where the play request indicates that the initiation mode of the play request is public projection, the determining whether the to-be-played content satisfies the play content restriction corresponding to the preset mode includes: analyzing the play content of the to-be-played content.
2. The playback control method according to claim 1, in, Determining whether to play the content to be played on the playback device according to whether the content to be played satisfies the playback content restriction corresponding to the preset mode includes: In a case where the to-be-played content satisfies the playback content restriction corresponding to the preset mode, it is determined to play the to-be-played content on the playback device.
3. The playback control method according to claim 1, in, The plurality of playback modes include a standard mode and also include at least one restriction mode, wherein each restriction mode has its corresponding playback content restriction, and the preset mode is one of the at least one restriction mode; Wherein, the method further comprises: When it is determined that the current playback mode of the playback device is the standard mode, in response to the playback request to the playback device, it is determined to play the to-be-played content on the playback device.
4. The playback control method according to claim 3, in, The at least one restriction mode is at least one age mode, wherein each age mode corresponds to a specific age group.
5. The playback control method according to claim 1, in, The play request includes identification information of the content to be played, and the identification information of the content to be played indicates that the play request is initiated in a private projection manner; Wherein, determining the content attribute of the content to be played includes: Based on the identification information of the content to be played, acquiring attribute indication information related to the content to be played, the attribute indication information being used to indicate whether the content to be played satisfies the playback content restriction corresponding to the preset mode; and Based on the acquired attribute indication information, it is determined whether the to-be-played content satisfies the playback content restriction corresponding to the preset mode.
6. The playback control method according to claim 5, in, The private projection includes the external device and the playback device communicating with each other through the same local area network using a private protocol.
7. The playback control method according to claim 1, in, The play request includes play address information of the content to be played, and the play address information of the content to be played indicates that the play request is initiated in a public projection manner; The analysis of the content to be played includes: At least image recognition or audio recognition is performed on the content to be played to determine whether the content to be played meets the playback content restriction corresponding to the preset mode.
8. The playback control method according to claim 7, in, The analysis of the content to be played also includes: Based on the playback address information of the content to be played, obtaining a video segment list and / or an audio segment list of the content to be played, wherein the video segment list of the content to be played includes multiple video segments of the content to be played, and the audio segment list of the content to be played includes multiple audio segments of the content to be played; Based on at least a portion of the multiple video fragments in the video fragment list and / or at least a portion of the multiple audio fragments in the audio fragment list, it is determined whether the content to be played meets the playback content restriction corresponding to the preset mode.
9. The playback control method according to claim 8, in, For each video segment in the at least one portion of video segments and / or each audio segment in the at least one portion of audio segments, determining a correlation between the video segment and / or the audio segment and the preset mode; In a case where the correlation satisfies a first predetermined condition, determining that the to-be-played content satisfies a playback content restriction corresponding to the preset mode; If the correlation does not satisfy the first predetermined condition, determining that the video segment and / or the audio segment does not satisfy the playback content restriction corresponding to the preset mode; When the video segment and / or the audio segment that does not satisfy the playback content restriction corresponding to the preset mode satisfies the second predetermined condition, it is determined that the to-be-played content does not satisfy the playback content restriction corresponding to the preset mode.
10. The playback control method according to claim 9, in, The video slice includes a plurality of video frames, and the audio slice includes a plurality of audio frames; Wherein, determining the correlation between the video segment and the preset mode comprises performing image recognition on at least a portion of the plurality of video frames; Determining the correlation between the audio segment and the preset mode includes performing sound recognition on at least a portion of the plurality of audio frames; Wherein, the first predetermined condition is that the correlation is greater than a first predetermined threshold; and The second predetermined condition is that the number of video segments and / or audio segments that do not meet the playback content restriction corresponding to the preset mode is greater than a second predetermined threshold.
11. A playback control method for controlling a playback device, include: Obtaining a current playback mode of the playback device, wherein the playback device has multiple playback modes, and each playback mode has a corresponding playback content restriction; Acquire a playback request for controlling the playback device, wherein the playback request is a multimedia projection initiated by an external device to the playback device, the playback request is used to indicate content to be played, and the playback request further indicates a mode of initiating the playback request, and the mode of initiating the playback request includes private projection and public projection; Based on determining that the current playback mode is a preset mode among the multiple playback modes, determining whether the to-be-played content satisfies a playback content restriction corresponding to the preset mode; and Sending a play instruction to the playback device to control whether to play the content to be played on the playback device according to the determination of whether the content to be played satisfies the playback content restriction corresponding to the preset mode; Wherein, when the play request indicates that the initiation mode of the play request is private projection, the determining whether the to-be-played content satisfies the play content restriction corresponding to the preset mode includes: determining the content attribute of the to-be-played content; and In a case where the play request indicates that the initiation mode of the play request is public projection, the determining whether the to-be-played content satisfies the play content restriction corresponding to the preset mode includes: analyzing the play content of the to-be-played content.
12. The playback control method according to claim 11, in, According to the determination of whether the to-be-played content satisfies the playback content restriction corresponding to the preset mode, sending a playback instruction to the playback device to control whether to play the to-be-played content on the playback device includes: In a case where the content to be played meets the content restriction corresponding to the preset mode, a play instruction is sent to the play device to control the play device to play the content to be played.
13. The playback control method according to claim 11, in, The plurality of playback modes include a standard mode and also include at least one restriction mode, wherein each restriction mode has its corresponding playback content restriction, and the preset mode is one of the at least one restriction mode; Wherein, the method further comprises: When it is determined that the current playback mode of the playback device is the standard mode, in response to the playback request to the playback device, a playback instruction is sent to the playback device to control the playback device to play the content to be played.
14. A playback control device for a playback device, the device include: a request acquisition module, configured to acquire a playback request for controlling the playback device from an external device, wherein the playback request is a multimedia projection initiated by the external device to the playback device, the playback request is used to indicate content to be played, and the playback request also indicates a mode of initiating the playback request, and the mode of initiating the playback request includes private projection and public projection; a mode acquisition module, configured to acquire a current playback mode of the playback device, wherein the playback device has multiple playback modes, and each playback mode has a corresponding playback content restriction; a playback analysis module configured to determine whether the to-be-played content satisfies a playback content restriction corresponding to the preset mode based on determining that the current playback mode is a preset mode among the multiple playback modes; and a play determination module, configured to determine whether to play the content to be played on the playback device according to whether the content to be played satisfies the playback content restriction corresponding to the preset mode; Wherein, when the play request indicates that the initiation mode of the play request is private projection, the determining whether the to-be-played content satisfies the play content restriction corresponding to the preset mode includes: determining the content attribute of the to-be-played content; and In a case where the play request indicates that the initiation mode of the play request is public projection, the determining whether the to-be-played content satisfies the play content restriction corresponding to the preset mode includes: analyzing the play content of the to-be-played content.
15. A playback control device, include: one or more processors; as well as One or more memories, wherein a computer executable program is stored, and when the computer executable program is executed by the processor, the method of any one of claims 1-13 is performed.
16. A computer program product, comprising computer software code, which is used to implement the method according to any one of claims 1 to 13 when executed by a processor.
17. A computer-readable storage medium having computer-executable instructions stored thereon, wherein the instructions are used to implement the method according to any one of claims 1 to 13 when executed by a processor.
Citation Information
Patent Citations
Video playing method and device and storage medium
CN111209440A