Multimedia playback method, device, storage medium and electronic device

Abstract

The present application discloses a multimedia playback method, device, storage medium and electronic device, which relates to the field of Internet technology. The method includes: collecting object feature information of a target object viewing multimedia content, and generating an object identifier based on the object feature data; detecting the object behavior of the target object during the playback of the multimedia content; determining the target playback time of the multimedia content when the object behavior meets the target condition; and recording the target playback time and the object identifier jointly into a target record, so as to play back the multimedia content for the target object according to the target record. The present application can effectively improve the playback effect of multimedia content.

Description

Technical Field

[0001] The present application relates to the field of Internet technology, and in particular to a multimedia playback method, device, storage medium and electronic device. Background Art

[0002] With the development of technology, the requirements for the playback experience of multimedia such as videos are getting higher and higher. Taking the playback of video programs on smart TVs as an example, when different objects operate the TV to play video programs, different playback records are often generated. Usually, the objects have the need to play back the video programs according to the playback records.

[0003] However, currently, multimedia playback records are often not effectively associated with the viewed object, and are even less able to be associated with a high playback experience, resulting in poor multimedia playback effects and poor user playback experience. Summary of the invention

[0004] The embodiment of the present application provides a solution that can effectively improve the multimedia playback effect.

[0005] The embodiments of the present application provide the following technical solutions:

[0006] According to one embodiment of the present application, a multimedia playback method includes: collecting object feature information of a target object viewing multimedia content, and generating an object identifier based on the object feature information; during the playback of the multimedia content, detecting the object behavior of the target object; when the object behavior meets the target condition, determining the target playback time of the multimedia content according to the object behavior; and jointly recording the target playback time and the object identifier into a target record to play back the multimedia content for the target object according to the target record.

[0007] In some embodiments of the present application, the object feature information includes object sound information; the collecting of the object feature information of the target object viewing the multimedia content and generating the object identification based on the object feature information includes: collecting the object sound information of the target object viewing the multimedia content; performing voiceprint collection processing based on the object sound information to obtain voiceprint data corresponding to the object sound information; performing recognition processing based on the voiceprint data to obtain a voiceprint recognition result, and generating the object identification based on the voiceprint recognition result.

[0008] In some embodiments of the present application, the object behavior includes whether the target object stops watching the multimedia content; during the playback of the multimedia content, detecting the object behavior of the target object includes: during the playback of the multimedia content, detecting whether the target object is watching the multimedia content; when the object behavior meets the target condition, determining the target playback time of the multimedia content according to the object behavior includes: when the target object stops watching the multimedia content for a predetermined period of time, determining the time point when the target object stops watching the multimedia content as the target playback time.

[0009] In some embodiments of the present application, the object behavior includes object emotion; during the playback of the multimedia content, detecting the object behavior of the target object includes: during the playback of the multimedia content, determining the object emotion of the target object by real-time face detection; when the object behavior meets the target condition, determining the target playback time of the multimedia content according to the object behavior includes: when the object emotion meets a specific emotional state, determining the playback time point of the multimedia content as the target playback time.

[0010] In some embodiments of the present application, the object behavior includes whether the target object stops watching the multimedia content and the object's emotion; during the playback of the multimedia content, detecting the object behavior of the target object includes: during the playback of the multimedia content, determining the object emotion of the target object through real-time face detection, and detecting whether the target object is watching the multimedia content; when the object behavior meets the target condition, determining the target playback time of the multimedia content according to the object behavior, includes: when the target object stops watching the multimedia content for a predetermined period of time, and the object's emotion when stopping watching the multimedia content meets a specific emotional state, determining the time point when the target object stops watching the multimedia content as the target playback time.

[0011] In some embodiments of the present application, the target playback time and the object identifier are jointly recorded in the target record, including: querying the target record corresponding to the object identifier and the media identifier of the multimedia content; when the target record is queried, updating the target playback time to the target record; when the target record is not queried, generating the target record according to the target playback time, the object identifier and the media identifier.

[0012] In some embodiments of the present application, the playing back of the multimedia content for the target object according to the target record includes: performing information extraction processing on the object feature information collected in the target playback scenario to obtain object feature data; determining an object identifier based on the object feature data, and querying the target record according to the determined object identifier; and playing back the multimedia content according to the target playback time in the target record.

[0013] According to one embodiment of the present application, a multimedia playback device includes: a collection module, which is used to collect object feature information of a target object watching multimedia content, and generate an object identification based on the object feature information; a detection module, which is used to detect the object behavior of the target object during the playback of the multimedia content; a determination module, which is used to determine the target playback time of the multimedia content according to the object behavior when the object behavior meets the target condition; and a recording module, which is used to jointly record the target playback time and the object identification into a target record, so as to play back the multimedia content for the target object according to the target record.

[0014] According to another embodiment of the present application, a storage medium stores a computer program thereon, and when the computer program is executed by a processor of a computer, the computer executes the method described in the embodiment of the present application.

[0015] According to another embodiment of the present application, an electronic device may include: a memory storing a computer program; and a processor reading the computer program stored in the memory to execute the method described in the embodiment of the present application.

[0016] In an embodiment of the present application, object feature information of a target object viewing multimedia content is collected, and an object identifier is generated based on the object feature information; during playback of the multimedia content, the object behavior of the target object is detected; when the object behavior meets a target condition, a target playback time of the multimedia content is determined based on the object behavior; the target playback time and the object identifier are jointly recorded in a target record, so as to play back the multimedia content for the target object based on the target record.

[0017] In this way, the target record is effectively associated with the target object through the object identifier, and the target playback time is determined according to the object behavior when the object behavior recorded in the target record meets the target conditions, so that the target record and the target object can be associated with a high playback experience, and multimedia content can be played back with a high playback experience for the target object according to the target record, thereby effectively improving the multimedia playback effect and enhancing the user playback experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0019] Figure 1 A schematic diagram of a system to which the embodiments of the present application can be applied is shown.

[0020] Figure 2 A flowchart of a multimedia playback method according to an embodiment of the present application is shown.

[0021] Figure 3 A block diagram of a multimedia playback device according to an embodiment of the present application is shown.

[0022] Figure 4 A block diagram of an electronic device according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0023] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.

[0024] In the following description, the specific embodiments of the present application will be described with reference to steps and symbols performed by one or more computers, unless otherwise stated. Therefore, these steps and operations will be mentioned several times as being performed by a computer, and the computer execution referred to herein includes the operation of a computer processing unit by electronic signals representing data in a structured form. This operation converts the data or maintains it at a location in the memory system of the computer, which can be reconfigured or otherwise change the operation of the computer in a manner familiar to those skilled in the art. The data structure maintained by the data is a physical location in the memory, which has specific characteristics defined by the data format. However, the principles of the present application are described in the above text, which does not represent a limitation, and those skilled in the art will understand that the various steps and operations described below can also be implemented in hardware.

[0025] Figure 1 FIG. 1 is a schematic diagram showing a system 100 to which an embodiment of the present application can be applied. Figure 1As shown, the system 100 may include a cloud server 101 and / or a local terminal 102. The local terminal 102 may be any computer device, such as a computer, a mobile phone, a smart watch, and a home appliance (such as a smart TV), etc. The cloud server 101 may be a server that provides cloud services.

[0026] In one implementation of this example, the local terminal 102 can: collect object feature information of a target object viewing multimedia content, and generate an object identifier based on the object feature information; detect the object behavior of the target object during playback of the multimedia content; when the object behavior meets the target condition, determine the target playback time of the multimedia content; and record the target playback time and the object identifier jointly into a target record to play back the multimedia content for the target object according to the target record.

[0027] Furthermore, in some embodiments, the local terminal 102 can upload the target record to the cloud server 101 for storage, and the object identifier can be determined based on the target record on the local terminal 102 or other terminals according to the object feature information of the target object collected, and the target playback time of the multimedia content can be searched from the target record according to the object identifier for playback.

[0028] Figure 2 The flowchart of the multimedia playback method according to an embodiment of the present application is schematically shown. The execution subject of the multimedia playback method can be any device, such as Figure 1 A local terminal 102 is shown.

[0029] like Figure 2 As shown, the multimedia playing method may include steps S210 to S240.

[0030] Step S210, collecting object feature information of a target object that is viewing multimedia content, and generating an object identifier based on the object feature information; Step S220, detecting the object behavior of the target object during playback of the multimedia content; Step S230, determining a target playback time of the multimedia content when the object behavior meets a target condition; Step S240, jointly recording the target playback time and the object identifier into a target record, so as to play back the multimedia content for the target object according to the target record.

[0031] Multimedia content such as TV programs or article content, etc. Object feature information such as sound information or facial image information. Through a collection unit such as a camera or a recording device, when the target object watches the multimedia content (such as when the playback is started or after a specific period of time after the playback, etc.), the object feature information of the target object can be actively collected (i.e., automatically collected in the default mode) or passively collected (i.e., collected after the object triggers the collection process itself) through an agreed legal protocol.

[0032] The object identifier is an identifier that can uniquely identify the target object, and the object feature information is information that can uniquely characterize the target object. Furthermore, a unique object identifier of the target object can be generated based on the object feature information.

[0033] During the playback of multimedia content watched by the target object, the target object's behavior, such as whether the target object is away from watching the multimedia content and the object's emotions, can be detected through voice recognition or face recognition in an agreed legal protocol mode.

[0034] When it is detected that the object behavior meets the target condition, the target playback time of the multimedia content is determined according to the object behavior, and thus the target playback time is highly correlated with the object behavior.

[0035] Finally, the target playback time and the object identifier are recorded in the target record, so that when the target object needs to play back the multimedia content, the multimedia content can be played back for the target object according to the target record.

[0036] In this way, based on steps S210 to S240, the target record is effectively associated with the target object through the object identifier, and the target playback time is determined according to the object behavior when the object behavior recorded in the target record meets the target conditions, so that the target record and the target object can be associated with a high playback experience, and multimedia content can be played back with a high playback experience for the target object according to the target record, thereby effectively improving the multimedia playback effect and enhancing the user playback experience.

[0037] The following describes the specific process of each step during multimedia playback.

[0038] In step S210, object feature information of a target object viewing multimedia content is collected, and an object identifier is generated based on the object feature information.

[0039] Multimedia content such as TV programs or article content, etc. Object feature information such as sound information or facial image information. Through a collection unit such as a camera or a recording device, when the target object watches the multimedia content (such as when the playback is started or after a specific period of time after the playback, etc.), the object feature information of the target object can be actively collected (i.e., automatically collected in the default mode) or passively collected (i.e., collected after the object triggers the collection process itself) through an agreed legal protocol.

[0040] The object identifier is an identifier that can uniquely identify the target object, and the object feature information is information that can uniquely characterize the target object. Furthermore, a unique object identifier of the target object can be generated based on the object feature information.

[0041] In one embodiment, the object feature information includes object sound information; in step S210, the object feature information of the target object viewing the multimedia content is collected, and an object identifier is generated based on the object feature information, including: collecting the object sound information of the target object viewing the multimedia content; performing voiceprint collection processing based on the object sound information to obtain voiceprint data corresponding to the object sound information; performing recognition processing based on the voiceprint data to obtain a voiceprint recognition result, and generating the object identifier based on the voiceprint recognition result.

[0042] After the voiceprint data of the target object is collected, voiceprint recognition processing can be performed based on the voiceprint data to obtain a voiceprint recognition result, such as by performing similarity matching processing on the voiceprint data and the preset voiceprint data in the voiceprint library to obtain a voiceprint recognition result.

[0043] The voiceprint recognition result may include unique identification information such as the identity information of the target object, such as the unique identification information corresponding to the preset voiceprint data that matches the voiceprint data. At this time, when generating an object identification based on the voiceprint recognition result, the unique identification information can be used as the object identification.

[0044] The voiceprint recognition result may include unrecognized, such as preset voiceprint data that is not matched by the collected voiceprint data in the voiceprint library. At this time, when generating an object identifier based on the voiceprint recognition result, a unique identification information can be constructed, such as starting information registration processing to collect the identity information of the target object as the unique identification information or generating a unique identification information according to a specific strategy. The voiceprint data can be associated with the constructed unique identification information and saved in the voiceprint library, and the constructed unique identification information can be used as an object identifier.

[0045] In this way of collecting the object's sound information to obtain the object's identification, the target object can control the playback of multimedia content based on voice. Voiceprint data is collected through voice, and voiceprint recognition is performed using the voiceprint library to determine the object's identification and then match the target record for playback.

[0046] In one embodiment, the object feature information includes object facial information; in step S210, the object feature information of the target object viewing the multimedia content is collected, and an object identifier is generated based on the object feature information, including: collecting the object facial information of the target object viewing the multimedia content; performing facial feature collection processing based on the object facial information to obtain facial feature data corresponding to the object facial information; performing recognition processing based on the facial feature data to obtain a facial recognition result, and generating the object identifier based on the facial recognition result.

[0047] After the facial feature data of the target object is collected, facial recognition processing can be performed based on the facial feature data to obtain a facial recognition result, such as performing facial recognition by performing similarity matching processing on the facial feature data and preset facial feature data in a facial recognition library to obtain a facial recognition result.

[0048] The facial recognition result may include unique identification information such as the identity information of the target object, such as unique identification information corresponding to preset facial data that matches the facial data. At this time, when generating an object identification based on the facial recognition result, the unique identification information may be used as the object identification.

[0049] The facial recognition result may include unrecognized data, such as preset facial data that is not matched by the facial data collected in the facial recognition library. At this time, when generating an object identification based on the facial recognition result, unique identification information can be constructed, such as starting information registration processing to collect the identity information of the target object as unique identification information or generating a unique identification information according to a specific strategy. The facial data can be associated with the constructed unique identification information and saved in the facial recognition library, and the constructed unique identification information can be used as an object identification.

[0050] In this way of collecting the facial information of the object to obtain the object identification, when the target object controls the playback of multimedia content, the face recognition library can be used to perform face recognition to determine the object identification and then match the target record for playback.

[0051] In step S220, during the playback of the multimedia content, the object behavior of the target object is detected.

[0052] During the playback of multimedia content watched by the target object, the target object's behavior, such as whether the target object is away from watching the multimedia content and the object's emotions, can be detected through voice recognition or face recognition in an agreed legal protocol mode.

[0053] For example, the real-time emotion of the target object can be detected based on the real-time micro-expressions of the target object based on face recognition, or keywords can be extracted through voice recognition, and emotions can be determined based on keywords, etc. For example, whether the target object is out of the multimedia playback can be detected through real-time object face recognition.

[0054] In step S230, when the object behavior meets the target condition, the target playing time of the multimedia content is determined.

[0055] When it is detected that the object behavior meets the target condition, the target playback time of the multimedia content is determined according to the object behavior, and thus the target playback time is highly correlated with the object behavior.

[0056] In one embodiment, the object behavior includes whether the target object stops watching the multimedia content. Step S220, during the playback of the multimedia content, detects the target object behavior, including:

[0057] During the playback of the multimedia content, detecting whether the target object is watching the multimedia content; step S230, when the object behavior meets the target condition, determining the target playback time of the multimedia content according to the object behavior, including: when the target object stops watching the multimedia content for a predetermined time period, determining the time point when the target object stops watching the multimedia content as the target playback time.

[0058] In this way, when the target object stops watching the multimedia content for a predetermined period of time, the time point when the target object stops watching the multimedia content can be used as the target playback time. When the target playback time is recorded, playback can be performed at the target playback time according to playback requirements to achieve breakpoint resumption.

[0059] In one embodiment, the object behavior includes object emotion; step S220, during the playback of the multimedia content, detecting the object behavior of the target object, including: during the playback of the multimedia content, determining the object emotion of the target object by real-time face detection; step S230, when the object behavior meets the target condition, determining the target playback time of the multimedia content according to the object behavior, including: when the object emotion meets a specific emotional state, determining the playback time point of the multimedia content as the target playback time.

[0060] In this way, when the subject's emotion meets a specific emotional state (such as the happiness level is the first level or the sadness level is the first level, etc.), the playback time point of the multimedia content that meets the specific emotional state can be determined as the target playback time. When the target playback time is recorded, it can be played back at the target playback time according to the playback requirements, so that the recollection playback of the highlight emotional moments can be achieved.

[0061] In one embodiment, the object behavior includes whether the target object stops watching the multimedia content and the object's emotion; step S220, during the playback of the multimedia content, detecting the object behavior of the target object, including: during the playback of the multimedia content, determining the object emotion of the target object through real-time face detection, and detecting whether the target object is watching the multimedia content; step S230, when the object behavior meets the target condition, determining the target playback time of the multimedia content according to the object behavior, including: when the target object stops watching the multimedia content for a predetermined period of time, and the object emotion when stopping watching the multimedia content meets a specific emotional state, determining the time point when the target object stops watching the multimedia content as the target playback time.

[0062] In this way, when the target object stops watching the multimedia content for a predetermined period of time and the object's emotion when stopping watching meets a specific emotional state (such as the happiness level is the first level or the sadness level is the first level, etc.), the moment when the target object stops watching the multimedia content can be used as the target playback moment. When the target playback moment is recorded, it can be played back at the target playback moment according to playback requirements, so that breakpoint resumption of highlight emotional moments can be achieved.

[0063] In step S240, the target playback time and the object identifier are jointly recorded in a target record, so as to play back the multimedia content for the target object according to the target record.

[0064] The target playback time and the object identifier are recorded in the target record, so that when the target object needs to play back the multimedia content, the multimedia content can be played back for the target object according to the target record.

[0065] In one embodiment, in step S240, the target playback time and the object identifier are jointly recorded in the target record, including: querying the target record corresponding to the object identifier and the media identifier of the multimedia content; when the target record is queried, updating the target playback time to the target record; when the target record is not queried, generating the target record according to the target playback time, the object identifier and the media identifier. In this way, the target record can be updated accurately and in real time.

[0066] In one embodiment, in step S240, the multimedia content is played back for the target object according to the target record, including: performing information extraction processing on the object feature information collected in the target playback scene to obtain object feature data; determining an object identifier based on the object feature data, and querying the target record according to the determined object identifier; and playing back the multimedia content according to the target playback time in the target record.

[0067] The target playback scenario is, for example, a scenario where a user triggers the playback of multimedia content or a scenario where a local terminal is restarted; object feature information is, for example, facial image information or sound information, and object feature data is, for example, facial feature data or voiceprint data. The object feature data can be identified using a preset voiceprint library or facial recognition library, that is, the object identifier is determined based on the object feature data. Furthermore, the corresponding target record can be accurately determined for the target object, and the multimedia content can be played back according to the target playback time in the target record.

[0068] In order to better implement the multimedia playback method provided in the embodiment of the present application, the embodiment of the present application also provides a multimedia playback device based on the multimedia playback method. The meanings of the terms are the same as those in the multimedia playback method, and the specific implementation details can refer to the description in the method embodiment. Figure 3 A block diagram of a multimedia playback device according to an embodiment of the present application is shown.

[0069] like Figure 3 As shown, the multimedia playback device 300 may include a collection module 310 , a detection module 320 , a determination module 330 and a recording module 340 .

[0070] The acquisition module 310 can be used to acquire object feature information of a target object viewing multimedia content, and generate an object identifier based on the object feature information; the detection module 320 can be used to detect the object behavior of the target object during the playback of the multimedia content; the determination module 330 can be used to determine the target playback time of the multimedia content according to the object behavior when the object behavior meets the target condition; the recording module 340 can be used to jointly record the target playback time and the object identifier into a target record, so as to play back the multimedia content for the target object according to the target record.

[0071] In some embodiments of the present application, the acquisition module 310 includes: a sound acquisition unit, which is used to collect object sound information of a target object watching multimedia content; a voiceprint extraction unit, which is used to perform voiceprint acquisition processing based on the object sound information to obtain voiceprint data corresponding to the object sound information; and a recognition processing unit, which is used to perform recognition processing based on the voiceprint data to obtain a voiceprint recognition result, and generate the object identifier based on the voiceprint recognition result.

[0072] In some embodiments of the present application, the object behavior includes whether the target object stops watching the multimedia content; the detection module 320 includes: a first detection unit, used to detect whether the target object is watching the multimedia content during the playback of the multimedia content; the determination module 330 includes: a first determination unit, used to determine the moment when the target object stops watching the multimedia content as the target playback moment when the target object stops watching the multimedia content for a predetermined period of time.

[0073] In some embodiments of the present application, the object behavior includes object emotions; the detection module 320 includes: a second detection unit, used to determine the object emotions of the target object through real-time face detection during the playback of the multimedia content; the determination module 330 includes: a second determination unit, used to determine the playback time point of the multimedia content as the target playback time point when the object emotion meets a specific emotional state.

[0074] In some embodiments of the present application, the object behavior includes whether the target object stops watching the multimedia content and the object's emotion; the detection module 320 includes: a third detection unit, which is used to determine the object emotion of the target object through real-time face detection during the playback of the multimedia content, and detect whether the target object is watching the multimedia content; the determination module 330 includes: a third determination unit, which is used to determine the moment when the target object stops watching the multimedia content as the target playback moment when the target object stops watching the multimedia content for a predetermined period of time and the object's emotion when stopping watching the multimedia content meets a specific emotional state.

[0075] In some embodiments of the present application, the recording module 340 includes: a query unit for querying the target record corresponding to the object identifier and the media identifier of the multimedia content; an update unit for updating the target playback time to the target record when the target record is queried; and a generation unit for generating the target record according to the target playback time, the object identifier and the media identifier when the target record is not queried.

[0076] In some embodiments of the present application, the recording module 340 includes: an information extraction processing unit, which is used to extract information from the object feature information collected in the target playback scenario to obtain object feature data; a query determination unit, which is used to determine the object identifier based on the object feature data, and query the target record based on the determined object identifier; and a playback unit, which is used to play back the multimedia content according to the target playback time in the target record.

[0077] In this way, based on the multimedia playback device 300, the target record is effectively associated with the target object through the object identifier, and the target playback time is determined according to the object behavior when the object behavior recorded in the target record meets the target conditions, so that the target record and the target object can be associated with a high playback experience, and the multimedia content can be played back with a high playback experience for the target object according to the target record, thereby effectively improving the multimedia playback effect and improving the user playback experience.

[0078] It should be noted that, although several modules or units of the equipment for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present application, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into being embodied by multiple modules or units.

[0079] In addition, an embodiment of the present application further provides an electronic device, which may be a terminal or a server. Figure 4 As shown, it shows a schematic diagram of the structure of the electronic device involved in the embodiment of the present application, specifically:

[0080] The electronic device may include components such as a processor 401 with one or more processing cores, a memory 402 with one or more computer-readable storage media, a power supply 403, and an input unit 404. Those skilled in the art will appreciate that Figure 4 The electronic device structure shown in the figure does not constitute a limitation on the electronic device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0081] The processor 401 is the control center of the electronic device. It uses various interfaces and lines to connect various parts of the entire computer device. By running or executing software programs and / or modules stored in the memory 402, and calling data stored in the memory 402, it executes various functions of the computer device and processes data, thereby monitoring the electronic device as a whole. Optionally, the processor 401 may include one or more processing cores; preferably, the processor 401 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user pages and application programs, etc., and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 401.

[0082] The memory 402 can be used to store software programs and modules. The processor 401 executes various functional applications and data processing by running the software programs and modules stored in the memory 402. The memory 402 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the computer device, etc. In addition, the memory 402 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory 402 may also include a memory controller to provide the processor 401 with access to the memory 402.

[0083] The electronic device also includes a power supply 403 for supplying power to each component. Preferably, the power supply 403 can be logically connected to the processor 401 through a power management system, so as to manage charging, discharging, power consumption and other functions through the power management system. The power supply 403 can also include one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, power status indicators and other arbitrary components.

[0084] The electronic device may further include an input unit 404, which may be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.

[0085] Although not shown, the electronic device may further include a display unit, etc., which will not be described in detail herein. Specifically in this embodiment, the processor 401 in the electronic device will load the executable files corresponding to the processes of one or more computer programs into the memory 402 according to the following instructions, and the processor 401 will run the computer programs stored in the memory 402 to implement various functions. For example, the processor 401 may perform the following steps:

[0086] Collect object feature information of a target object viewing multimedia content, and generate an object identifier based on the object feature information; detect the object behavior of the target object during playback of the multimedia content; when the object behavior meets the target condition, determine the target playback time of the multimedia content according to the object behavior; record the target playback time and the object identifier jointly in a target record, so as to play back the multimedia content for the target object according to the target record.

[0087] In some embodiments of the present application, the object feature information includes object sound information; when collecting the object feature information of the target object viewing the multimedia content and generating the object identification based on the object feature information, the processor 401 can execute: collecting the object sound information of the target object viewing the multimedia content; performing voiceprint collection processing based on the object sound information to obtain voiceprint data corresponding to the object sound information; performing recognition processing based on the voiceprint data to obtain a voiceprint recognition result, and generating the object identification based on the voiceprint recognition result.

[0088] In some embodiments of the present application, the object behavior includes whether the target object stops watching the multimedia content; during the playback of the multimedia content, when detecting the object behavior of the target object, the processor 401 may execute: during the playback of the multimedia content, detecting whether the target object is watching the multimedia content; when the object behavior meets the target condition, determining the target playback time of the multimedia content according to the object behavior, the processor 401 may execute: when the target object stops watching the multimedia content for a predetermined period of time, determining the time point when the target object stops watching the multimedia content as the target playback time.

[0089] In some embodiments of the present application, the object behavior includes object emotion; during the playback of the multimedia content, when the object behavior of the target object is detected, the processor 401 can execute: during the playback of the multimedia content, determining the object emotion of the target object by real-time face detection; when the object behavior meets the target condition, determining the target playback time of the multimedia content according to the object behavior, the processor 401 can execute: when the object emotion meets a specific emotional state, determining the playback time point of the multimedia content as the target playback time.

[0090] In some embodiments of the present application, the object behavior includes whether the target object stops watching the multimedia content and the object's emotion; during the playback of the multimedia content, when detecting the object behavior of the target object, the processor 401 may execute: during the playback of the multimedia content, determining the object emotion of the target object through real-time face detection, and detecting whether the target object is watching the multimedia content; when the object behavior meets the target condition, determining the target playback time of the multimedia content according to the object behavior, the processor 401 may execute: when the target object stops watching the multimedia content for a predetermined period of time, and the object's emotion when stopping watching the multimedia content meets a specific emotional state, determining the time point when the target object stops watching the multimedia content as the target playback time.

[0091] In some embodiments of the present application, when the target playback time and the object identifier are jointly recorded in a target record, the processor 401 may execute: querying the target record corresponding to the object identifier and the media identifier of the multimedia content; when the target record is queried, updating the target playback time to the target record; when the target record is not queried, generating the target record according to the target playback time, the object identifier and the media identifier.

[0092] In some embodiments of the present application, when the multimedia content is played back for the target object according to the target record, the processor 401 can execute: extracting information from the object feature information collected in the target playback scenario to obtain object feature data; determining an object identifier based on the object feature data, and querying the target record according to the determined object identifier; and playing back the multimedia content according to the target playback time in the target record.

[0093] Those skilled in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by a computer program, or by controlling related hardware through a computer program. The computer program may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0094] To this end, an embodiment of the present application further provides a storage medium, in which a computer program is stored. The computer program can be loaded by a processor to execute the steps in any method provided in the embodiment of the present application.

[0095] The storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0096] Since the computer program stored in the storage medium can execute the steps in any method provided in the embodiments of the present application, the beneficial effects that can be achieved by the method provided in the embodiments of the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0097] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the embodiments disclosed herein. The present application is intended to cover any variations, uses or adaptations of the present application, which follow the general principles of the present application and include common knowledge or customary technical means in the art that are not disclosed in the present application.

[0098] It should be understood that the present application is not limited to the embodiments that have been described above and shown in the accompanying drawings, but various modifications and changes may be made without departing from the scope thereof.

Claims

1. A multimedia playback method, characterized in that: include: Collecting object feature information of a target object viewing multimedia content, and generating an object identifier based on the object feature information; During the playback of the multimedia content, detecting the target object's behavior; the target object's behavior includes whether the target object is away from watching the multimedia content and the object's emotions; When the object behavior meets the target condition, determining the target playback time of the multimedia content according to the object behavior; recording the target playback time and the object identifier in a target record, so as to play back the multimedia content for the target object according to the target record; The detecting the object behavior of the target object during the playing of the multimedia content includes: During the playback of the multimedia content, determining the target object's emotion through real-time facial detection, and detecting whether the target object is watching the multimedia content; When the object behavior meets the target condition, determining the target playback time of the multimedia content according to the object behavior includes: When the target object stops watching the multimedia content for a predetermined time period and the object's emotion when stopping watching the multimedia content meets a specific emotional state, the time point when the target object stops watching the multimedia content is determined as the target playback time point.

2. The method according to claim 1, characterized in that The object characteristic information includes object sound information; The collecting of object feature information of a target object viewing multimedia content and generating an object identifier based on the object feature information includes: Collecting object sound information of a target object viewing multimedia content; Performing voiceprint collection and processing based on the object's voice information to obtain voiceprint data corresponding to the object's voice information; Recognition processing is performed based on the voiceprint data to obtain a voiceprint recognition result, and the object identifier is generated based on the voiceprint recognition result.

3. The method according to claim 1, characterized in that The detecting the object behavior of the target object during the playing of the multimedia content includes: During the playback of the multimedia content, detecting whether the target object is watching the multimedia content; When the object behavior meets the target condition, determining the target playback time of the multimedia content according to the object behavior includes: When the target object stops watching the multimedia content for a predetermined time period, a time point at which the target object stops watching the multimedia content is determined as the target playback time point.

4. The method according to claim 1, characterized in that: The detecting the object behavior of the target object during the playing of the multimedia content includes: During the playback of the multimedia content, determining the subject emotion of the target subject through real-time facial detection; When the object behavior meets the target condition, determining the target playback time of the multimedia content according to the object behavior includes: When the emotion of the object meets the specific emotional state, the playing time point of the multimedia content is determined as the target playing time point.

5. The method according to claim 1, characterized in that The step of jointly recording the target playback time and the object identifier into a target record includes: Querying the target record corresponding to the object identifier and the media identifier of the multimedia content; When the target record is found, the target playback time is updated to the target record; When the target record is not found, the target record is generated according to the target playback time, the object identifier and the media identifier.

6. The method according to claim 1, characterized in that The playing back the multimedia content for the target object according to the target record includes: Extracting and processing the object feature information collected in the target playback scene to obtain object feature data; Determine an object identifier based on the object feature data, and query the target record according to the determined object identifier; The multimedia content is played back according to the target playback time in the target record.

7. A multimedia playback device, characterized in that: include: A collection module, used to collect object feature information of a target object viewing multimedia content, and generate an object identifier based on the object feature information; A detection module, used to detect the object behavior of the target object during the playback of the multimedia content; the object behavior includes whether the target object stops watching the multimedia content and the object's emotions; The detecting the target object's behavior during the playback of the multimedia content includes: determining the target object's emotion by real-time facial detection during the playback of the multimedia content, and detecting whether the target object is watching the multimedia content; a determination module, configured to determine a target playback time of the multimedia content according to the object behavior when the object behavior meets the target condition; the determination of the target playback time of the multimedia content according to the object behavior when the object behavior meets the target condition includes: when the target object stops watching the multimedia content for a predetermined time, and the object's emotion when stopping watching the multimedia content meets a specific emotional state, determining the time point when the target object stops watching the multimedia content as the target playback time; The recording module is used to record the target playback time and the object identifier in a target record, so as to play back the multimedia content for the target object according to the target record.

8. A storage medium, characterized in that: A computer program is stored thereon, and when the computer program is executed by a processor of a computer, the computer is caused to execute the method according to any one of claims 1 to 6.

9. An electronic device, characterized in that: include: a memory storing a computer program; A processor reads a computer program stored in a memory to execute the method according to any one of claims 1 to 6.

Images