Multimedia playing method and device, medium and equipment

Abstract

The embodiment of the invention provides a multimedia playing method and device, a medium and equipment. The method comprises the following steps: receiving a first multimedia control instruction uploaded by a client of a player through a multimedia input service instance created based on a TIF; performing format conversion on the first multimedia control instruction to obtain a second multimedia control instruction which can be identified by the client; and sending the second multimedia control instruction to the client, so that the client executes the second multimedia control instruction. According to the invention, the player carrying the TIF has the capability of playing multimedia. And the client and the server of the player are separated, so that only data at one end can be updated when the application of the player is updated, and the server can be pulled out to be combined with different types of clients for use in a plug-in form.

Description

Technical Field

[0001] The present application relates to the field of communication technology, and in particular to the field of multimedia playback technology, and in particular to a multimedia playback method, device, medium and equipment. Background Art

[0002] Android TIF (Android TV input Framework) is a set of standard APIs (application programming interfaces) provided by Google to TV manufacturers. It is used to create a TV Input (TV input source) management module to control Android TV, so that system applications or third-party applications can obtain all input sources (such as signal sources or DTV, etc.) through TIF, and then output the video images corresponding to the input sources to the TV screen, thereby realizing cross-process communication.

[0003] Currently, TIF provides an architecture for playing signal sources or DTV for Android TV, but lacks the ability to support the playback of input sources such as multimedia. In addition, most system applications or third-party applications equipped with TIF integrate the client responsible for user interaction logic with the server responsible for data processing logic. This means that once the application needs to be updated, the entire application usually needs to be fully updated, resulting in a large amount of update package data. This not only increases the workload of application developers, but also affects users' enthusiasm for updating applications. Summary of the invention

[0004] The embodiments of the present application provide a multimedia playback method, device, medium and equipment. The multimedia playback method provided in the embodiments of the present application enables the functions of playing multimedia based on TIF and other input sources under the Android system to be realized, and by separating the client and server of the application, the work pressure of the developer when updating the application is simplified and the user experience when updating the application is improved.

[0005] On the one hand, an embodiment of the present application provides a multimedia playback method, which is applied to a server of a player, including:

[0006] Receive a first multimedia control instruction uploaded by the client of the player through a multimedia input service instance created based on TIF;

[0007] Converting the first multimedia control instruction into a format to obtain a second multimedia control instruction recognizable by the client;

[0008] The second multimedia control instruction is sent to the client, so that the client executes the second multimedia control instruction.

[0009] In the multimedia playback method described in the embodiment of the present application, before the multimedia input service instance created based on TIF receives the first multimedia control instruction uploaded by the client of the player, it also includes:

[0010] Creating the multimedia input service instance based on TIF;

[0011] The multimedia input service is registered in the input service list of the player, so that the server receives and processes multimedia control instructions based on the multimedia input service instance.

[0012] In the multimedia playback method described in the embodiment of the present application, the multimedia control instruction includes any one of a continue playback instruction, a pause playback instruction, a fast forward instruction, a fast rewind instruction, a double speed playback instruction and a loop playback instruction.

[0013] Another aspect of the present application embodiment provides a multimedia playback method, which is applied to a client of a player, and the method includes:

[0014] Receive input multimedia control events;

[0015] Identify a first multimedia control instruction in the multimedia control event, and send the first multimedia control instruction to a server of the player, so that the server converts the format of the first multimedia control instruction through a multimedia input service instance to obtain a second multimedia control instruction that can be recognized by the client; wherein the multimedia input service instance is created based on TIF and registered in an input service list of the corresponding player;

[0016] Receive and execute the second multimedia control instruction sent by the server.

[0017] In the multimedia playback method described in the embodiment of the present application, before receiving the input multimedia control event, the method further includes:

[0018] When an input multimedia play event is detected, a session is established with the server, and after the session is established with the server, a start play instruction is executed according to the target multimedia resource sent by the server.

[0019] In the multimedia playback method described in the embodiment of the present application, establishing a session with the server, and after establishing the session with the server, executing a start playback instruction according to a target multimedia resource sent by the server, includes:

[0020] A session creation request is initiated to the server of the player to establish a session with the server, and the storage path of the target multimedia resource, the preset identifier corresponding to the multimedia input source, and the start playback instruction are sent to the server through the session creation request, so that the server calls the multimedia input service instance corresponding to the preset identifier to receive the storage path and the start playback instruction, and obtains the target multimedia resource corresponding to the storage path and sends it to the client to execute the start playback instruction.

[0021] In the multimedia playback method described in the embodiment of the present application, after establishing a session with the server, the method further includes:

[0022] Detecting the operating status of the server, wherein the operating status includes normal and abnormal;

[0023] If the running state of the server is abnormal, re-establishing a session with the server.

[0024] In the multimedia playback method described in the embodiment of the present application, if the running state of the server is abnormal, re-establishing a session with the server includes:

[0025] Positioning the time node corresponding to when the running status of the server is detected to be abnormal;

[0026] Obtain historical multimedia playback parameters recorded before the time node, re-establish a session with the server according to the historical multimedia playback parameters, and after re-establishing the session with the server, receive historical multimedia resources corresponding to the historical multimedia playback parameters sent by the server, and restore the current playback screen to the historical playback screen before the time node according to the historical multimedia resources.

[0027] Correspondingly, another aspect of the embodiment of the present application further provides a multimedia playback device, which is applied to a server of a player, and the multimedia playback device includes:

[0028] An instruction receiving module, used for receiving a first multimedia control instruction uploaded by a client of the player through a multimedia input service instance created based on TIF;

[0029] a format conversion module, configured to receive, through the multimedia input service instance, a first multimedia control instruction uploaded by a client of the player, and perform format conversion on the first multimedia control instruction to obtain a second multimedia control instruction recognizable by the client;

[0030] The instruction control module is used to send the second multimedia control instruction to the client so that the client executes the second multimedia control instruction.

[0031] Correspondingly, another aspect of the embodiment of the present application further provides a storage medium, wherein the storage medium stores a plurality of instructions, and the instructions are suitable for loading by a processor to execute the multimedia playback method as described above.

[0032] Correspondingly, another aspect of the embodiment of the present application further provides an electronic device, including a processor and a memory, wherein the memory stores a plurality of instructions, and the processor loads the instructions to execute the multimedia playback method as described above.

[0033] The embodiment of the present application provides a multimedia playback method, device, medium and equipment, which receives the first multimedia control instruction uploaded by the client of the player through a multimedia input service instance created based on TIF; converts the format of the first multimedia control instruction to obtain a second multimedia control instruction that can be recognized by the client; sends the second multimedia control instruction to the client so that the client executes the second multimedia control instruction. Using the multimedia playback method provided by the embodiment of the present application, a multimedia input service instance for receiving and processing multimedia control instructions is created and registered in the input service list of the corresponding player by creating an interface based on the service instance provided by TIF, so that the player equipped with TIF has the ability to play multimedia. And by separating the client and the server of the player, not only can the data of only one end be updated when the player updates the application, but also the server can do not need to care about the upper logic of the client based on the standardized API provided by TIF, that is, no matter which format the control instruction uploaded by the client is transmitted, it can identify and control the client to execute the corresponding control instruction, so the server can be extracted and used in combination with different types of clients in the form of a plug-in. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application, and those skilled in the art can obtain other drawings based on these drawings without creative work.

[0035] Figure 1 A flowchart of a multimedia playback method provided in an embodiment of the present application.

[0036] Figure 2 Another flowchart of the multimedia playback method provided in an embodiment of the present application is provided.

[0037] Figure 3 Another flowchart of the multimedia playback method provided in an embodiment of the present application is provided.

[0038] Figure 4 A schematic diagram of the structure of a multimedia playback device provided in an embodiment of the present application.

[0039] Figure 5 Another structural schematic diagram of the multimedia playback device provided in an embodiment of the present application.

[0040] Figure 6 Another structural schematic diagram of the multimedia playback device provided in an embodiment of the present application.

[0041] Figure 7 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0042] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present application.

[0043] The embodiment of the present application provides a multimedia playback method, which uses the method to create an interface based on the service instance provided by TIF, create a multimedia input service instance for receiving and processing multimedia control instructions and register it in the input service list of the corresponding player, so that the player equipped with TIF has the ability to play multimedia. And by separating the client and the server of the player, not only can the data of only one end be updated when the player updates the application, but the server, based on the standardized API provided by TIF, does not need to care about the upper-level logic of the client, that is, no matter what format the control instructions uploaded by the client are transmitted, it can identify and control the client to execute the corresponding control instructions, so the server can be extracted and used in combination with different types of clients in the form of a plug-in.

[0044] The term "and / or" in this application can be a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this application generally indicates that the associated objects before and after are in an "or" relationship.

[0045] The terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable in appropriate circumstances, so that the embodiments described here can be implemented in a sequence other than the content illustrated or described here. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, the process, method, system, product or television set comprising a series of steps or modules need not be limited to the steps or modules clearly listed, but may include other steps or modules that are not clearly listed or inherent to these processes, methods, products or television sets. The naming or numbering of the steps in the present application does not mean that the steps in the method flow must be performed in the time / logic sequence indicated by the naming or numbering, and the process steps that have been named or numbered can change the execution order according to the technical purpose to be achieved, as long as the same or similar technical effects can be achieved. The division of modules in this application is a logical division. There may be other division methods when it is implemented in actual applications. For example, multiple modules can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, and the indirect coupling or communication connection between modules can be electrical or other similar forms, which are not limited in this application. In addition, the modules or submodules described as separate components may or may not be physically separated, may or may not be physical modules, or may be distributed in multiple circuit modules, and some or all of the modules may be selected according to actual needs to achieve the purpose of the present application.

[0046] The multimedia playback method involved in the embodiments of the present application is mainly applied to electronic devices, which may be televisions, smart phones, tablet computers, laptops, desktop computers, servers, etc., which are not limited here. Optionally, the server may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or an IoT cloud (Internet of Things cloud) that provides the ability to store, process and manage data generated by an IoT television, or a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), and basic cloud computing services such as big data and artificial intelligence platforms, which are not limited here.

[0047] For ease of understanding, the specific process in the embodiments of the present application is described below. Figure 1 , Figure 1A flowchart of an embodiment of a multimedia playback method provided in an embodiment of the present application.

[0048] It should be noted that the players applicable to this solution include the client and the server, and the client and the server collaborate to complete the multimedia playback. Among them, the client is mainly responsible for the interaction with the user, and the server is mainly responsible for the processing of multimedia data.

[0049] exist Figure 1 In the illustrated embodiment, the method can be applied to the server of the player, and specifically comprises the following steps:

[0050] S101, receiving a first multimedia control instruction uploaded by a client of the player through a multimedia input service instance created based on TIF.

[0051] It needs to be explained that Android TIF (Android TV input Framework) is a set of standard APIs (application programming interfaces) provided by Google to TV manufacturers. It is used to create TV Input (TV input source) management modules to control Android TV. TV Input can be regarded as an application that represents a physical or virtual TV receiver or input port, so that system applications or third-party applications can obtain all input sources through TIF, such as signal sources, ATV (analog TV), DTV (digital TV) and IPTV (Internet TV), etc., and then output the video images corresponding to the input source to the TV screen, thereby realizing cross-process communication.

[0052] For example, as a system application, Live TV App obtains a session by calling TV Input Manager (an intermediate interface layer that allows TV Input and Live TV App to communicate), which contains the status of a signal source. TV Input writes the obtained Channel (physical interface and electronic transmission path connecting internal components of a computer or external devices) and Programs (a database containing channels, programs and related permissions) information into the / data / data / com.android.providers.tv / datab ases / tv.db database. Live TV App calls TV Input Service Instances through session in aidl (a language used to define interfaces for interaction between different components on Android devices, allowing a set of methods exposed by a component to other components) to obtain relevant channels and specific program information for playback.

[0053] At present, TIF mainly provides a playback source or DTV architecture for Android TV, but lacks the ability to support the playback of input sources such as multimedia. The multimedia playback method provided by this application is proposed to make up for the above defects.

[0054] In this embodiment, a multimedia input service instance created based on TIF is used to receive a first multimedia control instruction uploaded by a player client. Exemplarily, the multimedia control instruction may include any one of a continue play instruction, a pause play instruction, a fast forward instruction, a fast rewind instruction, a double speed play instruction, and a loop play instruction, which are not limited here.

[0055] It should be noted that, in order to enable the player to have the ability to receive and process multimedia control instructions, before receiving the first multimedia control instruction uploaded by the client of the player through the multimedia input service instance created based on TIF, the method further includes the following steps:

[0056] Creating the multimedia input service instance based on TIF;

[0057] The multimedia input service is registered in the input service list of the player, so that the server receives and processes multimedia control instructions based on the multimedia input service instance.

[0058] In this embodiment, the service instance creation interface provided by TIF is utilized to create a multimedia input service instance for receiving and processing multimedia control instructions, and the created multimedia input service instance is registered in the input service list of the corresponding player, so that the player equipped with TIF has the ability to play multimedia.

[0059] S102: Receive a first multimedia control instruction uploaded by a client of the player through the multimedia input service instance, and convert the format of the first multimedia control instruction to obtain a second multimedia control instruction recognizable by the client.

[0060] In this embodiment, by utilizing the characteristic of the multimedia input service instance that it can receive and process multimedia control instructions, it is possible to convert the format of the first multimedia control instructions uploaded by the player's client to obtain a second multimedia control instruction that the client can recognize and execute.

[0061] For example, assuming that the first multimedia control instruction uploaded by the client is "play", the server needs to convert the format of the first multimedia control instruction through the multimedia input service instance, and convert the "play" field in the first multimedia control instruction into a second multimedia control instruction "play multimedia file" that the client can recognize and execute.

[0062] S103: Send the second multimedia control instruction to the client, so that the client executes the second multimedia control instruction.

[0063] In this embodiment, after the format conversion obtains the second control instruction, the second control instruction can be sent to the client so that the client can correctly execute the second multimedia control instruction, such as any one of the continue playback instruction, pause playback instruction, fast forward instruction, fast rewind instruction, double speed playback instruction and loop playback instruction.

[0064] In summary, the embodiment of the present application creates a multimedia input service instance and registers it in the input service list of the corresponding player, and pre-arranges that the multimedia input service instance has the ability to receive and process multimedia control instructions, thereby enabling the player equipped with TIF to have the ability to play multimedia. Based on the original ability of TIF to play other input sources, only one player is needed to support the purpose of playing videos from multiple mainstream input sources, and there is no need to install multiple players to take into account different types of input sources. And by separating the client and the server of the player, not only can the data of only one end be updated when the player updates the application, but the server, based on the standardized API provided by TIF, does not need to care about the upper-level logic of the client, that is, no matter which format the control instructions uploaded by the client are transmitted, it can identify and control the client to execute the corresponding control instructions, so the server can be extracted and used in combination with different types of clients in the form of a plug-in, and at the same time, the file size of the application installation package can be greatly reduced, and there is no need to develop different servers for different clients separately, and only one server needs to be developed to adapt to different types of clients.

[0065] In some embodiments, Figure 2 In the illustrated embodiment, the method can also be applied to a client of a player, and includes the following steps:

[0066] S201, receiving an input multimedia control event.

[0067] In this embodiment, a multimedia control event refers to a control event in which a user controls a client through an external device such as a remote controller. For example, if a user presses a “pause” button on a remote controller, this action can be regarded as a multimedia control event.

[0068] It is understandable that a multimedia control event may also refer to a control event in which a user manipulates a client through a virtual control provided by the client. For example, a user clicks a "pause" virtual control provided by the client, and this action may also be regarded as a multimedia control event.

[0069] S202, identifying the first multimedia control instruction in the multimedia control event, and sending the first multimedia control instruction to the server of the player, so that the server converts the format of the first multimedia control instruction through a multimedia input service instance to obtain a second multimedia control instruction that can be recognized by the client; wherein the multimedia input service instance is created based on TIF and registered in the input service list of the corresponding player.

[0070] In this embodiment, after the client receives the input multimedia control event, for example, the user clicks the "pause" virtual control provided by the client, the client will first output a first multimedia control instruction according to the multimedia control event, such as a string containing the field "pause". The first multimedia control instruction will then be sent to the server of the player, so that the server converts the format of the first multimedia control instruction through the multimedia input service instance to obtain a second multimedia control instruction that can be recognized by the server. The specific process can be referred to S102, which will not be repeated here.

[0071] S203: Receive and execute the second multimedia control instruction sent by the server.

[0072] In this embodiment, after the client receives the second control instruction sent by the server, it can execute the second multimedia control instruction, such as any one of the continue playback instruction, pause playback instruction, fast forward instruction, fast rewind instruction, double speed playback instruction and loop playback instruction.

[0073] In some embodiments, Figure 3 As shown, before S201, the method further includes:

[0074] S301: When an input multimedia playback event is detected, a session is established with the server, and after the session is established with the server, a start playback instruction is executed according to a target multimedia resource sent by the server.

[0075] In this embodiment, before the client communicates with the server, it needs to establish a session with the server. Based on the established session, the client and the server can perform the transmission action of the multimedia control instruction.

[0076] In this embodiment, the trigger condition for establishing a session between the client and the server may be the client detecting an input multimedia playback event. When the client detects the multimedia playback event, it indicates that the current user specifies the multimedia and controls the client to play the multimedia.

[0077] In some embodiments, the step of establishing a session with the server and, after establishing the session with the server, executing a start playback instruction according to a target multimedia resource sent by the server specifically includes:

[0078] A session creation request is initiated to the server of the player to establish a session with the server, and the storage path of the target multimedia resource, the preset identifier corresponding to the multimedia input source, and the start playback instruction are sent to the server through the session creation request, so that the server calls the multimedia input service instance corresponding to the preset identifier to receive the storage path and the start playback instruction, and obtains the target multimedia resource corresponding to the storage path and sends it to the client to execute the start playback instruction.

[0079] In this embodiment, during the process of creating a session between the client and the server, the client will send the storage path of the target multimedia resource, the preset identifier corresponding to the multimedia input source, and the start playback instruction to the server through a session creation request. Since a multimedia input service instance for receiving and processing multimedia control instructions is pre-registered in the input service list of the player, and each input service instance has a corresponding preset identifier (for example, "multimedia") in the input service list, and this preset identifier is synchronously stored on the client of the player, when the client recognizes that the currently input multimedia playback event is for the multimedia input source, it will automatically obtain the preset identifier corresponding to the multimedia input source, the storage path of the target multimedia resource, and the start playback instruction, and send them to the server through a session creation request, so that the server calls the multimedia input service instance corresponding to the preset identifier to receive the storage path and the start playback instruction, and obtains the target multimedia resource corresponding to the storage path and sends it to the client to execute the start playback instruction.

[0080] In some embodiments, Figure 3 As shown, after establishing a session with the server, the method further includes:

[0081] S302, detecting the operating status of the server, wherein the operating status includes normal and abnormal;

[0082] S303, determining whether the operation status of the server is abnormal;

[0083] S304: If the operating status is abnormal, re-establish a session with the server.

[0084] In this embodiment, by splitting the traditional client and server with "symbiotic" characteristics, the client can detect anomalies on the server and automatically re-establish a session with the server when an abnormality in multimedia playback is detected on the server, thereby avoiding the situation where once an abnormality occurs on the server, the client will also follow suit and cause the player's playback interface to remain on the abnormal interface or return to the main interface.

[0085] In some embodiments, if the running state of the server is abnormal, re-establishing a session with the server includes:

[0086] Positioning the time node corresponding to when the running status of the server is detected to be abnormal;

[0087] Obtain historical multimedia playback parameters recorded before the time node, re-establish a session with the server according to the historical multimedia playback parameters, and after re-establishing the session with the server, receive historical multimedia resources corresponding to the historical multimedia playback parameters sent by the server, and restore the current playback screen to the historical playback screen before the time node according to the historical multimedia resources.

[0088] In this embodiment, by obtaining the historical multimedia playback parameters recorded before the time node, for example, calling the tune (a method for requesting data) method of Tv View to obtain the historical multimedia playback parameters recorded before the multimedia playback exception occurs, a session is re-established with the server according to the historical multimedia playback parameters, and after the session is re-established with the server, historical multimedia resources corresponding to the corresponding historical multimedia playback parameters sent by the server are received, and the current playback screen is restored to the historical playback screen before the time node according to the historical multimedia resources.

[0089] All the above optional technical solutions can be arbitrarily combined to form optional embodiments of the present application, which will not be described one by one here.

[0090] In specific implementation, the present application is not limited by the execution order of the various steps described. If no conflict occurs, some steps can be performed in other orders or simultaneously.

[0091] As can be seen from the above, the multimedia playback method provided in the embodiment of the present application receives the first multimedia control instruction uploaded by the client of the player through the multimedia input service instance created based on TIF; converts the format of the first multimedia control instruction to obtain the second multimedia control instruction that the client can recognize; sends the second multimedia control instruction to the client so that the client executes the second multimedia control instruction. Using the multimedia playback method provided in the embodiment of the present application, by creating an interface based on the service instance provided by TIF, a multimedia input service instance for receiving and processing multimedia control instructions is created and registered in the input service list of the corresponding player, so that the player equipped with TIF has the ability to play multimedia. And by separating the client and the server of the player, not only can it be possible to update only the data on one end when the player updates the application, but also the server can do not need to care about the upper-level logic of the client based on the standardized API provided by TIF, that is, no matter which format the control instruction uploaded by the client is transmitted, it can identify and control the client to execute the corresponding control instruction, so the server can be extracted and used in combination with different types of clients in the form of a plug-in.

[0092] The embodiment of the present application further provides a multimedia playback device, which can be integrated into an electronic device.

[0093] See also Figure 4 , Figure 4 A schematic diagram of the structure of a multimedia playback device provided in an embodiment of the present application. The multimedia playback device 30 may include:

[0094] An instruction receiving module 31 is used to receive a first multimedia control instruction uploaded by a client of the player through a multimedia input service instance created based on TIF;

[0095] A format conversion module 32, configured to receive a first multimedia control instruction uploaded by a client of the player through the multimedia input service instance, and perform format conversion on the first multimedia control instruction to obtain a second multimedia control instruction recognizable by the client;

[0096] The instruction control module 33 is used to send the second multimedia control instruction to the client so that the client executes the second multimedia control instruction.

[0097] In some embodiments, the device also includes a registration module for creating the multimedia input service instance based on TIF; registering the multimedia input service to the input service list of the player so that the server receives and processes multimedia control instructions based on the multimedia input service instance.

[0098] In specific implementation, the above modules can be implemented as independent entities, or can be arbitrarily combined to be implemented as the same entity or several entities.

[0099] As can be seen from the above, the multimedia playback device 30 provided in the embodiment of the present application, wherein the instruction receiving module 31 is used to receive the first multimedia control instruction uploaded by the client of the player through the multimedia input service instance created based on TIF; the format conversion module 32 is used to receive the first multimedia control instruction uploaded by the client of the player through the multimedia input service instance, and format-convert the first multimedia control instruction to obtain a second multimedia control instruction that can be recognized by the client; the instruction control module 33 is used to send the second multimedia control instruction to the client, so that the client executes the second multimedia control instruction.

[0100] The embodiment of the present application further provides a multimedia playback device, which can be integrated into an electronic device.

[0101] See also Figure 5 , Figure 5 A schematic diagram of the structure of a multimedia playback device provided in an embodiment of the present application. The multimedia playback device 40 may include:

[0102] An event receiving module 41, used for receiving an input multimedia control event;

[0103] The instruction recognition module 42 is used to recognize the first multimedia control instruction in the multimedia control event, and send the first multimedia control instruction to the server of the player, so that the server converts the format of the first multimedia control instruction through the multimedia input service instance to obtain a second multimedia control instruction that can be recognized by the client; wherein the multimedia input service instance is created based on TIF and registered in the input service list of the corresponding player;

[0104] The instruction execution module 43 is used to receive and execute the second multimedia control instruction sent by the server.

[0105] In some embodiments, the device further comprises a detection module for establishing a session with the server when an input multimedia playback event is detected, and after establishing the session with the server, executing a start playback instruction according to the target multimedia resource sent by the server.

[0106] In some embodiments, the detection module is used to initiate a session creation request to the server of the player, establish a session with the server, and simultaneously send the storage path of the target multimedia resource, the preset identifier corresponding to the multimedia input source, and the start playback instruction to the server through the session creation request, so that the server calls the multimedia input service instance corresponding to the preset identifier to receive the storage path and the start playback instruction, and obtains the target multimedia resource corresponding to the storage path and sends it to the client to execute the start playback instruction.

[0107] In some embodiments, the device further includes a reconnection module for detecting the operating status of the server, wherein the operating status includes normal and abnormal; if the operating status of the server is abnormal, re-establishing a session with the server.

[0108] In some embodiments, the reconnection module is used to locate the time node corresponding to when the operating status of the server is detected to be abnormal; obtain the historical multimedia playback parameters recorded before the time node, re-establish a session with the server according to the historical multimedia playback parameters, and after re-establishing the session with the server, receive the historical multimedia resources corresponding to the historical multimedia playback parameters issued by the server, and restore the current playback screen to the historical playback screen before the time node according to the historical multimedia resources.

[0109] In specific implementation, the above modules can be implemented as independent entities, or can be arbitrarily combined to be implemented as the same entity or several entities.

[0110] As can be seen from the above, the multimedia playback device 40 provided in the embodiment of the present application, wherein the event receiving module 41 is used to receive an input multimedia control event; the instruction recognition module 42 is used to identify the first multimedia control instruction in the multimedia control event, and send the first multimedia control instruction to the server of the player, so that the server converts the format of the first multimedia control instruction through a multimedia input service instance to obtain a second multimedia control instruction that can be recognized by the client; wherein the multimedia input service instance is created based on TIF and registered in the input service list of the corresponding player; and the instruction execution module 43 is used to receive and execute the second multimedia control instruction sent by the server.

[0111] See also Figure 6 , Figure 6Another structural diagram of a multimedia playback device provided in an embodiment of the present application, the multimedia playback device 30 includes a memory 120, one or more processors 180, and one or more applications, wherein the one or more applications are stored in the memory 120 and configured to be executed by the processor 180; the processor 180 may include an instruction receiving module 31, a format conversion module 32, and an instruction control module 33. For example, the structure and connection relationship of the above components may be as follows:

[0112] The memory 120 can be used to store applications and data. The applications stored in the memory 120 include executable codes. The applications can be composed of various functional modules. The processor 180 executes various functional applications and data processing by running the applications stored in the memory 120. In addition, the memory 120 may include a high-speed random access memory and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory 120 may also include a memory controller to provide the processor 180 with access to the memory 120.

[0113] The processor 180 is the control center of the device, and uses various interfaces and lines to connect various parts of the entire terminal, and executes various functions of the device and processes data by running or executing applications stored in the memory 120, and calling data stored in the memory 120, so as to monitor the device as a whole. Optionally, the processor 180 may include one or more processing cores; preferably, the processor 180 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs.

[0114] Specifically in this embodiment, the processor 180 will load the executable code corresponding to the process of one or more application programs into the memory 120 according to the following instructions, and the processor 180 will run the application programs stored in the memory 120 to implement various functions:

[0115] An instruction receiving instruction, used to receive a first multimedia control instruction uploaded by the client of the player through a multimedia input service instance created based on TIF;

[0116] A format conversion instruction, used for receiving, through the multimedia input service instance, a first multimedia control instruction uploaded by the client of the player, and performing format conversion on the first multimedia control instruction to obtain a second multimedia control instruction recognizable by the client;

[0117] The instruction control instruction is used to send the second multimedia control instruction to the client so that the client executes the second multimedia control instruction.

[0118] In some embodiments, the program also includes a registration instruction for creating the multimedia input service instance based on TIF; registering the multimedia input service to the input service list of the player so that the server receives and processes multimedia control instructions based on the multimedia input service instance.

[0119] The present application also provides an electronic device. Figure 7 , Figure 7 The electronic device 1200 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application, and the electronic device can be used to implement the multimedia playback method provided in the above embodiment. The electronic device 1200 can be a television, a smart phone, or a tablet computer.

[0120] like Figure 7 As shown, the electronic device 1200 may include an RF (Radio Frequency) circuit 110, a memory 120 including one or more (only one is shown in the figure) computer-readable storage media, an input unit 130, a display unit 140, a sensor 150, an audio circuit 160, a transmission module 170, a processor 180 including one or more (only one is shown in the figure) processing cores, and a power supply 190. Those skilled in the art will understand that Figure 7 The structure of the electronic device 1200 shown in the figure does not constitute a limitation on the electronic device 1200, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0121] The RF circuit 110 is used to receive and send electromagnetic waves, realize the mutual conversion between electromagnetic waves and electrical signals, and thus communicate with a communication network or other televisions. The RF circuit 110 may include various existing circuit elements for performing these functions, such as an antenna, a radio frequency transceiver, a digital signal processor, an encryption / decryption chip, a user identity module (SIM) card, a memory, etc. The RF circuit 110 can communicate with various networks such as the Internet, an intranet, a wireless network, or communicate with other televisions via a wireless network.

[0122] The memory 120 can be used to store software programs and modules, such as the program instructions / modules corresponding to the multimedia playback method in the above-mentioned embodiment. The processor 180 executes various functional applications and data processing by running the software programs and modules stored in the memory 120. The vibration reminder mode can be automatically selected for multimedia playback according to the current scene of the electronic device, which can not only ensure that scenes such as meetings are not disturbed, but also ensure that users can perceive incoming calls, thereby improving the intelligence of the electronic device. The memory 120 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 120 may further include a memory remotely arranged relative to the processor 180, and these remote memories may be connected to the electronic device 1200 via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and a combination thereof.

[0123] The input unit 130 can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control. Specifically, the input unit 130 may include a touch-sensitive surface 131 and other input devices 132. The touch-sensitive surface 131, also known as a touch display screen or touch pad, can collect user touch operations on or near it (such as operations performed by users using fingers, styluses, or any other suitable objects or accessories on or near the touch-sensitive surface 131), and drive corresponding connection devices according to a pre-set program. Optionally, the touch-sensitive surface 131 may include a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch position, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into touch point coordinates, and then sends it to the processor 180, and can receive and execute commands sent by the processor 180. In addition, the touch-sensitive surface 131 may be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch-sensitive surface 131, the input unit 130 may further include other input devices 132. Specifically, the other input devices 132 may include, but are not limited to, one or more of a physical keyboard, a function key (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, and the like.

[0124] The display unit 140 can be used to display information input by the user or information provided to the user and various graphical user interfaces of the electronic device 1200, which can be composed of graphics, text, icons, videos and any combination thereof. The display unit 140 may include a display panel 141. Optionally, the display panel 141 may be configured in the form of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), etc. Further, the touch-sensitive surface 131 may cover the display panel 141. When the touch-sensitive surface 131 detects a touch operation on or near it, it is transmitted to the processor 180 to determine the type of touch event. Subsequently, the processor 180 provides corresponding visual output on the display panel 141 according to the type of touch event. Although in Figure 7 In the embodiment, the touch-sensitive surface 131 and the display panel 141 are implemented as two independent components to implement input and output functions, but in some embodiments, the touch-sensitive surface 131 and the display panel 141 can be integrated to implement input and output functions.

[0125] The electronic device 1200 may also include at least one sensor 150, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 141 according to the brightness of the ambient light, and the proximity sensor may turn off the display panel 141 and / or the backlight when the electronic device 1200 is moved to the ear. As a type of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc. that can also be configured in the electronic device 1200, they will not be repeated here.

[0126] The audio circuit 160, the speaker 161, and the microphone 162 can provide an audio interface between the user and the electronic device 1200. The audio circuit 160 can transmit the received audio data to the speaker 161 after converting the received audio data into an electrical signal, which is converted into a sound signal for output by the speaker 161; on the other hand, the microphone 162 converts the collected sound signal into an electrical signal, which is received by the audio circuit 160 and converted into audio data, and then the audio data is processed by the output processor 180, and then sent to another terminal through the RF circuit 110, or the audio data is output to the memory 120 for further processing. The audio circuit 160 may also include an earplug jack to provide communication between an external headset and the electronic device 1200.

[0127] The electronic device 1200 can help users send and receive emails, browse web pages, and access streaming media through the transmission module 170 (such as a Wi-Fi module), which provides users with wireless broadband Internet access. Figure 7 The transmission module 170 is shown, but it is understandable that it is not an essential component of the electronic device 1200 and can be omitted as needed without changing the essence of the invention.

[0128] The processor 180 is the control center of the electronic device 1200. It uses various interfaces and lines to connect various parts of the entire mobile phone. By running or executing software programs and / or modules stored in the memory 120, and calling data stored in the memory 120, it executes various functions of the electronic device 1200 and processes data, thereby monitoring the mobile phone as a whole. Optionally, the processor 180 may include one or more processing cores; in some embodiments, the processor 180 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, etc., and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 180.

[0129] The electronic device 1200 also includes a power supply 190 for supplying power to various components. In some embodiments, the power supply can be logically connected to the processor 180 through a power management system, so that the power management system can realize functions such as managing discharge and power consumption. The power supply 190 can also include any components such as one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, and power status indicators.

[0130] Although not shown, the electronic device 1200 may also include a camera (such as a front camera, a rear camera), a Bluetooth module, etc., which will not be described in detail here. Specifically in this embodiment, the display unit 140 of the electronic device 1200 is a touch screen display, and the electronic device 1200 also includes a memory 120, and one or more programs, wherein one or more programs are stored in the memory 120, and are configured to be executed by one or more processors 180. One or more programs include instructions for performing the following operations:

[0131] An instruction receiving instruction, used to receive a first multimedia control instruction uploaded by the client of the player through a multimedia input service instance created based on TIF;

[0132] A format conversion instruction, used for receiving, through the multimedia input service instance, a first multimedia control instruction uploaded by the client of the player, and performing format conversion on the first multimedia control instruction to obtain a second multimedia control instruction recognizable by the client;

[0133] The instruction control instruction is used to send the second multimedia control instruction to the client so that the client executes the second multimedia control instruction.

[0134] In some embodiments, the program also includes a registration instruction for creating the multimedia input service instance based on TIF; registering the multimedia input service to the input service list of the player so that the server receives and processes multimedia control instructions based on the multimedia input service instance.

[0135] The embodiment of the present application also provides an electronic device, which may be a smart phone, a television, a computer, or other device.

[0136] As can be seen from the above, an embodiment of the present application provides an electronic device 1200, and the electronic device 1200 performs the following steps:

[0137] Registering a multimedia input service instance created based on TIF into an input service list of a corresponding player, wherein the multimedia input service instance is used to receive and process multimedia control instructions;

[0138] Receiving a first multimedia control instruction uploaded by the client of the player through the multimedia input service instance, and converting the format of the first multimedia control instruction to obtain a second multimedia control instruction that can be recognized by the client;

[0139] The second multimedia control instruction is sent to the client, so that the client executes the second multimedia control instruction.

[0140] In some embodiments, the electronic device 1200 further performs the following steps:

[0141] Receive input multimedia control events;

[0142] Identify a first multimedia control instruction in the multimedia control event, and send the first multimedia control instruction to a server of the player, so that the server converts the format of the first multimedia control instruction through a multimedia input service instance to obtain a second multimedia control instruction that can be recognized by the client; wherein the multimedia input service instance is created based on TIF and registered in an input service list of the corresponding player;

[0143] Receive and execute the second multimedia control instruction sent by the server.

[0144] An embodiment of the present application further provides a storage medium, wherein a computer program is stored in the storage medium. When the computer program is executed on a computer, the computer executes the multimedia playback method described in any one of the above embodiments.

[0145] It should be noted that, for the multimedia playback method described in the present application, ordinary testers in the field can understand that all or part of the process of implementing the multimedia playback method described in the embodiment of the present application can be completed by controlling the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium, such as a memory of an electronic device, and executed by at least one processor in the electronic device, and the execution process may include the process of the embodiment of the multimedia playback method. Among them, the storage medium can be a disk, an optical disk, a read-only memory (ROM), a random access memory (RAM), etc.

[0146] For the multimedia playback device of the embodiment of the present application, each functional module can be integrated into a processing chip, or each module can exist physically separately, or two or more modules can be integrated into one module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium, such as a read-only memory, a disk or an optical disk.

[0147] The multimedia playback method, device, medium and equipment provided by the embodiments of the present application are introduced in detail above. Specific examples are used herein to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method and core idea of ​​the present application. At the same time, for those skilled in the art, according to the idea of ​​the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as limiting the present application.

Claims

1. A multimedia playback method, applied to a server of a player, characterized in that: The method comprises: Receive a first multimedia control instruction uploaded by the client of the player through a multimedia input service instance created based on TIF; Converting the first multimedia control instruction into a format to obtain a second multimedia control instruction recognizable by the client; The second multimedia control instruction is sent to the client, so that the client executes the second multimedia control instruction.

2. The multimedia playing method according to claim 1, wherein: Before the multimedia input service instance created based on TIF receives the first multimedia control instruction uploaded by the client of the player, the method further includes: Creating the multimedia input service instance based on TIF; The multimedia input service is registered in the input service list of the player, so that the server receives and processes multimedia control instructions based on the multimedia input service instance.

3. A multimedia playback method, applied to a player client, characterized in that: The method comprises: Receive input multimedia control events; Identify a first multimedia control instruction in the multimedia control event, and send the first multimedia control instruction to a server of the player, so that the server converts the format of the first multimedia control instruction through a multimedia input service instance to obtain a second multimedia control instruction that can be recognized by the client; wherein the multimedia input service instance is created based on TIF and registered in an input service list of the corresponding player; Receive and execute the second multimedia control instruction sent by the server.

4. The multimedia playing method according to claim 3, characterized in that: Before the receiving of the input multimedia control event, the method further includes: When an input multimedia play event is detected, a session is established with the server, and after the session is established with the server, a start play instruction is executed according to the target multimedia resource sent by the server.

5. The multimedia playing method according to claim 4, characterized in that: The establishing a session with the server, and after establishing the session with the server, executing a start playback instruction according to a target multimedia resource sent by the server, comprises: A session creation request is initiated to the server of the player to establish a session with the server, and the storage path of the target multimedia resource, the preset identifier corresponding to the multimedia input source, and the start playback instruction are sent to the server through the session creation request, so that the server calls the multimedia input service instance corresponding to the preset identifier to receive the storage path and the start playback instruction, and obtains the target multimedia resource corresponding to the storage path and sends it to the client to execute the start playback instruction.

6. The multimedia playing method according to claim 4, characterized in that: After establishing a session with the server, the method further includes: Detecting the operating status of the server, wherein the operating status includes normal and abnormal; If the running state of the server is abnormal, re-establishing a session with the server.

7. The multimedia playing method according to claim 4, characterized in that: If the running state of the server is abnormal, re-establishing a session with the server includes: Positioning the time node corresponding to when the running status of the server is detected to be abnormal; Obtain historical multimedia playback parameters recorded before the time node, re-establish a session with the server according to the historical multimedia playback parameters, and after re-establishing the session with the server, receive historical multimedia resources corresponding to the historical multimedia playback parameters sent by the server, and restore the current playback screen to the historical playback screen before the time node according to the historical multimedia resources.

8. A multimedia playback device, applied to a server of a player, characterized in that: The multimedia playback device comprises: An instruction receiving module, used for receiving a first multimedia control instruction uploaded by a client of the player through a multimedia input service instance created based on TIF; a format conversion module, configured to receive, through the multimedia input service instance, a first multimedia control instruction uploaded by a client of the player, and perform format conversion on the first multimedia control instruction to obtain a second multimedia control instruction recognizable by the client; The instruction control module is used to send the second multimedia control instruction to the client so that the client executes the second multimedia control instruction.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor to execute the multimedia playing method according to any one of claims 1 to 7.

10. An electronic device, characterized in that: It comprises a processor and a memory, wherein the memory stores a plurality of instructions, and the processor loads the instructions to execute the multimedia playing method according to any one of claims 1 to 7.

Images