Media playing method, Internet of Things system, device, medium and product

Abstract

The embodiment of the invention provides a media playing method, an Internet of Things system, equipment, a medium and a product, and the method comprises the steps: enabling a user terminal to sense the access of collection equipment of media content through building a capability management system, and carrying out the capability request of the collection equipment, so as to obtain the capability component information corresponding to the collection equipment. And matching the capability components based on the capability component information, determining which capability components the player of the user terminal needs to have in order to play the media content of the corresponding acquisition equipment, and loading the related capability components. Through the scheme, the capability components required by different acquisition devices can be matched, and then the corresponding capability components are loaded, so that the unnecessary presetting of the capability components is avoided, the problem of space redundancy is solved, and the starting and loading speed of the player can be optimized.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the technical field of communication, and in particular to a media playing method, an Internet of Things system, a device, a medium and a product. BACKGROUND

[0002] A media player is an important part of a converged device center and is one of the media through which a user directly communicates with a terminal. The media player can display various types of media data collected by terminal devices such as a camera, a smart door lock and a smart robot on a user interface.

[0003] In related technologies, different media data collection devices will produce different codecs and support different transmission protocols due to hardware differences. In an Internet of Things scenario such as a smart home, in which multiple devices are interconnected, a user terminal needs to integrate various different media players to support audio and video playing of different collection devices. Currently, different collection devices are supported by writing various required protocols and supported functions into a program during compilation or by pre-setting various required plug-ins for installation. This will cause poor player adaptability, function redundancy and unnecessary occupation of space resources. Therefore, how to reduce unnecessary space redundancy is a technical problem that needs to be solved urgently. SUMMARY

[0004] Embodiments of the present application provide a media playing method, an Internet of Things system, a device, a medium and a product, which aim to improve the adaptability to collection devices while reducing unnecessary space redundancy.

[0005] In a first aspect, embodiments of the present application provide a media playing method, which comprises:

[0006] obtaining an access message of a media content collection device;

[0007] sending a capability request according to the access message;

[0008] receiving capability component information generated according to the capability request;

[0009] matching and installing a capability component corresponding to the collection device according to the capability component information, the capability component being configured to enable a player to play media content from the collection device.

[0010] In a second aspect, embodiments of the present application provide an electronic device, which at least comprises:

[0011] a player and a player capability management system;

[0012] The player capability management system can be used to match the capability of the media content collection device and install the corresponding capability component of the collection device, so that the player can be used to play the media content.

[0013] In a third aspect, the embodiments of the present application provide an Internet of Things system, and the system at least comprises:

[0014] a media collection device, an Internet of Things platform, and an electronic device;

[0015] The media collection device and the Internet of Things platform are in communication connection;

[0016] The Internet of Things platform and the media player are in communication connection;

[0017] The media collection device is configured to collect media content and send the media content to the Internet of Things platform;

[0018] The Internet of Things platform is configured to send the media content to the electronic device and send a response message generated according to a capability model in response to a request of the electronic device, wherein the capability model is used to represent capability components required for playing media content from the media collection device;

[0019] The electronic device is configured to be capable of matching the capability components required for playing media content from the media collection device and loading the required capability components to a player of the electronic device.

[0020] In a fourth aspect, the embodiments of the present application provide an electronic device, which comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the media playing method of the first aspect when executing the computer program.

[0021] In a fourth aspect, the embodiments of the present application provide a computer readable storage medium, which stores computer executable instructions, and the computer executable instructions are used to execute the media playing method of the first aspect.

[0022] In a fifth aspect, the embodiments of the present application provide a computer program product, which comprises a computer program or computer instructions, and the computer program or the computer instructions are stored in a computer readable storage medium, a processor of a computer device reads the computer program or the computer instructions from the computer readable storage medium, and the processor executes the computer program or the computer instructions, so that the computer device executes the media playing method of the first aspect.

[0023] In this application, a capability management system is constructed, enabling user terminals to perceive the access of media content acquisition devices and request capabilities from these devices to obtain corresponding capability component information. Based on this information, capability components are matched to determine which capability components the user terminal's player needs to play media content from the corresponding acquisition device, and then the relevant capability components are loaded. This approach matches the required capability components for different acquisition devices and loads the corresponding components, avoiding unnecessary pre-installation of capability components, solving the problem of space redundancy, and optimizing the player's startup and loading speed. Furthermore, through dynamic matching, the player's encoding and decoding capabilities and supported transmission methods can be expanded via capability components, thereby ensuring compatibility with a wider range of acquisition devices and guaranteeing flexibility in expansion. Attached Figure Description

[0024] Figure 1 This is a system architecture diagram of the media playback method provided in one embodiment of this application;

[0025] Figure 2 This is a system architecture diagram of the media playback method provided in another embodiment of this application;

[0026] Figure 3 This is a platform system architecture diagram based on the Internet of Things provided in one embodiment of this application;

[0027] Figure 4 This is a flowchart of a media playback method provided in an embodiment of this application;

[0028] Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application.

[0029] Figure 6 This is a schematic diagram of an Internet of Things (IoT) system provided in an embodiment of this application;

[0030] Figure 7 This is a schematic diagram of a media playback interaction scenario based on the Internet of Things provided in an example of this application;

[0031] Figure 8 This is a structural block diagram of a portion of the terminal implementing the media playback method of the embodiments of this application;

[0032] Figure 9 This is a structural block diagram of a portion of the server implementing the media playback method of the embodiments of this application. Detailed Implementation

[0033] In order to make the purposes, technical solutions and advantages of the present application clearer, the present application will be further described in detail below with reference to the drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and should not be used to limit the present application.

[0034] It should be noted that although the functional modules are divided in the device schematic diagram, and the logical order is shown in the flowchart, in some cases, the steps shown or described can be performed in a manner different from the module division in the device or the order in the flowchart. The terms "first", "second", etc. in the specification and claims and the above drawings are used to distinguish similar objects, and do not necessarily describe a specific order or sequence.

[0035] In the embodiments of the present application, the words such as "exemplarily" are used to represent as an example, illustration or description, and should not be interpreted as more preferred or more advantageous than other embodiments or design schemes. The use of words such as "exemplarily" is intended to present the relevant concept in a specific manner.

[0036] In the related art, the media player is an important part of the convergence device center and one of the media for users to directly communicate with the terminal, which can display various types of media data collected by the media collection device on the user interface. In the smart home terminal system, media collection devices such as cameras, smart door locks, and intelligent robots have audio and video collection and transmission capabilities, and can display the audio and video data collected by themselves to the user for viewing through the relay cloud platform. However, due to differences in memory, CPU, sensors and other hardware, different devices have different encoding and decoding and transmission protocols, which will cause different media players to be integrated and played when adapting to different devices, resulting in problems such as software bloat, poor adaptability, and high development difficulty.

[0037] In the related art, different media data collection devices will have different encoding and decoding and supported transmission protocols due to hardware differences. In the Internet of Things scene of multi-device interconnection such as smart home, various different media players need to be integrated in the user terminal to support audio and video playback of different collection devices.

[0038] Currently, the required protocols and supported functions are written into the program at the compilation stage. For example, IJKPlayer (a lightweight video player): the player is configured to support protocols (such as Real Time Streaming Protocol (RTSP), Hypertext Transfer Protocol (HTTP), Secure Socket Layer (SSL), etc.) and encodings (H.264, H.265 (Highly Compressed Digital Video Codec Standard), etc.) at compile time, and then packaged into a shared library, which is integrated into the application as a playback kernel. This approach can cause the flexibility of expansion to be greatly reduced, and redundant configuration items can easily occur. For example: a camera device needs to support the RTSP protocol and H.264 encoding, and a robot device needs to support the HTTP protocol and H.265 encoding. At this time, both protocols and encodings need to be compiled into the player shared library, but if the user only uses the camera device, the software package will have redundant functions.

[0039] Alternatively, pre-set plugins required for different types of acquisition devices are installed to support different acquisition devices. For example, VLC player provides a plugin system, but the system cannot be linked with external systems. The plugin system provides a series of pre-installed plugins for use at the initial startup stage of the player, and the corresponding plugins cannot be enabled or disabled according to the capabilities of different devices, so redundant startup plugins can slow down the application startup speed and occupy application space. This can cause poor player adaptability, function redundancy, and unnecessary space resource occupation. Therefore, how to reduce unnecessary space redundancy is a technical problem that needs to be solved.

[0040] This application provides a media playback method, an IoT system, a device, a medium, and a product. By constructing a capability management system, user terminals can sense the access of media content acquisition devices and request capabilities from these devices to obtain capability component information. Based on this information, capability components are matched to determine which capability components the user terminal's player needs to play media content from the corresponding acquisition device, and then the relevant capability components are loaded. This approach matches the capability components required by different acquisition devices and loads the corresponding components, avoiding unnecessary pre-installation of capability components, solving the problem of space redundancy, and optimizing the player's startup and loading speed. In related technologies, loading all pre-set plugins during the initial startup phase of the player can cause slow startup speeds and redundancy due to loading too many unnecessary plugins. This application's dynamic matching method matches and loads the corresponding capability components according to the sensed acquisition device, avoiding the installation of too many unnecessary redundant plugins. Furthermore, when switching between playback on different acquisition devices, the required capabilities are loaded based on dynamic matching, improving the response and loading speed when playing media data. When connecting to acquisition devices that use new encoding / decoding capabilities and transmission protocols, the player's encoding / decoding capabilities and supported transmission methods can be expanded through capability components, thereby ensuring compatibility with more types of acquisition devices and guaranteeing flexibility in expansion.

[0041] The embodiments of this application will be further described below with reference to the accompanying drawings.

[0042] Figure 1 This is a system architecture diagram of the media playback method provided in one embodiment of this application. For example... Figure 1 As shown, the system includes, but is not limited to, server 110, media acquisition device 120, user terminal 130, etc.

[0043] Server 110 refers to a computer system that provides capability management services, media playback services, and interaction services with media acquisition device 120 to user terminal 130. In this embodiment, server 110 is equipped with a capability management system, which can identify and match capability components between user terminal 130 and media acquisition device 120, and assist user terminal 130 in installing capability components. Compared to user terminal 130, server 110 has higher requirements in terms of stability, security, and performance. Server 110 can be a single high-performance computer in a network platform, a cluster of multiple high-performance computers, a portion of a single high-performance computer (e.g., a virtual machine), or a combination of portions of multiple high-performance computers (e.g., virtual machines). Server 110 can also communicate with media acquisition device 120 and / or user terminal 130 via wired or wireless means to exchange data.

[0044] The media collection device 120 refers to a device that collects media information such as audio and video data, and can provide the media information to the user terminal 130. It includes but is not limited to a camera, a smart door lock, a smart robot, a smart TV, other devices or apparatuses with audio and video collection capabilities, etc. The media collection device 120 can also communicate with the server 110 in a wired or wireless manner to exchange data.

[0045] The user terminal 130 is a device that plays the media information collected by the media collection device 120 to the user. The user terminal 130 is installed with a player 131 for playing audio or video according to the media information. The user terminal 130 includes desktop computers, laptops, PDAs (personal digital assistants), mobile phones, car terminals, home theater terminals, special terminals, etc. In addition, it can be a single device or a collection of multiple devices. For example, multiple devices are connected through a local area network, share a display device for collaborative work, and jointly constitute a terminal. The user terminal 130 can also communicate with the server 110 in a wired or wireless manner to exchange data.

[0046] Figure 2 is a system architecture diagram to which a media playing method provided by another embodiment of the present application is applied. As shown in Figure 2 The system includes but is not limited to a network 210, a media collection device 220, a user terminal 230, etc.

[0047] The network 210 can be the Internet, the Internet of Things, a home area network, etc., which is not specifically limited here.

[0048] The media collection device 220 refers to a device that collects media information such as audio and video data, and can provide the media information to the user terminal 130. It includes but is not limited to a camera, a smart door lock, a smart robot, a smart TV, other devices or apparatuses with audio and video collection capabilities, etc. The media collection device 120 can also communicate with the network 210 in a wired or wireless manner to exchange data, to realize interaction with the user terminal 230.

[0049] The user terminal 230 is a device for playing the media information collected by the media collection device 220 to a user. The user terminal 230 is installed with a player 231 for playing audio or video according to the media information. The user terminal 230 is also loaded with a capability management system 232; through the capability management system 232, the user terminal 230 can acquire corresponding capability component information from the media collection device 220 and perform capability matching, based on the capability matching result, acquire and install the capability component, so as to enable the player 231 to adapt to various media collection devices 220. The user terminal 230 includes desktop computers, laptop computers, PDAs (personal digital assistants), mobile phones, vehicle-mounted terminals, home theater terminals, special-purpose terminals, and the like. In addition, it can be a single device or a collection of multiple devices. For example, multiple devices are connected through a local area network, share a display device for cooperative work, and collectively constitute a terminal. The user terminal 230 can also communicate with the network 210 in a wired or wireless manner to exchange data, so as to realize interaction with the media collection device 210.

[0050] The embodiments of the present application can be applied in smart home, multimedia fusion interaction, smart campus, industrial production management, and the like.

[0051] Figure 3 A platform system architecture based on the Internet of Things is provided for an embodiment of the present application. As shown in the scenario shown in Figure 3 , it includes:

[0052] 1) Media collection device: the media collection device refers to an Internet of Things (IoT) device with basic capabilities of multimedia data collection, coding and decoding, transmission, and playing. The device saves the collected audio and video data in a local storage through a certain coding format or transmits the data to a cloud platform, and can establish a device server through a communication protocol. The media collection device also stores the device basic capability component information possessed by itself.

[0053] 2) Cloud platform and relay server: the cloud platform and the relay server undertake the roles of database and proxy. The database of the cloud platform saves the audio and video files of the media collection device, and can enable the player to acquire the audio and video files through a specific port and IP address and play. At the same time, the capability component center of the cloud platform is one of the ways to deploy the player plug-in, and the capability component center of the cloud platform is a cloud database for uploading and downloading various capability components. The relay server is used for data analysis, conversion, and mutual transmission between the media collection device and the user terminal and the capability management system.

[0054] 3) User terminal: The user terminal receiving terminal device is the carrier of the player and the player capability management system. The user can see the access of the media collection device from the graphic system carried by the user terminal. The audio and video data collected by the media collection device can be viewed through the device management process.

[0055] 4) Player capability management system: The capability management system is the middleware connecting the media collection device and the user terminal. The main function of the system is to obtain the player capability component set required by the media collection device when detecting the access of the media collection device, and then install the corresponding capability component into the player to provide device support.

[0056] Exemplarily, based on Figure 3 The platform system architecture is provided, taking a home monitoring scene as an example. It is assumed that the current media collection device is a home camera, and the player and the player capability management system are both arranged in the user terminal.

[0057] When the home camera accesses the platform system, the home camera reports an access message to the platform. The platform informs the user terminal of the basic message such as the device identifier of the access according to the access message. After the user terminal listens to the message of the access of the home camera to the system, the player capability management system is notified to match and load the capability components.

[0058] The player capability management system generates a capability request according to the identifier of the accessed media collection device. The player capability management system sends the capability request to the home camera through the relay server. The home camera returns the information of each capability component required by itself to the player capability management system through the relay server according to the request information carried in the capability request.

[0059] The player capability management system matches the returned capability components required by the home camera, and determines the transmission protocol, the coding and decoding protocol, the function plug-in and the like supported by the home camera. If the player capability management system finds that a certain capability component is missing locally, the corresponding capability component is requested from the capability component center of the cloud platform. After the player capability management system matches and obtains all the capability components required by the home camera, the capability components are all installed into the player, so that the player can support the home camera.

[0060] After the capability component loading is completed, the player obtains the audio and video data collected by the home camera through the cloud platform or directly to the home camera, and plays the data.

[0061] In the above example, the player capability management system enables the user terminal to detect the access of media acquisition devices (such as home security cameras) and request the necessary capability component information from these devices. Based on this information, the system matches capability components to determine which components the user terminal's player needs to play media content from the corresponding acquisition device, and then loads the relevant components. This solution matches the required capability components for different acquisition devices and loads the corresponding components, avoiding unnecessary pre-installation of capability components, solving the problem of space redundancy, and optimizing the player's startup and loading speed. Through this dynamic matching method, the player matches and loads the corresponding capability components according to the detected acquisition device, avoiding the installation of too many unnecessary redundant plugins. Furthermore, it can retrieve missing capability components from the cloud platform, thus avoiding excessive caching of capability components locally in the capability management system and saving local space resources.

[0062] Figure 4 This is a flowchart of a media playback method provided in an embodiment of this application. This media playback method can be applied to, but is not limited to, user terminals, such as… Figure 1 User terminal 130 provided in the system, such as Figure 2 User terminal 230 provided in the system, or such Figure 3 In the user terminals of the provided platform system. For example... Figure 4 As shown, the media playback method includes, but is not limited to:

[0063] Step 410: Obtain the access message from the media content acquisition device;

[0064] Step 420: Send a capability request based on the access message;

[0065] Step 430: Receive capability component information generated based on the capability request;

[0066] Step 440: Match and install the capability components corresponding to the acquisition device according to the capability component information. The capability components are configured to enable the player to play media content from the acquisition device.

[0067] In step 410, media content refers to audio and video data streams. Acquisition devices refer to devices that generate and transmit audio and video data streams, such as cameras, smart locks, and smart robots. Access messages refer to messages obtained by the user terminal when the acquisition device establishes a communication connection with an IoT platform or user terminal, which indicate basic information about the acquisition device.

[0068] In step 420, a capability request refers to a message used to request the required capability components of the accessed acquisition device.

[0069] In step 430, the capability component information refers to information indicating which capability components the media content collection device needs. Exemplarily, the capability component information can be an identifier of each capability component.

[0070] In step 440, the matching according to the capability component information refers to that the player capability management system acquires the capability components needed by the media content collection device from a local server or a cloud server according to the capability component information. The installation of the capability components corresponding to the media content collection device refers to installing the capability components needed by the media content collection device acquired in the matching stage into the player, so that the player can support the corresponding media content collection device.

[0071] In the present application, the capability refers to a transmission protocol, a codec protocol, and various functional plug-ins supported by the media content collection device, such as black and white filtering, picture flipping, night mode, image filtering, etc. The capability component refers to a module or a plug-in capable of implementing the above-mentioned capabilities, which can be a piece of encapsulated code, or a separate software plug-in or software module.

[0072] In the above steps 410 to 440, the execution can be performed by a user terminal on which the player capability management system and the player are installed, or can be performed by a user terminal on which the player is installed and a player capability management system deployed separately through other terminals or servers.

[0073] In the above steps 410 to 440, the user terminal can perceive the access of the media content collection device, and can request the media content collection device to obtain the capability component information needed by the media content collection device. Then, the matching of the capability components is performed based on the capability component information, it is determined which capability components the player of the user terminal needs to have in order to play the media content of the corresponding media content collection device, and the related capability components are loaded. In the embodiments of the present application, the capability components needed by different media content collection devices can be matched and loaded, unnecessary preloading of the capability components is avoided, the problem of spatial redundancy is solved, and the startup loading speed of the player can be optimized. Through the dynamic matching manner of the embodiments of the present application, the player matches and loads the corresponding capability components according to the perceived media content collection device, and unnecessary redundant plug-ins are avoided from being installed too much.

[0074] The above is a general description of steps 410 to 440, and the specific implementation process of steps 410 to 440 is described in detail below.

[0075] In step 410, an access message of a media content collection device is acquired.

[0076] In an embodiment, as in Figure 1 or Figure 3In the provided system architecture, the collection device reports an initialization event to the server, wherein the initialization event contains device authentication type, access address, port, device identifier and other attributes. After receiving the initialization event, the server sends an access message to the user terminal to inform that a new collection device is accessed, and creates a device session in the database by the server. Through the server as a relay, the messages exchanged between the user terminal and the collection device are converted, so that both sides can recognize the information sent by the other party without obstacles.

[0077] In another embodiment, as in Figure 2 In the provided system architecture, when the user terminal directly communicates with the collection device through the network, the user terminal obtains the basic device information of the collection device, such as the device identifier, by listening to the access message when the new collection device is accessed.

[0078] In step 420, the access message sending capability request is sent.

[0079] In an embodiment, the user terminal generates a corresponding capability request according to the device identifier in the access message, and the capability request carries a message for obtaining the supported capability components of the specified collection device. It should be noted that in this application, the capability components supported by the media collection device / collection device are the capability components required by the media collection device / collection device.

[0080] In the case of a relay server or an Internet of Things unified platform (server), the user terminal sends the capability request to the server, and after the server matches the corresponding collection device according to the capability request, the server sends the capability acquisition instruction that can be recognized by the collection device to the corresponding collection device according to the capability request.

[0081] In the case of a relay server or an Internet of Things unified platform (server), the user terminal sends the capability request to the server, and after the server matches the corresponding collection device according to the capability request, the server sends the capability acquisition instruction that can be recognized by the collection device to the corresponding collection device according to the capability request. Figure 2 In the provided system architecture, when the user terminal directly communicates with the collection device through the network, the user terminal directly sends the capability request to the corresponding collection device.

[0082] In step 430, the capability component information generated according to the capability request is received.

[0083] In an embodiment, in the case that the player capability management system is arranged on the user terminal or the electronic device side, step 430 includes:

[0084] The Internet of Things platform sends a capability acquisition instruction according to the capability request;

[0085] The Internet of Things platform receives the capability model generated according to the capability acquisition instruction;

[0086] The Internet of Things platform generates a response message according to the capability model, wherein the response message includes capability component information.

[0087] The Internet of Things platform refers to an Internet of Things unified platform, which is usually deployed in one or more servers. The Internet of Things platform is used for message relay between the collection device and the user terminal.

[0088] The capability acquisition instruction is an instruction for instructing the corresponding collection device to send its own capability model. The target collection device is determined based on the device identifier carried in the capability request. The capability model is a data group obtained by integrating the information of each capability component of the collection device based on a pre-set data structure type.

[0089] The response message is a standard data that can be recognized by the user terminal and is generated by the Internet of Things platform after analyzing the capability model to obtain the corresponding capability component information in the capability model. The user terminal can obtain the capability component information from the response message.

[0090] In the above embodiment, since the player capability management system is arranged on the user terminal / electronic device side, in order to be compatible with the information interaction of different collection devices, message relay through the Internet of Things platform is required to enable both the user terminal and the collection device to recognize the messages / instructions sent by the other party.

[0091] In another embodiment, when the player capability management system is arranged on the Internet of Things platform (server) side, step 430 comprises:

[0092] receiving the capability model generated by the collection device according to the capability request;

[0093] analyzing the capability model to obtain the capability component information.

[0094] Since the player capability management system is arranged on the Internet of Things platform side, the capability matching process is performed between the Internet of Things platform and the collection device. At this time, the capability request is directly sent by the player capability management system in the Internet of Things platform to the collection device, and the collection device generates its own capability model according to the capability request and returns it to the player capability management system in the Internet of Things platform.

[0095] Since the player capability management system is arranged on the Internet of Things platform, it is not necessary to generate a response message according to the capability model for the user terminal. Instead, the Internet of Things platform analyzes the capability model to obtain the corresponding capability component information and performs capability component matching to obtain the required capability component of the collection device. The Internet of Things platform sends the matched capability component to the user terminal for the player to load the capability component.

[0096] In step 440, the capability component corresponding to the collection device is matched and installed according to the capability component information. The capability component is configured to enable the player to play the media content from the collection device.

[0097] In an embodiment, step 440 comprises:

[0098] According to the capability component information, matching the capability components required by the collection device;

[0099] According to the capability components required by the collection device, searching and installing the capability components corresponding to the collection device.

[0100] The matching of the capability components required by the collection device refers to parsing the capability component information, determining the collection device capabilities (capability components) contained in the capability component information, and thus determining which capability components are required by the collection device.

[0101] The searching of the capability components refers to searching and obtaining the required capability components from the local of the user terminal where the player is located, or the database of the Internet of Things platform, or the cloud capability component library. The installation of the capability components refers to loading the obtained capability components to the player, so that the player can support the corresponding collection device and play the audio and video stream of the collection device.

[0102] In an embodiment, searching and installing the capability components corresponding to the collection device at least comprises one of the following:

[0103] Searching the local component list and loading the found capability components corresponding to the collection device into the player;

[0104] Searching the local component list, obtaining a missing capability list, sending a component request according to the missing capability list, and obtaining and installing the capability components in the missing capability list; wherein the missing capability list includes the capability components required by the collection device that are missing in the local component list.

[0105] The local component list refers to the capability component library locally of the user terminal where the player is located, or the capability component library locally of the user terminal or server where the player capability management system is located.

[0106] When the local component list has all the capability components corresponding to the collection device, the required capability components are directly obtained from the local component list and loaded into the player.

[0107] When the local component list does not have all the capability components corresponding to the collection device, the capability components that can be found are obtained from the local component list, and the missing capability components are recorded in the missing capability list. After traversing the local component list, the actual capability components in the list are obtained from the cloud component library or the component library of the Internet of Things platform according to the missing capability list. Finally, the capability components obtained from the local component list and the capability components obtained from other component libraries are loaded into the player.

[0108] The above embodiment, the player can match and load the corresponding capability component according to the perceived Internet of Things device, avoid installing too many unnecessary redundant plug-ins. And the embodiment of the application can obtain the missing capability component from the cloud platform, which avoids too many capability component caches in the local capability management system, saves local space resources.

[0109] In an embodiment, after obtaining the corresponding capability component in the list according to the missing capability list, the capability component in the missing capability list is added to the local component list. Thus, the local component list is expanded to enable the local component list to support more media acquisition devices.

[0110] Figure 5 The structure schematic diagram of the electronic device provided by an embodiment of the application is shown in the figure. Figure 5 As shown in the figure, the electronic device at least includes a player and a player capability management system.

[0111] The player capability management system can be used to match the capability of the media content acquisition device and install the corresponding capability component of the acquisition device, so that the player can be used to play media content.

[0112] In an embodiment, the player capability management system is configured to obtain access information of the acquisition device, and send a capability request corresponding to the acquisition device according to the access information, so that the Internet of Things platform generates response information according to the capability request;

[0113] The player capability management system is configured to install the corresponding capability component of the acquisition device according to the response information.

[0114] In an embodiment, the player capability management system is configured to obtain capability component information according to the response information, and match and install the corresponding capability component of the acquisition device according to the capability component information.

[0115] In an embodiment, the player capability management system is configured to at least one of the following:

[0116] According to the capability component information, the local component list is searched, and the corresponding capability component of the acquisition device is installed;

[0117] According to the capability component information, the local component list is searched to obtain a missing capability list, a component request is sent according to the missing capability list, and the capability component in the missing capability list is obtained and installed.

[0118] In an embodiment, the player capability management system is configured to add the capability component in the missing capability list to the local component list.

[0119] In an embodiment, the player capability management system is configured to load the corresponding capability component of the acquisition device to the player.

[0120] In one embodiment, the player capability management system includes at least a capability matching module and a capability loading module. The capability matching module is capable of matching the capabilities of a media content acquisition device, and the capability loading module is capable of installing capability components corresponding to the acquisition device. Specifically, the capability matching module is responsible for obtaining capability component information corresponding to the media acquisition device, matching the required capability components based on the capability component information, and obtaining capability components from at least one of a local component library, a cloud component library, and an IoT platform component library based on the matched capability components, and providing these capability components to the capability loading module. The capability loading module is responsible for installing the capability components obtained by the capability matching module into the corresponding player.

[0121] It should be noted that the electronic device provided in this application is a hardware implementation corresponding to the media playback methods provided in the above embodiments. Specific implementation details and beneficial effects correspond to the media playback methods provided in the above embodiments, and will not be repeated here.

[0122] Figure 6 This is a schematic diagram of an Internet of Things (IoT) system provided in an embodiment of this application. Figure 6 As shown, the Internet of Things (IoT) system includes at least: a media acquisition device, an IoT platform, and an electronic device; wherein the media acquisition device and the IoT platform are connected in communication, and the IoT platform and the media player are connected in communication.

[0123] The media acquisition device is configured to acquire media content and send it to an IoT platform;

[0124] The IoT platform is configured to send media content to electronic devices and, in response to requests from the electronic devices, send response messages generated according to a capability model, where the capability model characterizes the capability components required to play media content from media acquisition devices.

[0125] The electronic device is configured to match the capability components required for playing media content from the media acquisition device, and the required capability components are loaded into the player of the electronic device.

[0126] It should be noted that the IoT system provided in this application is a system implementation method corresponding to the media playback methods provided in the above embodiments. Specific implementation details and beneficial effects correspond to the media playback methods provided in the above embodiments, and will not be repeated here.

[0127] In one embodiment, if an electronic device needs to play audio and video streams captured by multiple acquisition devices simultaneously, it can be achieved in the following two ways:

[0128] Manner 1: The player and the player capability management system are an entirety, which can be understood as the player and the player capability management system belong to the same software package. For the convenience of description, the entirety is named as a playing system. Multiple playing system instances are constructed, and the multiple playing system instances correspond to multiple collection devices one by one. Each playing system instance establishes a connection with a collection device. For each pair of playing system instance and collection device, the media playing method provided in any embodiment of the present application is executed once, so that the player in the playing system instance can match and install the capability components required by the corresponding collection device, so that the player can play the audio and video stream collected by the corresponding collection device. Each playing system instance corresponds to a player window, which is used to play the audio and video stream collected by the corresponding collection device to the user. The end user can view the audio and video corresponding to multiple collection devices through one electronic device at the same time.

[0129] Manner 2: The electronic device includes multiple players and one player capability management system. The multiple players correspond to the multiple collection devices one by one. The multiple players realize the capability component matching and installation between the players and the collection devices through the player capability management system, so that each player can support the corresponding collection device. Each player corresponds to a window, which is used to play the audio and video stream collected by the corresponding collection device to the user. The end user can view the audio and video corresponding to multiple collection devices through one electronic device at the same time.

[0130] In an embodiment, one electronic device usually establishes a connection with one collection device. After the connection between the electronic device and the collection device is established, a binding relationship is formed, and the electronic device after binding corresponds to a master account device.

[0131] When other electronic devices also need to view the media content collected by the collection device, the other electronic devices initiate a request to the master account device. After receiving the request, if the master account device agrees to the request, the master account device will initiate device sharing. The master account device will send a sharing instruction to the Internet of Things platform. The Internet of Things platform will send a sharing push to the other electronic devices according to the sharing instruction. The other electronic devices receiving the sharing push can perform capability component matching and installation between the media collection device, so that the player of the other electronic devices can play the media content of the media collection device.

[0132] In other embodiments, the master account device can also actively initiate media collection device sharing.

[0133] The media playing method of the present application is described in detail below through some examples. It can be understood that the following examples are only used to better illustrate the media playing method of the present application, and are not limited.

[0134] Figure 7A schematic diagram of an Internet of Things-based media playing interaction scenario is provided for an example of the present application. As shown in Figure 7 The media playing process includes the following steps:

[0135] 1) Internet of Things device accesses Internet of Things unified platform: First, the Internet of Things unified platform defines an initialization event that needs to be reported when the Internet of Things device accesses, and the event includes the following attributes: device authentication type, access address, port, and device identifier. Among them, the Internet of Things device in the present example corresponds to a media collection device.

[0136] After the Internet of Things device is powered on, it first performs self-checking. The device will scan its own hardware to obtain the supported capability components. After self-checking is completed, the Internet of Things device will save all the capability components into the device local database. Then, the Internet of Things device will send a device access event to the Internet of Things unified platform. The Internet of Things unified platform receives the access event, creates a device session and saves it to the database, and at the same time, the platform pushes a message to the user device to inform that the Internet of Things device accesses. At this time, the user device can see the online device card displayed as a green light, and can also click to enter the device viewing and management page.

[0137] 2) Player capability management system detects Internet of Things device access and obtains Internet of Things device capability components: In step 1), the Internet of Things device accesses the Internet of Things unified platform and reports an access event. The platform receives the event and pushes a message to the user device. At this time, the background service of the user device listens to the device access message of the platform, and notifies the player capability management system to start the device capability component loading process.

[0138] First, the player capability management system reads the device access message, parses the device basic information in the access message such as the device identifier, then constructs a device capability request, and sends the capability request to the Internet of Things unified platform. After receiving the request from the user, the platform queries the saved session in the data, matches the corresponding Internet of Things device according to the device identifier, and sends a capability acquisition instruction to the Internet of Things device. Then, the Internet of Things device receives the capability acquisition instruction, retrieves the device database to query the capability component information, creates a capability model, and returns the capability model to the Internet of Things unified platform. After receiving the capability model, the Internet of Things unified platform parses the capability model according to the model definition and generates a response message, and returns the corresponding message to the player capability management system. Among them, the response message includes the capability component information parsed from the capability model.

[0139] 3) Player capability management system loads capability components: In 2), after the player capability management system obtains the response message of the device capability model, it starts the player capability component loading process.

[0140] First, the player capability management system parses the IoT device capabilities contained in the response message field by field, and caches each IoT device capability parsed into a capability list. After all fields are parsed, the player capability management system uses the capability list to search for capability components in the local component warehouse (user component library), loads the found capability components into the player startup list, and places the un-found capability components into the missing capability list. After all capability components are searched, if there are components not recorded in the user component library, the platform component library is requested for the missing capability components. The player capability management system sends the failed component list to the platform component library, the platform component library searches for the corresponding capability components, and returns the capability component files to the player capability management system one by one. The player capability management system caches the capability components into the user component library while loading the capability components into the player startup list.

[0141] 4) Player starts and uses capability components: the player uses the capability components loaded by the player capability management system as playing capabilities, and starts the capability components in sequence from modules such as codec, transmission protocol, and output format (resolution, color gamut), and finally presents the audio and video content to the user interface.

[0142] In the above example, through the player capability management system, the user device can perceive the access of the IoT device and request the capability component information required by the IoT device. Thus, based on the capability component information, the matching of the capability components is performed, it is determined which capability components the player of the user device needs to have in order to play the media content of the corresponding IoT device, and the related capability components are loaded. Through the corresponding scheme of the above example, the capability components required by different IoT devices can be matched and loaded, unnecessary capability components are avoided to be pre-installed, the problem of spatial redundancy is solved, and the startup and loading speed of the player can be optimized. Through the dynamic matching manner of the example, the player matches and loads the corresponding capability components according to the perceived IoT device, which avoids installing too many unnecessary redundant plug-ins. Moreover, the capability components missing locally can be obtained from the cloud platform, which avoids caching too many capability components locally in the capability management system, and saves local space resources.

[0143] In another example, when the Internet of Things device adopts a new capability component, such as a newly set codec, an upgraded transmission protocol, a newly built functional plug-in, etc., the Internet of Things device accesses the Internet of Things unified platform and performs self-checking, and after that, the Internet of Things device saves all the capability components into a device local database and uploads all the capability components to a platform component library. The platform component library matches the capability components uploaded by the Internet of Things device, retains the capability components already existing in the library, and stores the new capability components not existing in the library. Thus, when a user device performs capability component matching and loading with the Internet of Things device subsequently, the new capability components of the Internet of Things device can be obtained from the platform component library.

[0144] In the above example, when the Internet of Things device (media acquisition device) adopting a new codec capability and transmission protocol is accessed, the codec capability and supported transmission mode of the player can be expanded through the capability component, so that more types of acquisition devices are compatible, and the flexibility of expansion is ensured. In the case that the new capability component not existing in the library, such as a newly set codec, an upgraded transmission protocol, a newly built functional plug-in, etc., is updated only on the Internet of Things device side, and the database of the user device and the platform does not need to be uniformly updated, and the scalability is further improved.

[0145] Exemplarily, it is assumed that there are camera A and camera B: the processor performance of camera A is 70% of that of camera B, the codec capability is lower, the resolution is 2.5 million, and the resolution of camera B is 4 million. Therefore, camera A uses H.264 encoding which is more friendly to low resolution; the Flash of camera A is 16 MB, and the memory is 64 MB, while the Flash of camera B is 128 MB, and the memory is 128 MB. Therefore, camera A adopts HTTP Live Streaming (HLS) which has a lower requirement for the size of a sliding window, while camera B adopts a faster and more stable RTSP real-time streaming protocol. At the same time, camera A is less than camera B in functions such as night mode and picture flipping, and these functions are defined in the device capability set of camera A. After the player component obtains the capability component corresponding to camera A through the media playing method provided in the application, the corresponding capability component is loaded to realize effects such as black and white filtering and picture inversion.

[0146] Figure 8 A structure block diagram of a part of a terminal for implementing the media playing method of the embodiments of the application is shown in FIG. 1. As shown in FIG. 1, the terminal includes a processor 1001, a memory 1002, a communication interface 1003, and a display 1004. Figure 8As shown, the terminal includes: radio frequency (RF) circuit 810, memory 815, input unit 830, display unit 840, sensor 850, audio circuit 860, wireless fidelity (WiFi) module 870, processor 880, and power supply 890, and the like. Those skilled in the art can understand that Figure 8 The terminal structure shown does not constitute a limitation on mobile phones or computers, and can include more or fewer components than shown, or combine certain components, or different component arrangements.

[0147] The RF circuit 810 can be used for receiving and sending signals in the process of information or communication, especially receiving the downlink information of the base station and processing it by the processor 880; in addition, sending the uplink data to the base station.

[0148] The memory 815 can be used to store software programs and modules, and the processor 880 executes various functions and data processing of the content terminal by running the software programs and modules stored in the memory 815.

[0149] The input unit 830 can be used to receive input digital or character information, and generate key signal input related to the setting and function control of the content terminal. Specifically, the input unit 830 can include a touch panel 831 and other input devices 832.

[0150] The display unit 840 can be used to display input information or provided information and various menus of the content terminal. The display unit 840 can include a display panel 88.

[0151] The audio circuit 860, speaker 861, and microphone 862 can provide an audio interface.

[0152] In this embodiment, the processor 880 included in the terminal can execute the media playing method of the previous embodiment.

[0153] The terminal of the embodiments of the present application includes but is not limited to mobile phones, computers, smart voice interaction devices, smart home appliances, vehicle-mounted terminals, aircraft, etc. The embodiments of the present application can be applied to various scenarios, including but not limited to content recommendation, data filtering, etc.

[0154] Figure 9A structure block diagram of a server for implementing the media playing method of the embodiments of the present application. The server can have great differences due to different configurations or performances, and can include one or more central processing units (CPU) 922 (e.g., one or more processors) and a memory 932, one or more storage media 930 (e.g., one or more mass storage devices) for storing applications 99 or data 944. The memory 932 and the storage media 930 can be temporary storage or persistent storage. The programs stored in the storage media 930 can include one or more modules (not shown in the figure), each of which can include a series of instructions for operating the server. Further, the central processing unit 922 can be configured to communicate with the storage media 930 to execute the series of instructions in the storage media 930 on the server.

[0155] The server can also include one or more power supplies 926, one or more wired or wireless network interfaces 950, one or more input / output interfaces 958, and / or one or more operating systems 941, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, etc.

[0156] The central processing unit 922 in the server can be used to execute the media playing method of the embodiments of the present application.

[0157] The embodiments of the present application also provide a computer readable storage medium for storing program codes, the program codes being used to execute the media playing method of the above-mentioned embodiments.

[0158] The embodiments of the present application also provide a computer program product including a computer program. The processor of the computer device reads the computer program and executes it, so that the computer device executes the media playing method as described above.

[0159] The terms "first", "second", "third", "fourth", and the like in the description of the application and in the claims hereof, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the use of the terms so termed is interchangeable under appropriate circumstances such that the descriptive terms used herein are used to describe the embodiments of the application described herein are by way of illustration and not of limitation. Moreover, the terms "comprise", "comprising", "include", "including", and the like, are typically used herein to indicate the presence of stated features, integers, steps, or components, but not to the exclusion of others. It is to be understood that the use of these terms are not made to limit or restrict the scope of each and every embodiment of the application as such terms encompass equivalent meanings.

[0160] It should be understood that, in the application, "at least one" means one or more, and "multiple" means two or more. "And / or" is used to describe the relationship between the associated contents, which means that there can be three relationships, for example, "A and / or B" can represent three cases: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally represents an "or" relationship between the associated contents. "At least one of the following" or similar expressions means any combination of these items, including any combination of single or multiple items. For example, at least one of a, b or c can mean a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, and c can be single or multiple.

[0161] It should be understood that, in the description of the embodiments of the application, the meaning of multiple (or multiple items) is two or more, greater than, less than, more than, etc. are not included in the number, above, below, etc. are included in the number.

[0162] In several embodiments provided by the application, it should be understood that the disclosed system, device and method can be implemented in other ways. For example, the device embodiments described above are only schematic. The division of units is only a logical function division. Actual implementation can have another division manner. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units or components shown or discussed can be indirect coupling or communication connection through some interface, device or unit, which can be electrical, mechanical or other form.

[0163] The units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, i.e., may be located in one place, or may be distributed to multiple network units. Part or all of the units may be selected according to actual needs to achieve the purpose of the embodiment.

[0164] In addition, each functional unit in each embodiment of the present application can be integrated into one processing unit, or each unit can be physically present separately, or two or more units can be integrated into one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.

[0165] The integrated unit, if realized in the form of a software functional unit and sold or used as an independent product, can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application essentially or the part that contributes to the prior art or the whole or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a number of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the embodiments of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various media that can store program codes.

[0166] It should also be understood that the various embodiments provided by the embodiments of the present application can be combined arbitrarily to achieve different technical effects.

[0167] The above is a specific description of the embodiments of the present application, but the present application is not limited to the above embodiments. Those skilled in the art can make various equivalent modifications or replacements without departing from the spirit of the present application, and these equivalent modifications or replacements are included in the scope defined by the claims of the present application.

Claims

1. A media playback method, characterized in that, The method includes: Obtain access messages from media content acquisition devices; Send a capability request according to the access message; Receive capability component information generated based on the capability request; The capability components corresponding to the acquisition device are matched and installed according to the capability component information. The capability components are configured to enable the player to play media content from the acquisition device.

2. The method according to claim 1, characterized in that, The step of matching and installing the capability components corresponding to the acquisition device based on the capability component information includes: Based on the capability component information, match the capability components required by the acquisition device; Based on the required capability components of the acquisition device, locate and install the corresponding capability components for the acquisition device.

3. The method according to claim 2, characterized in that, The process of finding and installing the capability components corresponding to the acquisition device includes at least one of the following: Search the local component list and load the capability components corresponding to the acquisition device found into the player; The local component list is searched to obtain a list of missing capabilities. A component request is sent based on the list of missing capabilities to obtain and install the capability components in the list of missing capabilities. The list of missing capabilities includes the capability components required by the acquisition device that are missing from the local component list.

4. The method according to claim 3, characterized in that, The method further includes: Add the capability components from the missing capability list to the local component list.

5. The method according to any one of claims 1 to 4, characterized in that, Receiving capability component information generated based on the capability request includes: The IoT platform sends a capability acquisition instruction based on the capability request; Receive a capability model generated based on the capability acquisition instruction; A response message is generated based on the capability model, wherein the response message includes the capability component information.

6. The method according to any one of claims 1 to 4, characterized in that, Receiving capability component information generated based on the capability request includes: Receive the capability model generated by the acquisition device based on the capability request; The capability model is parsed to obtain the capability component information.

7. An electronic device, characterized in that, The electronic device includes at least: Player and player capability management system; The player capability management system can be used to match the capabilities of media content acquisition devices and install the corresponding capability components of the acquisition devices, so that the player can be used to play the media content.

8. The electronic device according to claim 7, characterized in that: The player capability management system is configured to obtain the access information of the acquisition device and send the capability request corresponding to the acquisition device according to the access information, so that the IoT platform can generate response information according to the capability request; The player capability management system is configured to install capability components corresponding to the acquisition device based on the response information.

9. The electronic device according to claim 8, characterized in that: The player capability management system is configured to obtain capability component information based on the response information, and to match and install the capability components corresponding to the acquisition device based on the capability component information.

10. The electronic device according to claim 9, characterized in that: The player capability management system is configured to be at least one of the following: Based on the capability component information, search the local component list and install the capability component corresponding to the found acquisition device; Based on the capability component information, the local component list is searched to obtain the missing capability list. A component request is sent based on the missing capability list to obtain and install the capability components in the missing capability list.

11. The electronic device according to claim 10, characterized in that: The player capability management system is configured to add capability components from the missing capability list to the local component list.

12. The electronic device according to claim 11, characterized in that: The player capability management system is configured to load the capability components corresponding to the acquisition device into the player.

13. The electronic device according to any one of claims 7 to 12, characterized in that, The player capability management system includes at least: Capability matching module and capability loading module; The capability matching module can match the capabilities of the media content acquisition device, and the capability loading module can install the capability components corresponding to the acquisition device.

14. An Internet of Things (IoT) system, characterized in that, The system includes at least: Media acquisition equipment, Internet of Things (IoT) platforms, electronic devices; The media acquisition device and the Internet of Things platform are communicatively connected; The IoT platform and the media player are connected in communication. The media acquisition device is configured to acquire media content and send the media content to the Internet of Things platform; The IoT platform is configured to send the media content to the electronic device and, in response to a request from the electronic device, send a response message generated according to a capability model, wherein the capability model is used to characterize the capability components required to play media content from the media acquisition device. The electronic device is configured to match the capability components required for playing media content from the media acquisition device and load the required capability components into the player of the electronic device.

15. An electronic device comprising: A memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that the processor, when executing the computer program, implements the method as described in any one of claims 1 to 6.

16. A computer-readable storage medium storing computer-executable instructions for performing the method according to any one of claims 1 to 6.

17. A computer program product, comprising a computer program or computer instructions, characterized in that, The computer program or the computer instructions are stored in a computer-readable storage medium, and the processor of the computer device reads the computer program or the computer instructions from the computer-readable storage medium. The processor executes the computer program or the computer instructions, causing the computer device to perform the method as described in any one of claims 1 to 6.

Images