Adaptive media sharing methods and systems

Abstract

This invention discloses an adaptive media sharing method and system. The method includes devices within a local area network (LAN) that support media sharing forming a media node network through a device discovery mechanism. After forming the media node network, the devices initiate media sharing, constructing a media sharing network. Data source nodes retrieve media data from the data source and, based on the media sharing network composed of the data source nodes and data presentation nodes, deliver the media data to each participating data presentation node. The data presentation nodes are responsible for receiving and processing the media data received from the data source and presenting it. This invention enables real-time media sharing anytime, anywhere among multiple devices within a LAN.

Description

Technical Field

[0001] This invention belongs to the field of media technology, specifically relating to an adaptive media sharing method and system. Background Technology

[0002] With the rapid development of internet and media technologies, media application terminals have become increasingly diversified, ranging from traditional televisions and computers to mobile phones and tablets, from elevator screens and outdoor large screens to smart cockpits. The presentation methods of media applications on these terminals are also becoming more diverse. Screens of all sizes are breaking free from their original constraints of work, commercial promotion, or private entertainment, and are trending towards convergence, interconnection, and sharing. Especially in shared spaces on local area networks, the desire to watch dramas or sports games together, and to share media content from individuals or the internet at any time, necessitates multi-terminal media sharing technologies to meet these needs.

[0003] Current mainstream media sharing technologies, such as those used in shopping malls and supermarkets, rely heavily on traditional video splitters and distributors, which are limited by hardware and physical distance. Other examples include MiraCast (a wireless display standard based on Wi-Fi Direct, developed by the Wi-Fi Alliance in 2012), DLNA (Digital Living Network Alliance), and AirPlay (Apple's AirPlay technology), which are primarily designed for point-to-point data projection from small screens to large screens and do not support multi-device applications.

[0004] One possible way to address this media sharing need is for all terminal devices to access a shared data source and use a synchronization mechanism to achieve simultaneous viewing. However, this approach is limited by repeatedly accessing the same data source, which wastes both bandwidth and authorization.

[0005] Another implementation technique involves the initiator of the sharing, using themselves as the central point, to distribute the content to be shared to other devices participating in the sharing. The drawback of this approach is that the central device is tightly bound to the shared resource. If the central device malfunctions or needs to perform other tasks, the current sharing session ends prematurely, and the sharing session can only be restarted. This results in a very poor experience in terms of the continuity and smoothness of the sharing process.

[0006] Furthermore, the mainstream content ecosystem generally provides multimedia content using unified technical specifications. For example, most internet video content uses H.264 / H.265 encoding, and the vast majority of terminal devices support these encoding formats. However, there are exceptions, such as the AVS series encoding algorithms, which are not supported by a large number of terminal devices. Similarly, many low-end or older devices do not support the more advanced 8K / 4K technologies. Small-screen devices are unable to process and display ultra-high-definition content; standard-definition content may be more suitable for them. Some specific data sources use unique formats / protocols that ordinary terminals cannot support. All of these factors hinder the application and widespread adoption of distributed multimedia systems. Summary of the Invention

[0007] The technical problem to be solved by the present invention is to provide an adaptive media sharing method and system that enables multiple devices in a local area network to share media anytime and anywhere.

[0008] To solve the above-mentioned technical problems, the present invention adopts the following technical solution:

[0009] In a first aspect, embodiments of the present invention provide an adaptive media sharing method, comprising the following steps:

[0010] Within a local area network, devices that support media sharing functions can form a media node network by using a device discovery mechanism. Newly added devices and existing online devices can form a media node network. The information on newly added devices includes device capability information.

[0011] After a media node network is formed through the device discovery mechanism, the devices initiate media sharing to build a media sharing network.

[0012] The data source node pulls media data from the data source and delivers the media data to each data presentation node participating in the sharing, based on the media sharing network composed of the data source node and the data presentation node.

[0013] The data presentation node is used to receive and process media data received from the data source for presentation;

[0014] The format conversion node is used to receive data from the specified data source node, process it, and deliver the processed media data to the specified data presentation node.

[0015] In one possible design of the first aspect, the device capability information includes at least one of the following: the type of node the device can create, audio / video encoding / decoding capabilities, protocol and file format input / output support, video output capabilities, audio output capabilities, the network environment, and available network bandwidth.

[0016] In one possible design of the first aspect, devices within the local area network that support media sharing functionality form a media node network through a device discovery mechanism, consisting of newly added devices and existing online devices.

[0017] Based on the given multicast network address, the new device is declared online;

[0018] When other online devices in the multicast network receive a new device coming online information packet, they process and determine the networking conditions within the packet. If the conditions are not met, they do not process the packet; if they are met, they record the new device's information and communication address, add the new device to their own list of online devices, and simultaneously send back a response containing their own device information and information on other devices that meet the networking conditions, based on the communication address provided by the new device. Upon receiving the response packet from an online device, the new device adds the responding device and other devices included in the information packet to its own list of online devices.

[0019] The new equipment and the existing online equipment form a media node network.

[0020] In one possible design of the first aspect, the new device online information further includes the device's unique identifier, device communication address, device performance indicators, device online periodic update cycle, and response requirements of other online devices for network formation judgment, wherein the response requirements include specifying the application type as media sharing.

[0021] In one possible design of the first aspect, after a media node network is formed through an inter-device discovery mechanism, the devices initiate media sharing, and the construction of the media sharing network includes:

[0022] The device that initiates media sharing becomes the master device, creates a media sharing session, and starts the session management module, which is used to manage the current media sharing session.

[0023] The address information for inter-device communication provided by the device discovery is used as the signaling channel, and the master device notifies other devices on the network to join the media sharing session;

[0024] The device that agrees to join the session becomes a slave device;

[0025] The session management module obtains the capability information of the added slave devices and matches them. For devices with mismatched capabilities, it finds devices that support format conversion and creates a format conversion node to provide data format conversion services specifically for the mismatched devices; or it creates multiple data source nodes to provide services for devices with different capabilities.

[0026] The master device creates data presentation nodes on each slave device that joins the session;

[0027] The session management module of the main device records and manages information about each device and the member nodes contained in the device, plans and records the data transmission path from the data source node to the data presentation node, and sends it to each node through the signaling channel;

[0028] Media data distribution channels are established between the data source nodes and each data presentation node according to the planned transmission path, completing the media sharing network networking associated with the current session.

[0029] In one possible design of the first aspect, during the media data sharing process, if the device of the data source node leaves, the master device selects another suitable device in the current session and notifies that device to create a new data source node; the master device re-plans and records the path from the new data source node to other data presentation nodes through the session management module and distributes it to each node; each data node forms a media sharing network according to the new path and sends or receives data based on the new network.

[0030] In one possible design of the first aspect, during the media data sharing process, if the master device leaves or does not want to assume the responsibilities of the master device, the master device's permissions are transferred to other devices in the current session, and the successor slave device becomes the master device, creating and running the session management module on the new master device.

[0031] In one possible design of the first aspect, if the device to which the running data source node belongs is the master device, the data source node is migrated to another device in the session before transferring the master device's permissions.

[0032] In one possible design of the first aspect, during the media data sharing process, if the slave device associated with the format conversion node leaves, the master device notifies the format conversion node to release resources.

[0033] Secondly, embodiments of the present invention provide an adaptive media sharing system, including multiple terminals.

[0034] The multiple terminals are set up in the local area network and support media sharing. Through the device discovery mechanism, newly online devices and existing online devices form a media node network. The information on newly online devices includes device capability information.

[0035] The device initiating media sharing becomes the master device, creates a media sharing session, and starts the session management module. Using the address information for inter-device communication provided by device discovery as the signaling channel, the master device notifies other devices on the network to join the media sharing session. Devices joining the session become slave devices. The session management module obtains the capability information of the joining slave devices for matching. For devices with mismatched capabilities, it searches for devices that support format conversion and creates a format conversion node to provide dedicated data format conversion services for these devices; or it creates multiple data source nodes to provide services for devices with different capabilities. The master device sets up the data source nodes and sets other devices joining the session as data presentation nodes. The master device's session management module plans the data transmission path based on the information of each member node and sends it to each node through the signaling channel. Media data distribution channels are established between the data source nodes and each data presentation node according to the planned transmission path, completing the media sharing network configuration associated with the current session.

[0036] The data source node is used to pull media data from the data source, process it, and distribute it to the various data presentation nodes participating in the sharing; the data presentation node is used to receive and process the media data received from the data source node; the format conversion node is used to receive data from the specified data source node, process it, and deliver the processed media data to the specified data presentation node.

[0037] In one possible design of the second aspect, during the media data sharing process, if the device of the data source node leaves, the master device selects another suitable device in the current session and notifies that device to create a new data source node; the master device re-plans and records the path from the new data source node to other data presentation nodes through the session management module and distributes it to each node; each data node builds a media sharing network according to the new path and sends or receives data based on the new network.

[0038] In one possible design of the second aspect, during the media data sharing process, if the master device leaves or does not want to assume the responsibilities of the master device, the master device's permissions are transferred to other devices in the current session, and the successor slave device becomes the master device, creating and running the session management module on the new master device.

[0039] In one possible design of the second aspect, if the device to which the running data source node belongs is the master device, the data source node is migrated to another device in the session before transferring the master device's permissions.

[0040] In one possible design of the second aspect, during the media data sharing process, if the slave device associated with the format conversion node leaves, the master device notifies the format conversion node to release resources.

[0041] The present invention has the following beneficial effects:

[0042] (1) Decentralized device discovery mechanism. This customizable and lightweight device discovery mechanism does not require additional registration or management server deployment and participation, ensuring that different types of terminal devices in the local area network can flexibly configure networking conditions based on their own unique needs, discover each other quickly and reliably across terminals, and build a decentralized media node network, laying the foundation for the subsequent implementation of media sharing functions.

[0043] (2) The decentralized media sharing mechanism ensures the continuous and effective operation of the media sharing system: the main device and data source node responsible for sharing session management are separated, optimizing the system's operating capabilities. The data source node is responsible for pulling, processing, and distributing media data, and has the heaviest workload in the media sharing system. The main device can evaluate the capabilities of each device participating in the session, including itself, and select the most suitable device as the data source node, thereby maximizing the allocation of capabilities as a whole system.

[0044] (3) The data source node and the actual physical device are decoupled, and the master and slave devices can be flexibly switched to ensure the continuous and effective operation of the media sharing system. During the sharing process, if the device where the data source node is located is abnormal or leaves, the master device can migrate the data source node to other devices through the session management module; if the master device wants to become a slave device or wants to leave the session, it can promptly transfer the master device's permissions to other slave devices participating in the session to ensure that the sharing continues effectively.

[0045] (4) In view of the fact that there are many types of terminals and different playback capabilities in the above system, the application can understand the capabilities of each terminal before sharing begins, and has the opportunity to choose the most compatible method (encoding method, streaming media format, etc.) for sharing; at the same time, for the case of mismatched capabilities, a data format conversion mechanism is also introduced to adapt to various types of terminals to the greatest extent. Attached Figure Description

[0046] Figure 1 This is a flowchart illustrating the steps of an adaptive media sharing method according to an embodiment of the present invention.

[0047] Figure 2 This is a flowchart illustrating the device discovery and networking steps in the adaptive media sharing method according to an embodiment of the present invention.

[0048] Figure 3 This is a flowchart of the media sharing network steps in the adaptive media sharing method of this invention.

[0049] Figure 4 This is a flowchart illustrating another step in the adaptive media sharing method of this invention: media sharing networking.

[0050] Figure 5This is a diagram showing the relationship between data source nodes, data presentation nodes, and physical devices in an adaptive media sharing system according to an embodiment of the present invention.

[0051] Figure 6 This is a diagram showing the relationship between another data source node, data presentation node, and physical device in the adaptive media sharing system of this invention.

[0052] Figure 7 This is a schematic diagram of data source node switching in an adaptive media sharing system according to an embodiment of the present invention;

[0053] Figure 8 This is a schematic diagram of master device switching in an adaptive media sharing system according to an embodiment of the present invention;

[0054] Figure 9 This is a schematic diagram of a format conversion node in an adaptive media sharing system according to an embodiment of the present invention. Detailed Implementation

[0055] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0056] In this embodiment of the invention, the relevant technical terms are defined as follows: Device refers to a hardware terminal with data transmission and reception capabilities or audio / video encoding / decoding, rendering, and output capabilities. Node refers to a hardware or software module participating in the sharing process, possessing corresponding audio / video reception, processing, and playback capabilities. Networking refers to the process of determining the connection and communication methods between nodes, which can generally be Ethernet, wireless network (including but not limited to WiFi, Bluetooth, cellular data network), etc. Data source can be audio / video files, streaming media links transmitted over a network, or a camera or screen projection on a device; it can also be a list combining multiple data sources. Data source node refers to the node responsible for reading data from the data source and sending it to other nodes in the session. Data presentation node is responsible for receiving and processing data from the data source node and presenting the processed data content. A session corresponds to a sharing instance, containing at least one data source node and more than one data presentation node. Master device refers to a participant in the current session who has management permissions (running a management module, which may or may not include any nodes). Slave device refers to a participant in the current session (containing at least one node of any type). It should be further noted that one or more nodes can run on a single physical device.

[0057] Reference Figure 1The diagram shows a flowchart of the adaptive media sharing method according to an embodiment of the present invention, including the following steps:

[0058] Within a local area network, devices that support media sharing functions can form a media node network by using a device discovery mechanism. Newly added devices and existing online devices can form a media node network. The information on newly added devices includes device capability information.

[0059] After a media node network is formed through the device discovery mechanism, the devices initiate media sharing to build a media sharing network.

[0060] The data source node pulls media data from the data source and delivers the media data to each data presentation node participating in the sharing, based on the media sharing network composed of the data source node and the data presentation node.

[0061] The data presentation node is used to receive and process media data received from the data source for presentation;

[0062] Format conversion nodes are used to receive data from one or more specified data source nodes, process it, and then deliver the processed media data to the specified data presentation node. Common processing includes encoding format conversion, streaming media format conversion, and image editing (scaling, compositing, cropping, overlaying, etc.).

[0063] This paper presents an adaptive media sharing method based on decentralized networking, applied within a local area network (LAN), to enable real-time sharing of specific multimedia resources, such as images, audio, or video, across multiple devices. When a device comes online, its capabilities are acquired. For cases of capability mismatch, a data format conversion node is introduced to maximize compatibility with various terminal types.

[0064] See Figure 2 The diagram illustrates the process by which devices supporting media sharing functionality within a local area network (LAN) form a media node network through a device discovery mechanism in an adaptive media sharing method according to an embodiment of the present invention. The main steps include:

[0065] Based on a given multicast network address, the new device announces its online status. This online status information further includes: the device's unique identifier; the device's communication address information, such as the address and port associated with HTTP / TCP / UDP; basic device performance indicators, including but not limited to CPU and memory information; responses from other online devices for network configuration determination, such as device type, application type, and custom fields. This invention must specify the application type as media sharing; and the device's periodic online update cycle to facilitate detection by other online devices to ensure the device is functioning correctly.

[0066] When other online devices in the multicast network receive a new device coming online information packet, they process and determine the networking conditions within the packet. If the conditions are not met, they do not process it. If the conditions are met, they record the new device's information and communication address, add the new device to their maintained list of online devices, and send back a response message based on the communication address provided by the new device, along with the information of their own device and other devices maintained by the device that meet the networking conditions.

[0067] When a new device receives a response packet from an online device, it adds the responding device and other devices included in the packet to its own list of online devices. By attaching other devices to the response device's packet, it can quickly discover some online devices that failed to respond in time due to packet loss, resolving the issues of slow or undiscoverable device discovery.

[0068] Through the above-described custom lightweight device discovery mechanism, newly launched devices and existing online devices form a decentralized media node network. Nodes can connect freely, and each device is a node on the network with equal status.

[0069] See Figure 3 The diagram illustrates the process of a device initiating media sharing and constructing a media sharing network after a media node network is formed through a device discovery mechanism, according to an embodiment of the adaptive media sharing method of the present invention. The following describes the situation where a media sharing session is created between devices, mainly including the following steps:

[0070] The local area network includes devices A, B, C, D, E, F, G, and T.

[0071] Device T is a device with special encoding and decoding capabilities (supporting AVS3 decoding and H.264 encoding), and a format conversion node is created.

[0072] Device A, the device that initiates media sharing, becomes the master device, creates a media sharing session, and starts the session management module. The session management module is used to manage the current media sharing session, including but not limited to data transmission path planning and management of all member nodes, including data source nodes and data presentation nodes.

[0073] The device discovery provides the address information for inter-device communication, which is used as a signaling channel. Device A, as the master device, notifies other devices on the network to join the media sharing session.

[0074] In a local area network, devices B, C, and D agree to join a session, and the devices that agree to join the session become slave devices; at this time, signaling channels are formed between devices A, B, C, and D.

[0075] The master device creates a data source node on a specific terminal. Here, device A is the data source node, but it doesn't have to be the local machine.

[0076] Each slave device that joins the session creates a data presentation node, i.e., device B, device C, and device D become data presentation nodes; the master device A can also be a data presentation node.

[0077] The master device's session management module records and manages information about each device and its member nodes, plans and records the data transmission path from the data source node to the data presentation node, and distributes it to each node via the signaling channel.

[0078] Media data distribution channels are established between the data source nodes and each data presentation node according to the planned transmission path, completing the media sharing network networking associated with the current session.

[0079] It is understandable that multiple media sharing sessions can be created simultaneously between devices within a local area network (LAN). See [link / reference] Figure 4 The following steps illustrate how to create two media sharing sessions:

[0080] Multiple devices A, B, C, D, E, F, and G within a local area network discover each other through a device discovery mechanism, building an interconnected media node network.

[0081] When device A receives a media sharing request instruction, device A becomes the master device, creates a media sharing session, and starts the session management module.

[0082] Based on the capability assessment among A, B, C, and D, the main device A creates a data source node and a data presentation node on its own end.

[0083] Devices B, C, and D join the session, become slave devices, and create data presentation nodes;

[0084] The main device A plans the media data sharing path, and the data source node, data presentation node on device A, and data presentation nodes on other devices B, C, and D construct the media sharing network 1;

[0085] At the same time, device E receives a media sharing request instruction, device E becomes the master device, creates a media sharing session, and starts the session management module;

[0086] Based on the capability assessment among E, F, and G, the main device E creates a data source node and a data presentation node on its local end;

[0087] Devices F and G join the session, become slave devices, and create data presentation nodes;

[0088] The main device E plans the media data sharing path, and the data source nodes and data presentation nodes on device E, as well as the data presentation nodes on other devices F and G, construct the media sharing network 2.

[0089] After establishing the media sharing network, the focus will be on the data sharing process. In an adaptive media sharing method according to an embodiment of the present invention, the data sharing process is as follows:

[0090] Data source nodes pull data from data sources, including images, audio, and video, depending on the data source. Based on the media sharing network composed of data source nodes and data presentation nodes, raw or processed media data is delivered to the various data presentation nodes participating in the sharing.

[0091] The data presentation node is responsible for receiving and processing media data received from the data source, and presenting the shared media data in an audible and visual form through hardware such as speakers or displays.

[0092] Furthermore, during media sharing, if a device acting as a data source node leaves, the master device selects another suitable device in the current session and notifies the other suitable device to create a new data source node. The master device then re-plans and records the path from the new data source node to other data presentation nodes through the session management module and distributes it to each data node. Each data node then builds a media sharing network according to the new path and sends or receives data based on the new network.

[0093] Furthermore, during media sharing, if the primary device leaves or no longer wishes to assume its responsibilities, it can transfer its permissions to another device in the current session. The succeeding device then becomes the primary device, creating and running the session management module. If the primary device contains a running data source node, this node must be migrated to another device in the session before transferring primary device permissions. The migration process is the same as the previous step: the primary device selects another suitable device in the current session and notifies it to create a new data source node; the primary device then uses the session management module to re-plan and record the path from the new data source node to other data presentation nodes and distributes it to each data node; each data node then builds a media sharing network according to the new path and sends or receives data based on the new network.

[0094] Corresponding to the method embodiment of the present invention, the embodiment of the present invention provides an adaptive media sharing system, including multiple devices, multiple terminals set in a local area network and supporting media sharing, and a media node network formed by newly online devices and existing online devices through a device discovery mechanism, wherein the information of newly online devices includes device capability information;

[0095] The device initiating media sharing becomes the master device, creates a media sharing session, and starts the session management module. Using the address information for inter-device communication provided by device discovery as the signaling channel, the master device notifies other devices on the network to join the media sharing session. Devices joining the session become slave devices. The session management module obtains the capability information of the joining slave devices for matching. For devices with mismatched capabilities, it searches for devices that support format conversion and creates a format conversion node to provide dedicated data format conversion services for these devices; or it creates multiple data source nodes to provide services for devices with different capabilities. The master device sets up the data source nodes and sets other devices joining the session as data presentation nodes. The master device's session management module plans the data transmission path based on the information of each member node and sends it to each node through the signaling channel. Media data distribution channels are established between the data source nodes and each data presentation node according to the planned transmission path, completing the media sharing network configuration associated with the current session.

[0096] The data source node is used to pull media data from the data source, process it, and distribute it to the various data presentation nodes participating in the sharing; the data presentation node is used to receive and process the media data received from the data source node; the format conversion node is used to receive data from the specified data source node, process it, and deliver the processed media data to the specified data presentation node.

[0097] Data source nodes and data rendering nodes can be on the same or different physical devices. Data source nodes are not necessarily on the primary device; the primary device may optionally include data rendering nodes. See [link to documentation] for the relationship between data source nodes, data rendering nodes, and physical devices. Figure 5 and Figure 6 , Figure 5 In this context, device A is the master device and also the data source node, while devices B, C, and D are data presentation nodes. Figure 6 In this context, device A is the master device, serving as both the data source node and the data presentation node, while devices B, C, and D are the data presentation nodes.

[0098] The initiating media sharing device becomes the master device, creates a media sharing session, and starts the session management module. Using the address information for inter-device communication provided by device discovery as the signaling channel, the master device notifies other devices on the network to join the media sharing session. Devices joining the session become slave devices. The master device sets up a data source node and sets other devices joining the session as data presentation nodes. The master device's session management module plans the data transmission path based on the information of each member node and sends it to each node through the signaling channel. A media data distribution channel is established between the data source node and each data presentation node according to the planned transmission path, completing the media sharing network setup associated with the current session.

[0099] Data source nodes retrieve media data from the data source, process it, and distribute it to the participating data presentation nodes. Data presentation nodes receive and process media data received from the data source nodes. During media data sharing, if a data source node device leaves, the master device selects another suitable device in the current session and notifies that device to create a new data source node. The master device then uses the session management module to re-plan and record the paths from the new data source node to the other data presentation nodes and distributes them to each node. Each data node then forms a media sharing network according to the new paths and sends or receives data based on the new network. See also... Figure 7 The diagram illustrates a data source node switching process in one embodiment, including the following steps:

[0100] Multiple devices A, B, C, and D within a local area network discover each other through a device discovery mechanism, building an interconnected media node network.

[0101] Device A receives a media sharing request instruction, the data source of which is a network video stream transmitted via HTTP. Device A becomes the master device, creates a media sharing session, and starts the session management module. Based on the capability assessment among A, B, C, and D, master device A creates a data source node and a data presentation node on its local end; devices B, C, and D become slave devices and create data presentation nodes.

[0102] The main device A plans the media data sharing path, and the data source nodes on device A and the data presentation nodes on other devices construct a media sharing network;

[0103] The data source node on device A begins to implement the network video stream sharing operation, processes the acquired audio and video data and distributes it to each data presentation node participating in the sharing, and each data presentation node implements the synchronous playback of the video stream.

[0104] During the sharing process, if the main device A no longer wants to handle the processing work of the data source node, it will hand over the data source node to device B. This includes information about the data source, the current processing progress of the data source, such as the number of data bytes already obtained through HTTP requests based on the current HTTP network flow.

[0105] Device A redesigns the data sharing transmission path and builds a new media sharing network based on the newly created data source node on Device B and the data presentation nodes on other devices.

[0106] The data source node on device B continues to acquire and process media data, distributing the media data to the data presentation nodes in the sharing network according to the newly planned transmission path; the sharing process continues.

[0107] During media data sharing, if the primary device leaves or no longer wishes to assume primary device responsibilities, its permissions are transferred to another device in the current session. The succeeding secondary device becomes the primary device, and the session management module is created and runs on the new primary device. If the currently running data source node belongs to the primary device, the data source node is migrated to another device in the session before transferring primary device permissions. See also Figure 8 The process of master-slave device switching is shown, which includes the following steps:

[0108] Multiple devices A, B, C, and D within a local area network discover each other through a device discovery mechanism, building an interconnected media node network.

[0109] Device A receives a media sharing request instruction, the data source of which is a network video stream transmitted over HTTP. Device A becomes the master device, creates a media sharing session, and starts the session management module.

[0110] Based on the capability assessment among ABCD, the master device A is designated to create a data source node on device B; devices B, C, and D become slave devices and create data presentation nodes.

[0111] The main device A plans the media data sharing path, and the data source nodes on device B and the data presentation nodes on other devices construct a media sharing network.

[0112] The data source node on device B begins to implement the network video stream sharing operation, processes the acquired audio and video data and distributes it to each data presentation node participating in the sharing, and each data presentation node implements the synchronous playback of the video stream.

[0113] During the sharing process, if the master device A can no longer perform its functions, it will transfer the master device's permissions and session management information to device B; device A will become a slave device; device B will create and run the session management module. Since the data source node has not changed, the data sharing can continue to operate effectively without any modifications.

[0114] See Figure 9 The diagram illustrates a format conversion process in an adaptive media sharing system according to an embodiment of the present invention, comprising the following steps:

[0115] Multiple devices A, B, C, and D within a local area network discover each other through a device discovery mechanism, building an interconnected media node network. Device B only supports AVS3 standard definition decoding, device C only supports H.264 decoding, while devices A and D both support both AVS3 decoding and H.264 encoding / decoding. Device A is connected to a high-fidelity audio output device.

[0116] Device A receives a media sharing request instruction. The instruction contains a data source that is a multi-bitrate video stream (providing both ultra-high definition and standard definition) transmitted via HTTP.

[0117] As the initiator, Device A becomes the master device, starts the session management module, and creates a media sharing session; then it creates a data source node and a data presentation node on its own end; at the same time, through capability matching, it discovers that it has the best audio output effect;

[0118] A invites devices B, C, and D to watch together in turn:

[0119] A invites B to join the conversation. Based on the capability matching mechanism, it is known in advance that B has limited performance and does not support ultra-high definition image decoding and display. Therefore, the management module creates a new data source node to collect the standard definition stream and delivers the standard definition stream to B; at the same time, it notifies B to mute.

[0120] A invites C to join the session. Based on the capability matching mechanism, A knows in advance that C only supports H.264 decoding and cannot support AVS3 decoding. At the same time, through the device discovery mechanism, A learns that there is a device T in the network that supports AVS3 to H.264 conversion. A then chooses to create a format conversion node on T and specifies that the node should collect data from the data source node on A, convert it into an H.264 media stream that C supports, and then send it to C. A also notifies C to mute.

[0121] A invites D to join the conversation. Based on the capability matching mechanism, A learns that D can support playback of ultra-high definition AVS3, so A shares the ultra-high definition stream with D; at the same time, A notifies D to mute.

[0122] At this time, A needs to handle other tasks temporarily. The data presentation node goes into the background and shuts down video output, while audio output continues as normal. Its data source node and management module continue to work, and other devices also function normally. After A finishes handling its tasks, video output is restored.

[0123] Subsequently, A needs to stop watching and shut down the device for some reason. First, the data presentation node on device A is terminated, and then the data source node is transferred to device D. After the transfer is completed, the data presentation nodes on B and D, as well as the format conversion node on T, all start receiving media streams from the data source node on D. Then, A transfers management rights to B, and the management module on device B becomes the new master device. Device A exits sharing. Since the audio output capabilities of B, C, and D are all average, B decides to use the built-in audio devices on each device to play audio and unmute them.

[0124] When C exits the viewing, the data presentation node on device C terminates. The management module on B determines that T's format conversion capability is no longer needed, so T ends the work of the format conversion node and exits the session.

[0125] D exits the viewing. Since only B remains, the standard definition stream data source node is rebuilt on B to support the local playback.

[0126] B has finished watching. The session has ended because the last presented node has exited.

[0127] Further reference Figure 9 The image shown illustrates a screen compositing process in an adaptive media sharing system according to an embodiment of the present invention, comprising the following steps:

[0128] Multiple devices A, B, C, and D on a local area network discover each other through a device discovery mechanism, building an interconnected media node network. Device D receives an instruction to simultaneously view video locally and display three different video streams provided by devices A, B, and C. Device D activates the session management module to create a media sharing session. After capability matching, the session management module finds that its local performance is insufficient to support simultaneous playback of three video streams. It also discovers that a device T on the network can provide format conversion capabilities for image compositing. Therefore, data source nodes are created on A, B, and C, and a format conversion node is created on T, which is specified to receive data from the data source nodes on A, B, and C, perform image compositing, and output a video stream suitable for playback on device D. Finally, a data presentation node is created on D for playback.

[0129] Those skilled in the art will understand that, in order to avoid excessive redundancy in the description of the implementation process of the technical solution, the technical details of the implementation process of the media sharing and data protection method and the media sharing and data protection system of the present invention can be referred to each other, and will not be repeated here.

[0130] It should be understood that the exemplary embodiments described herein are illustrative and not restrictive. Although one or more embodiments of the invention have been described in conjunction with the accompanying drawings, those skilled in the art will understand that various changes in form and detail may be made without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. An adaptive media sharing method, characterized in that, Includes the following steps: Within a local area network, devices that support media sharing functionality can form a media node network by using a device discovery mechanism. Newly added devices and existing online devices can then be connected together. Information about newly added devices includes device capability information. After a media node network is formed through the device discovery mechanism, the devices initiate media sharing to build a media sharing network. The data source node pulls media data from the data source and delivers the media data to each data presentation node participating in the sharing, based on the media sharing network composed of the data source node and the data presentation node. The data presentation node is used to receive and process media data received from the data source for presentation; The format conversion node is used to receive data from the specified data source node, process it, and deliver the processed media data to the specified data presentation node. After a media node network is formed through an inter-device discovery mechanism, the devices initiate media sharing. The construction of the media sharing network includes: The device that initiates media sharing becomes the master device, creates a media sharing session, and starts the session management module, which is used to manage the current media sharing session. The address information for inter-device communication provided by the device discovery is used as the signaling channel, and the master device notifies other devices on the network to join the media sharing session; The device that agrees to join the session becomes a slave device; The session management module obtains the capability information of the added slave devices and matches them. For devices with mismatched capabilities, it finds devices that support format conversion and creates a format conversion node to provide data format conversion services specifically for the mismatched devices; or it creates multiple data source nodes to provide services for devices with different capabilities. The master device creates data presentation nodes on each slave device that joins the session; The session management module of the main device records and manages information about each device and the member nodes contained in the device, plans and records the data transmission path from the data source node to the data presentation node, and sends it to each node through the signaling channel; Media data distribution channels are established between the data source nodes and each data presentation node according to the planned transmission path, completing the media sharing network networking associated with the current session; During media data sharing, if a data source node device leaves, the master device selects another device in the current session and notifies that device to create a new data source node. The master device then re-plans and records the path from the new data source node to other data presentation nodes through the session management module and distributes it to each node. Each data node then builds a media sharing network according to the new path and sends or receives data based on the new network. During media data sharing, if the master device leaves or no longer wishes to assume the responsibilities of the master device, it transfers the master device's permissions to another device in the current session. The succeeding slave device becomes the master device, and a session management module is created and run on the new master device.

2. The adaptive media sharing method as described in claim 1, characterized in that, The device capability information includes at least one of the following: the type of node the device can create, audio / video encoding / decoding capabilities, protocol and file format input / output support, video output capabilities, audio output capabilities, the network environment, and available network bandwidth.

3. The adaptive media sharing method as described in claim 1, characterized in that, Within a local area network (LAN), devices supporting media sharing are discovered through a device discovery mechanism. Newly added devices and existing online devices form a media node network, including: Based on the given multicast network address, the new device is declared online; When other online devices in the multicast network receive a new device coming online information packet, they process and determine the networking conditions within the packet. If the conditions are not met, they do not process the packet; if they are met, they record the new device's information and communication address, add the new device to their own list of online devices, and simultaneously send back a response containing their own device information and information on other devices that meet the networking conditions, based on the communication address provided by the new device. Upon receiving the response packet from an online device, the new device adds the responding device and other devices included in the information packet to its own list of online devices. The new equipment and the existing online equipment form a media node network.

4. The adaptive media sharing method as described in claim 1, characterized in that, The new device online information further includes the device's unique identifier, device communication address, device performance indicators, device online periodic update cycle, and response requirements of other online devices for network formation judgment. The response requirements include specifying the application type as media sharing.

5. The adaptive media sharing method as described in claim 1, characterized in that, If the device to which the running data source node belongs is the primary device, migrate the data source node to another device in the session before transferring the primary device permissions.

6. The adaptive media sharing method as described in claim 1, characterized in that, During media data sharing, if the slave device associated with the format conversion node leaves, the master device notifies the format conversion node to release resources.

7. An adaptive media sharing system, characterized in that, Including multiple terminals, The multiple terminals are set up in a local area network and support media sharing. Through the device discovery mechanism, newly online devices and existing online devices form a media node network. The information on newly online devices includes device capability information. The device that initiates media sharing becomes the master device, creates a media sharing session, and starts the session management module; The address information for inter-device communication provided by the device discovery is used as the signaling channel. The master device notifies other devices on the network to join the media sharing session. Devices that join the session become slave devices. The session management module obtains the capability information of the joined slave devices and matches them. For devices with mismatched capabilities, it finds devices that support format conversion and creates a format conversion node to provide dedicated data format conversion services for devices with mismatched capabilities; or it creates multiple data source nodes to provide services for devices with different capabilities. The master device is configured as the data source node, and other devices that join the session are configured as data presentation nodes. The session management module of the main device plans the data transmission path based on the information of each member node and sends it to each node through the signaling channel; the data source node and each data presentation node establish a media data distribution channel according to the planned transmission path to complete the media sharing network networking associated with the current session; The data source node is used to pull media data from the data source, process it, and then distribute it to the various data presentation nodes that participate in the sharing. The data presentation node is used to receive and process media data received from the data source node; The format conversion node is used to receive data from the specified data source node, process it, and deliver the processed media data to the specified data presentation node. During media data sharing, if the data source node device leaves, the master device selects another device in the current session and notifies that device to create a new data source node. The master device re-plans and records the path from the new data source node to other data presentation nodes through the session management module, and distributes it to each node; each data node builds a media sharing network according to the new path, and sends or receives data based on the new network. During media data sharing, if the master device leaves or no longer wishes to assume the responsibilities of the master device, it transfers the master device's permissions to another device in the current session. The succeeding slave device becomes the master device, and a session management module is created and run on the new master device.

8. The adaptive media sharing system as described in claim 7, characterized in that, If the device to which the running data source node belongs is the primary device, migrate the data source node to another device in the session before transferring the primary device permissions.

9. The adaptive media sharing system as described in claim 7, characterized in that, During media data sharing, if the slave device associated with the format conversion node leaves, the master device notifies the format conversion node to release resources.

Images