A data flow conversion method, device and storage medium

Abstract

The application discloses a data flow transfer method and device, and a storage medium. A flow transfer operation device acquires first media capability information of a first flow endpoint in a flow transfer destination device; acquires second media capability information of a second flow endpoint in a data source device; wherein the first flow endpoint and the second flow endpoint are in an unused working state; when the first media capability information and the second media capability information are consistent, a flow establishment request is sent to the flow transfer destination device; wherein the flow establishment request is used to instruct the flow transfer destination device to establish a flow data transmission channel with the data source device. The embodiment of the application does not need to perform mandatory standardization on audio and video capabilities of the device, the device presents its own audio and video capabilities in a flow endpoint mode, audio and video capability discovery and parameter negotiation are automatically performed in a data flow process, and device development and capability expansion are facilitated.

Description

Technical Field

[0001] This invention relates to the field of data transfer technology, and in particular to a data transfer method, device and storage medium. Background Technology

[0002] A distributed communication system refers to a system that integrates different smart devices into a local network. Each device provides different functions based on its own capabilities, and the functional modules of different devices can communicate and collaborate with each other. Finally, the functions of the devices within the network are aggregated and uniformly provided to the outside world, forming a super-large virtual device. In real-world scenarios, data flows between different devices; however, this requires mandatory standardization of the devices' audio and video capabilities, making it difficult to expand device functionality. Summary of the Invention

[0003] This invention provides a data transfer method, device, and storage medium to solve the problem in the prior art where the data transfer process requires the mandatory standardization of the device's audio and video capabilities, making it difficult to expand the device's functionality.

[0004] To achieve the above objectives, embodiments of the present invention provide a data transfer method applied to a data transfer operation device, the data transfer method comprising:

[0005] Obtain the first media capability information of the first stream endpoint in the destination device;

[0006] Obtain the second media capability information of the second stream endpoint in the data source device; wherein the first stream endpoint and the second stream endpoint are in an unused working state;

[0007] When the first media capability information and the second media capability information are consistent, a stream establishment request is sent to the streaming destination device; wherein, the stream establishment request is used to instruct the streaming destination device to establish a stream data transmission channel with the data source device.

[0008] As an improvement to the above solution, obtaining the first media capability information of the first streaming endpoint in the destination device includes:

[0009] Send a first-stream endpoint discovery request to the destination device;

[0010] Receive the ID of the first stream endpoint in the destination device, sent by the destination device based on the first stream endpoint discovery request;

[0011] Send a first query media capability request to the destination device of the stream, wherein the first query media capability request carries at least the ID of the first stream endpoint;

[0012] Receive the first media capability information of the first streaming endpoint sent by the destination device based on the first query media capability request.

[0013] As an improvement to the above solution, obtaining the second media capability information of the second stream endpoint in the data source device includes:

[0014] Send a second-stream endpoint discovery request to the data source device;

[0015] Receive the ID of the second stream endpoint in the data source device, sent by the data source device based on the second stream endpoint discovery request;

[0016] Send a second query media capability request to the data source device, the second query media capability request carrying at least the ID of the second stream endpoint;

[0017] Receive the second media capability information of the second streaming endpoint sent by the data source device based on the second query media capability request.

[0018] As an improvement to the above scheme, the step of sending a stream establishment request to the streaming destination device when the first media capability information and the second media capability information are consistent includes:

[0019] When the first media capability information and the second media capability information are consistent, the streaming data transmission channel between the data source device and the streaming operation device is destroyed and released;

[0020] Obtain the destination device ID corresponding to the first media capability information, and send a stream establishment request to the destination device of the device ID.

[0021] As an improvement to the above solution, before the data transfer destination device and the data source device establish a data transfer channel, the data transfer method further includes:

[0022] Obtain the third media capability information of the third stream endpoint in the flow operation device; wherein the third stream endpoint is in an unused working state;

[0023] When the third media capability information is consistent with the second media capability information, a streaming data transmission channel is established with the data source device through the third streaming endpoint and the second streaming endpoint.

[0024] As an improvement to the above scheme, before obtaining the first media capability information of the first streaming endpoint in the destination device, the data transfer method further includes:

[0025] The first number of streaming endpoints in the destination device that are in use is obtained, so as to obtain the first media capability information of the first streaming endpoint in the destination device when the first number is less than a preset first number threshold.

[0026] Before acquiring the second media capability information of the second stream endpoint in the data source device, the data transfer method further includes:

[0027] The second number of streaming endpoints in the data source device that are in use is obtained, in order to obtain the second media capability information of the second streaming endpoints in the data source device when the second number is less than a preset second number threshold.

[0028] To achieve the above objectives, embodiments of the present invention also provide a data transfer method applied to a data source device, the data transfer method comprising:

[0029] Send the second media capability information of the second stream endpoint in the data source device to the streaming operation device; wherein the second stream endpoint is in an unused working state;

[0030] When the destination device receives the stream establishment request sent by the stream operation device, a stream data transmission channel is established with the destination device.

[0031] Wherein, if the first media capability information and the second media capability information of the first stream endpoint in the destination device are consistent, the destination device receives the stream establishment request sent by the stream operation device, and the first stream endpoint is in an unused working state.

[0032] As an improvement to the above solution, before establishing a data transfer channel with the destination device, the data transfer method includes:

[0033] When the second media capability information is consistent with the third media capability information of the third stream endpoint in the streaming operation device, a streaming data transmission channel is established with the streaming operation device through the second stream endpoint and the third stream endpoint; wherein the third stream endpoint is in an unused working state.

[0034] As an improvement to the above solution, sending the second media capability information of the second stream endpoint in the data source device to the streaming operation device includes:

[0035] Receive a second stream endpoint discovery request sent by the streaming operation device, and send the ID of the second stream endpoint in the data source device to the streaming operation device;

[0036] The system receives a second media capability query request sent by the streaming operation device and sends the second media capability information of the second streaming endpoint to the streaming operation device; the second media capability query request carries at least the ID of the second streaming endpoint.

[0037] To achieve the above objectives, embodiments of the present invention also provide a data transfer method applied to a destination device, the data transfer method comprising:

[0038] Send the first media capability information of the first streaming endpoint in the streaming destination device to the streaming operation device; wherein the first streaming endpoint is in an unused working state;

[0039] Receive the stream establishment request sent by the stream operation device and establish a stream data transmission channel with the data source device;

[0040] Specifically, if the first media capability information and the second media capability information of the second stream endpoint in the data source device are consistent, a stream establishment request is received from the stream operation device, and the second stream endpoint is in an unused working state.

[0041] To achieve the above objectives, embodiments of the present invention also provide a data transfer device, including a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein the processor implements the data transfer method as described above when executing the computer program.

[0042] To achieve the above objectives, embodiments of the present invention also provide a computer-readable storage medium, the computer-readable storage medium including a stored computer program; wherein, when the computer program is executed, it controls the device where the computer-readable storage medium is located to perform the data transfer method as described above.

[0043] Compared with the prior art, the present invention provides a data transfer method, device, and storage medium. The transfer operation device acquires first media capability information of a first stream endpoint in the transfer destination device; acquires second media capability information of a second stream endpoint in the data source device; wherein the first stream endpoint and the second stream endpoint are in an unused working state; when the first media capability information and the second media capability information are consistent, a stream establishment request is sent to the transfer destination device to establish a stream data transmission channel between the transfer destination device and the data source device. There is no need to forcibly standardize the audio and video capabilities of the device. The device presents its own audio and video capabilities through the stream endpoint method, and automatically performs audio and video capability discovery and parameter negotiation during the data flow process, which facilitates device development and capability expansion. Attached Figure Description

[0044] Figure 1This is a flowchart of a data transfer method provided in an embodiment of the present invention;

[0045] Figure 2 This is another flowchart of a data transfer method provided in an embodiment of the present invention;

[0046] Figure 3 This is another flowchart of a data transfer method provided in an embodiment of the present invention;

[0047] Figure 4 This is a flowchart of the stream establishment process provided in an embodiment of the present invention;

[0048] Figure 5 This is a flowchart of the data transfer process provided in an embodiment of the present invention;

[0049] Figure 6 This is an example diagram of the media capabilities of a streaming endpoint provided in an embodiment of the present invention;

[0050] Figure 7 This is a schematic diagram of the streaming endpoint connection for audio collected by device A and played on device B, provided in an embodiment of the present invention.

[0051] Figure 8 The video streaming device provided in this embodiment of the invention connects to many devices via streaming endpoints;

[0052] Figure 9 The audio streaming device provided in this embodiment of the invention connects to many devices via streaming endpoints;

[0053] Figure 10 This is a structural block diagram of a data transfer device provided in an embodiment of the present invention;

[0054] Figure 11 This is another structural block diagram of a data transfer device provided in an embodiment of the present invention;

[0055] Figure 12 This is another structural block diagram of a data transfer device provided in an embodiment of the present invention;

[0056] Figure 13 This is a structural block diagram of a data transfer device provided in an embodiment of the present invention. Detailed Implementation

[0057] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0058] The terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of this application, unless otherwise stated, "a plurality of" means two or more.

[0059] It should be noted that, in this embodiment of the invention, the audio and video capabilities (media capabilities) supported by the device are abstracted externally as streaming endpoints, enabling the device to present its media capabilities externally through streaming endpoints. The media capability information of the streaming media includes: supported media codec formats and detailed codec parameter information. An example of streaming endpoint media capabilities can be found in [link to example]. Figure 6 For example, the media capabilities of the TX_EP1 stream endpoint include: media type is audio, channel mode is dual-channel stereo, codec is SBC (low complexity subband codec), and sampling rate is 44.1K, where TX_EP1 is the stream endpoint ID.

[0060] For example, the microphone (or camera) media capabilities of one device can be abstracted as the source endpoint, and the speaker (or screen) media capabilities of another device can be abstracted as the destination endpoint. After establishing a data stream channel between the source and destination endpoints, the streaming data acquired by the device with the source endpoint can be played on the device with the destination endpoint. When a single device supports multiple media formats, the device represents its media capabilities by presenting multiple streaming endpoints. The streaming endpoint information presented by the device includes the streaming endpoint ID, streaming endpoint type (source endpoint, destination endpoint), media type (audio, video), and media capability information. Figure 7 Device A presents the following streaming endpoints: TX_EP1 (media type: audio), TX_EP2 (media type: audio), TX_EP1 (media type: video), and TX_EP2 (media type: video). Device B presents the following streaming endpoints: RX_EP1 (media type: audio), RX_EP2 (media type: audio), and RX_EP1 (media type: video). Device A's TX_EP1 streaming endpoint is used as the source endpoint, and Device B's RX_EP1 streaming endpoint is used as the destination endpoint. Data flow between TX_EP1 and RX_EP1 is established, allowing streaming data from Device A to flow into Device B's RX_EP1 streaming endpoint through TX_EP1.

[0061] Furthermore, when a device supports a new media capability, it simply needs to encapsulate the new media capability as a new streaming endpoint. After publishing the new streaming endpoint, other devices can discover it. Once a device obtains the streaming endpoint ID from the media capabilities of the peer device, it can query the streaming endpoint's media capability information using the streaming endpoint ID.

[0062] Each media capability supported by the device (supported codec formats and detailed codec parameters) is represented by a separate stream endpoint, and a single media capability can correspond to multiple stream endpoints. The device can establish multiple streaming data channels with other devices through multiple stream endpoints to transmit streaming data, realizing a one-to-many connection.

[0063] like Figure 8 Video streaming device A presents the following streaming endpoints: TX_EP1 (media type: video), TX_EP2 (media type: video), TX_EP3 (media type: video), TX_EP4 (media type: video), TX_EP1 (media type: video), TX_EP2 (media type: video), TX_EP3 (media type: video), TX_EP4 (media type: video); Video streaming device B presents the following streaming endpoints: TX_EP1 (media type: video), TX_EP2 (media type: video), TX_EP3 (media type: video), TX_EP4 (media type: video), TX_EP1 (media type: video), TX_EP2 (media type: video), TX_EP3 (media type: video), TX_EP4 (media type: video), TX_EP1 (media type: video), TX_EP2 (media type: video), TX_EP2 (media type: video), TX_EP3 (media type: video), TX_EP4 (media type: video), TX_EP4 (media type: video), TX_EP5 (media type: video), TX_EP6 (media type: video), TX_EP7 (media type: video), TX_EP8 (media type: video), TX_EP9 (media type: video), TX_EP1 (media type: video), TX_EP2 (media type: video) o), TX_EP3 stream endpoint (media type is video), TX_EP4 stream endpoint (media type is video); The stream endpoints presented externally by video streaming device C include: TX_EP1 stream endpoint (media type is video), TX_EP2 stream endpoint (media type is video), TX_EP3 stream endpoint (media type is video), TX_EP4 stream endpoint (media type is video), TX_EP1 stream endpoint (media type is video), TX_EP2 stream endpoint (media type is video), TX_EP3 stream endpoint (media type is video), TX_EP4 stream endpoint (media type is video), TX_EP1 stream endpoint (media type is video), TX_EP2 stream endpoint (media type is video), TX_EP3 stream endpoint (media type is video), TX_EP4 stream endpoint (media type is video). The TX_EP1 stream endpoint of video streaming device B is used as the source endpoint, and the TX_EP1 stream endpoint of video streaming device C is also used as the source endpoint. The RX_EP1 stream endpoint and RX_EP2 stream endpoint of video streaming device A are used as the destination endpoints, realizing one-to-many connection of video streaming devices through stream endpoints.

[0064] like Figure 9Audio streaming device A presents the following streaming endpoints: TX_EP1 (media type: audio), TX_EP2 (media type: audio), TX_EP3 (media type: audio), TX_EP4 (media type: audio), TX_EP1 (media type: audio), TX_EP2 (media type: audio), TX_EP3 (media type: audio), TX_EP4 (media type: audio); Audio streaming device B presents the following streaming endpoints: TX_EP1 (media type: audio), TX_EP2 (media type: audio), TX_EP3 (media type: audio), TX_EP4 (media type: audio), TX_EP1 (media type: audio), TX_EP2 (media type: aud) The audio streaming device C presents the following streaming endpoints: TX_EP1 (audio), TX_EP2 (audio), TX_EP3 (audio), TX_EP4 (audio), TX_EP1 (audio), TX_EP2 (audio), TX_EP3 (audio), TX_EP4 (audio), TX_EP1 (audio), TX_EP2 (audio), TX_EP3 (audio), TX_EP4 (audio), TX_EP1 (audio), TX_EP2 (audio), TX_EP3 (audio), TX_EP4 (audio). The TX_EP1 and TX_EP2 streaming endpoints of video streaming device A are used as source endpoints, the RX_EP1 streaming endpoint of video streaming device B is used as the destination endpoint, and the RX_EP1 streaming endpoint of video streaming device C is used as the destination endpoint, thus enabling one-to-many connections between audio streaming devices through streaming endpoints.

[0065] Furthermore, the device manages connectivity capabilities through the management of the working status of flow endpoints. Flow endpoints on the device primarily have two working states: in use and unused. When a flow endpoint is marked as in use, it is undiscoverable by other devices. When a flow endpoint in use ceases operation, its status is changed to unused, and it becomes discoverable and usable by other devices. When the number of used flow endpoints reaches the device's limit, the device sets its own flow endpoints to undiscoverable, preventing other devices from discovering them and thus hindering the establishment of data flow channels.

[0066] See Figure 1 , Figure 1This is a flowchart of a data transfer method provided in an embodiment of the present invention. The data transfer method is applied to a transfer operation device and includes:

[0067] S11. Obtain the first media capability information of the first stream endpoint in the destination device;

[0068] S12. Obtain the second media capability information of the second stream endpoint in the data source device; wherein, the first stream endpoint and the second stream endpoint are in an unused working state;

[0069] S13. When the first media capability information and the second media capability information are consistent, a stream establishment request is sent to the streaming destination device; wherein, the stream establishment request is used to instruct the streaming destination device to establish a stream data transmission channel with the data source device.

[0070] This invention eliminates the need for mandatory standardization of device capabilities. Devices automatically discover and negotiate audio and video capabilities, facilitating device development and capability expansion. Simultaneously, devices present their audio and video capabilities through streaming endpoints, and manage device connections by controlling the usage status of these endpoints, simplifying multi-device interaction task management. Devices only need to focus on their own media capabilities and publish them to the distributed network via streaming endpoints, without needing to consider the media capabilities of other devices. During data transfer, the distributed network does not need to consider the capabilities of each individual device; the transfer operation device automatically identifies transferable devices in the distributed network and provides them to the user for selection, making data transfer between different devices more convenient and flexible.

[0071] It is understood that before transferring the data from the data source device to the destination device, i.e. before sending a stream establishment request to the destination device, a stream data transmission channel is established between the stream operation device and the data source device for stream data transmission between the stream operation device and the data source device. Thus, in the early stage of this embodiment, a stream data transmission channel is established between the stream operation device and the data source device. After sending a stream establishment request to the destination device, a stream data transmission channel is then established between the destination device and the data source device.

[0072] It is understood that the stream establishment request includes: when the first media capability information and the second media capability information are consistent, the ID of the first stream endpoint corresponding to the first media capability information and the ID of the second stream endpoint corresponding to the second media capability information.

[0073] In this embodiment of the invention, a streaming data transmission channel is established between the corresponding first streaming endpoint and the corresponding second streaming endpoint by using the ID of the corresponding first streaming endpoint and the ID of the corresponding second streaming endpoint, that is, a streaming data transmission channel is established between the streaming destination device and the data source device.

[0074] It is understood that after sending a stream establishment request to the destination device, the stream operation device receives a data stream success message from the destination device upon a successful response to the stream establishment request. This indicates that the destination device and the data source device have successfully established a stream data transmission channel, thus realizing the data stream method.

[0075] In one optional embodiment, obtaining the first media capability information of the first streaming endpoint in the destination device includes:

[0076] Send a first-stream endpoint discovery request to the destination device;

[0077] Receive the ID of the first stream endpoint in the destination device, sent by the destination device based on the first stream endpoint discovery request;

[0078] Send a first query media capability request to the destination device of the stream, wherein the first query media capability request carries at least the ID of the first stream endpoint;

[0079] Receive the first media capability information of the first streaming endpoint sent by the destination device based on the first query media capability request.

[0080] In this embodiment of the invention, the ID of the first streaming endpoint whose working state is unused in the destination device is first obtained, and then the first media capability information of the first streaming endpoint is queried based on the ID to realize the discovery of the streaming endpoint of the destination device.

[0081] For example, such as Figure 5 As shown, device A sends a first stream endpoint discovery request to device C to perform stream endpoint discovery. Device A receives the supported stream endpoints 1...N returned by device C, which are the IDs of the first stream endpoints whose working state is unused. Device A sends a first query media capability request to device C to query the capabilities of stream endpoints 1...N. Finally, device A receives the capabilities of stream endpoints 1...N returned by device C.

[0082] In one optional embodiment, obtaining the second media capability information of the second stream endpoint in the data source device includes:

[0083] Send a second-stream endpoint discovery request to the data source device;

[0084] Receive the ID of the second stream endpoint in the data source device, sent by the data source device based on the second stream endpoint discovery request;

[0085] Send a second query media capability request to the data source device, the second query media capability request carrying at least the ID of the second stream endpoint;

[0086] Receive the second media capability information of the second streaming endpoint sent by the data source device based on the second query media capability request.

[0087] In this embodiment of the invention, the ID of the second stream endpoint in the data source device that is in an unused working state is first obtained, and then the second media capability information of the second stream endpoint is queried based on the ID to realize the discovery of the stream endpoint of the data source device.

[0088] For example, such as Figure 5 As shown, device A sends a second stream endpoint discovery request to device B to perform stream endpoint discovery. Device A receives the IDs of supported stream endpoints 1...M, which are second stream endpoints whose working status is unused, returned by device B. Device A then sends a second query media capability request to device B to query the capabilities of stream endpoints 1...M. Finally, device A receives the capabilities of stream endpoints 1...M returned by device B.

[0089] In one optional embodiment, sending a stream establishment request to the streaming destination device when the first media capability information and the second media capability information are consistent includes:

[0090] When the first media capability information and the second media capability information are consistent, the streaming data transmission channel between the data source device and the streaming operation device is destroyed and released;

[0091] Obtain the destination device ID corresponding to the first media capability information, and send a stream establishment request to the destination device of the device ID.

[0092] It is understood that, in this embodiment of the invention, it is not necessary to know which destination devices the data can be transferred to before the data is transferred. During the data transfer process, the transfer operation device queries the media capabilities of other destination devices and the media capabilities of the data source device and performs capability matching. When the media capabilities are consistent, the match is successful, and the ID of the destination device that can transfer the data is returned to the user. If there are multiple destination devices that can transfer the data, multiple IDs of destination devices that can transfer the data can be returned, allowing the user to select the destination device for the transfer.

[0093] As can be seen, the device only needs to focus on its own media capabilities and publish those capabilities to the distributed network as streaming endpoints, without needing to pay attention to the media capabilities of other devices. The streaming operation device can automatically identify the devices that can be streamed (i.e., the destination devices) and provide them to the user for selection, making data transfer between different devices more convenient and flexible.

[0094] In one optional embodiment, before the data transfer destination device and the data source device establish a data transfer channel, the data transfer method further includes:

[0095] Obtain the third media capability information of the third stream endpoint in the flow operation device; wherein the third stream endpoint is in an unused working state;

[0096] When the third media capability information is consistent with the second media capability information, a streaming data transmission channel is established with the data source device through the third streaming endpoint and the second streaming endpoint.

[0097] It is understood that, in this embodiment of the invention, a streaming data transmission channel is established for the streaming data transmission process between the data source device and the streaming operation device. Specifically, when the third media capability information is consistent with the second media capability information, the ID of the third endpoint corresponding to the third media capability information and the ID of the second endpoint corresponding to the second media capability information are established to establish a streaming data transmission channel between the third streaming endpoint and the second streaming endpoint when they are consistent. This completes the establishment of the streaming data transmission channel between the data source device and the streaming operation device, enabling the data source device and the streaming operation device to transmit data through the corresponding second endpoint and third endpoint.

[0098] In one alternative embodiment, before acquiring the first media capability information of the first streaming endpoint in the destination device, the data streaming method further includes:

[0099] The first number of streaming endpoints in the destination device that are in use is obtained, so as to obtain the first media capability information of the first streaming endpoint in the destination device when the first number is less than a preset first number threshold.

[0100] Before acquiring the second media capability information of the second stream endpoint in the data source device, the data transfer method further includes:

[0101] The second number of streaming endpoints in the data source device that are in use is obtained, in order to obtain the second media capability information of the second streaming endpoints in the data source device when the second number is less than a preset second number threshold.

[0102] It is understandable that when the number of streaming endpoints used by a device reaches the corresponding device limit (first quantity threshold, second quantity threshold), the device sets its own streaming endpoints to undiscoverable, preventing other devices from discovering the device's streaming endpoints and establishing data stream channels, thus avoiding the phenomenon that excessive use of streaming endpoints can easily lead to streaming failures. Therefore, in this embodiment of the invention, when the number of streaming endpoints used by the device has not yet reached the device limit, unused streaming endpoints of the device can be discovered, and at this time, the media capability information of the unused streaming endpoints of the device can be obtained.

[0103] Furthermore, before acquiring the third media capability information of the third stream endpoint in the data transfer operation device, the data transfer method further includes:

[0104] The third number of streaming endpoints in the streaming operation device that are in use is obtained, so as to obtain the third media capability information of the third streaming endpoint in the streaming operation device when the third number is less than a preset third number threshold.

[0105] Similarly, in this embodiment of the invention, when the number of flow endpoints in use in the flow operation device is too large, the flow endpoint itself is set to be undiscoverable, so that other devices cannot discover the third flow endpoint of the flow operation device, thus avoiding the phenomenon that too many flow endpoints are used, which can easily lead to flow failure.

[0106] See Figure 2 , Figure 2 This is another flowchart of a data transfer method provided in an embodiment of the present invention. The data transfer method is applied to a data source device and includes:

[0107] S21. Send the second media capability information of the second stream endpoint in the data source device to the streaming operation device; wherein the second stream endpoint is in an unused working state;

[0108] S22. When the destination device receives the stream establishment request sent by the stream operation device, a stream data transmission channel is established with the destination device.

[0109] Wherein, if the first media capability information and the second media capability information of the first stream endpoint in the destination device are consistent, the destination device receives the stream establishment request sent by the stream operation device, and the first stream endpoint is in an unused working state.

[0110] In one alternative embodiment, before establishing a streaming data transmission channel with the destination device, the data transfer method includes:

[0111] When the second media capability information is consistent with the third media capability information of the third stream endpoint in the streaming operation device, a streaming data transmission channel is established with the streaming operation device through the second stream endpoint and the third stream endpoint; wherein the third stream endpoint is in an unused working state.

[0112] In one optional embodiment, sending the second media capability information of the second stream endpoint in the data source device to the streaming operation device includes:

[0113] Receive a second stream endpoint discovery request sent by the streaming operation device, and send the ID of the second stream endpoint in the data source device to the streaming operation device;

[0114] The system receives a second media capability query request sent by the streaming operation device and sends the second media capability information of the second streaming endpoint to the streaming operation device; the second media capability query request carries at least the ID of the second streaming endpoint.

[0115] It should be noted that this embodiment is an implementation of the data source device corresponding to the above method embodiment. Therefore, the relevant descriptions in the above method embodiment can be referred to, and the same beneficial effects can be achieved. To avoid repetition, further details will not be provided here.

[0116] See Figure 3 , Figure 3 This is another flowchart of a data transfer method provided in an embodiment of the present invention. The data transfer method is applied to the destination device and includes:

[0117] S31. Send the first media capability information of the first streaming endpoint in the streaming destination device to the streaming operation device; wherein the first streaming endpoint is in an unused working state;

[0118] S32. Receive the stream establishment request sent by the stream operation device, and establish a stream data transmission channel with the data source device;

[0119] Specifically, if the first media capability information and the second media capability information of the second stream endpoint in the data source device are consistent, a stream establishment request is received from the stream operation device, and the second stream endpoint is in an unused working state.

[0120] In one optional embodiment, receiving the stream establishment request sent by the stream operation device and establishing a stream data transmission channel with the data source device includes:

[0121] Receive and parse the stream establishment request sent by the streaming operation device to obtain the ID of the first stream endpoint corresponding to the first media capability information and the ID of the second stream endpoint corresponding to the second media capability information when the first media capability information and the second media capability information are consistent;

[0122] A streaming data transmission channel is established with the data source device using the ID of the corresponding first streaming endpoint and the ID of the corresponding second streaming endpoint.

[0123] It is understood that when the destination device receives the stream establishment request, it can establish a stream data transmission channel with the data source device through the ID of the corresponding first stream endpoint and the ID of the corresponding second stream endpoint carried in the stream establishment request.

[0124] It should be noted that this embodiment is an implementation method for the transfer destination device corresponding to the above method embodiments. Therefore, the relevant descriptions in the above method embodiments can be referred to, and the same beneficial effects can be achieved. To avoid repetition, further details will not be provided here.

[0125] In one specific embodiment, before the data transfer destination device and the data source device establish a data transfer channel, the data transfer method further includes a data transfer operation device and a data source device establishing a data transfer process, such as... Figure 4 As shown:

[0126] Device A (the streaming operation device) discovers the streaming endpoints from Device B (the data source device). Device B returns the supported streaming endpoints (streaming endpoints 1, 2, ..., M) to Device A. Streaming endpoints 1, 2, ..., M are second streaming endpoints whose working status is unused. Then, Device A queries Device B for the capabilities of streaming endpoints 1 to M in sequence (i.e., second media capability information). Device B returns the capabilities of streaming endpoints 1 to N in sequence to Device A. At this point, the second media capability information of the second streaming endpoints whose working status is unused in Device B is obtained. Device A can also obtain the capabilities of its supported streaming endpoints (i.e., the third media capability information of the third streaming endpoint). Then, Device A and Device B perform media capability matching negotiation, that is, comparing the third media capability information of Device A with the capabilities of Device B's streaming endpoints 1...M (i.e., the second media capability information). When the comparison results are consistent, Device A stops matching other streaming endpoint capabilities supported by Device B. Device A initiates the process of establishing a streaming data channel, establishing a streaming data channel between the matched streaming endpoints of Device A and Device B and performing streaming data transmission, that is, establishing a streaming data transmission channel with the data source device through the third streaming endpoint and the second streaming endpoint. After the streaming data transmission is completed, a streaming data channel release process is initiated to destroy and release the previously established streaming data channel.

[0127] In one specific embodiment, when device A (the data transfer device) is transmitting data to device B (the data source device), the data needs to be transferred from device A to device C (the data transfer destination device). The data transfer process is as follows: Figure 5 As shown:

[0128] Device A performs stream endpoint discovery on device C. Device C returns the supported stream endpoints (stream endpoints 1...N, where stream endpoints 1...N are the first stream endpoints whose working status is unused) to device A. Device A queries device C sequentially for the capabilities of stream endpoints 1...N (i.e., the first media capability information). Device C returns the capabilities of stream endpoints 1...N to device A sequentially. At this point, the first media capability information of the first stream endpoint in device C whose working status is unused can be obtained.

[0129] Similarly, device A discovers the flow endpoints of device C, and device B returns the supported flow endpoints (flow endpoints 1...M, where flow endpoints 1...M are second flow endpoints whose working status is unused) to device A. Device A queries device B for the capabilities of flow endpoints 1...M in sequence (i.e., second media capability information), and device B returns the capabilities of flow endpoints 1...N in sequence to device A. At this point, the second media capability information of the second flow endpoints in device B whose working status is unused can be obtained.

[0130] Device A matches the capabilities of both ends by comparing the streaming endpoint capabilities of Device C with those returned by Device B. Specifically, it compares the first media capability information with the second media capability information. When the streaming endpoint media capabilities supported by Device B match those of Device C, Device A stops matching other streaming endpoint capabilities supported by Device B and confirms the transferable destination device C. Device A then initiates a streaming establishment command (i.e., a streaming establishment request) to Device C, which instructs Device C to establish a streaming data transmission channel with Device B, i.e., to proceed with the streaming establishment process.

[0131] After receiving the flow establishment command, device C initiates a flow establishment process with device B;

[0132] After the data transmission channel between device C and device B is successfully established, device B and device C will transmit data streams; device C will return the result of successful data transmission to device A.

[0133] In this embodiment of the invention, the media capabilities of a device are abstracted as stream endpoints. The media capability information includes supported media codec formats and detailed codec parameter information. When a single device supports multiple media formats, the device represents its media capabilities by presenting multiple stream endpoints. The media capability information presented externally by the device includes stream endpoint ID, stream endpoint type (source endpoint TX_EP, destination endpoint RX_EP), and media type (audio, video). The content may include, but is not limited to, the following:

[0134] (1) After the device stream endpoint is published, it can be discovered by other devices. The media capabilities supported by the device can be obtained by querying the media capabilities of the stream endpoint in turn.

[0135] (2) When the media capabilities of the two devices are matched, the devices can establish a streaming data channel through the streaming endpoint to transmit data;

[0136] (3) The device performs status management on local flow endpoints. When the number of used flow endpoints reaches the maximum number of connections of the device, the flow endpoints cannot be discovered and connected by other devices.

[0137] In the data flow establishment process, before the data flow channel is established, the device initiates a device capability query, negotiates data transmission based on the media capabilities of both ends of the device, and then establishes a streaming data channel for streaming data transmission based on the agreed data encoding format and other parameters.

[0138] In the data transfer process, the transfer operation device queries the media capabilities of other devices and the media capabilities of the data source device and performs capability matching, returning the ID of the transfer destination device that can perform data transfer to the user; after the user confirms the transfer destination device, the transfer operation device sends a data stream establishment command to the transfer destination device; the transfer destination device initiates the data stream establishment process to establish a streaming data channel with the data source device to transmit streaming data, ultimately realizing data transfer.

[0139] This invention uses a stream endpoint approach to present the device's media capabilities to the outside world. This approach is independent of the capabilities of other devices in the distributed communication system. When developing a device, you only need to publish the supported media capabilities to the outside world according to the stream endpoint requirements. There is no need to standardize the device capability attributes, which facilitates the expansion and development of device capabilities.

[0140] The device in this embodiment manages the usage status of local flow endpoints to manage the device's connectivity capabilities. Each flow endpoint is independent of the others, making task management in multi-connection scenarios simple and easy to use.

[0141] The embodiments of the present invention automatically perform capability queries and negotiate transmission data parameters before the data flow channel is established. During product development, there is no need to pay too much attention to the specific media capabilities of the device. It is only necessary to publish the media capabilities supported by the device to the outside world. The transmission of streaming data between different devices is more convenient and flexible. There are no special requirements or restrictions on the device, which facilitates the flexible networking of distributed communication systems.

[0142] See Figure 10 , Figure 10 This is a structural block diagram of a data transfer device provided in an embodiment of the present invention. The data transfer device is applied to a transfer operation device and includes:

[0143] The first information acquisition module 11 is used to acquire the first media capability information of the first streaming endpoint in the destination device.

[0144] The second information acquisition module 12 is used to acquire the second media capability information of the second stream endpoint in the data source device; wherein the first stream endpoint and the second stream endpoint are in an unused working state;

[0145] The request sending module 13 is used to send a stream establishment request to the streaming destination device when the first media capability information and the second media capability information are consistent; wherein, the stream establishment request is used to instruct the streaming destination device to establish a stream data transmission channel with the data source device.

[0146] Optionally, the first information acquisition module 11 is further configured to:

[0147] Send a first-stream endpoint discovery request to the destination device;

[0148] Receive the ID of the first stream endpoint in the destination device, sent by the destination device based on the first stream endpoint discovery request;

[0149] Send a first query media capability request to the destination device of the stream, wherein the first query media capability request carries at least the ID of the first stream endpoint;

[0150] Receive the first media capability information of the first streaming endpoint sent by the destination device based on the first query media capability request.

[0151] Optionally, the second information acquisition module 12 is further configured to:

[0152] Send a second-stream endpoint discovery request to the data source device;

[0153] Receive the ID of the second stream endpoint in the data source device, sent by the data source device based on the second stream endpoint discovery request;

[0154] Send a second query media capability request to the data source device, the second query media capability request carrying at least the ID of the second stream endpoint;

[0155] Receive the second media capability information of the second streaming endpoint sent by the data source device based on the second query media capability request.

[0156] Optionally, the request sending module 13 is further configured to:

[0157] When the first media capability information and the second media capability information are consistent, the streaming data transmission channel between the data source device and the streaming operation device is destroyed and released;

[0158] Obtain the destination device ID corresponding to the first media capability information, and send a stream establishment request to the destination device of the device ID.

[0159] Optionally, the data transfer method apparatus further includes:

[0160] The third information acquisition module is used to acquire the third media capability information of the third stream endpoint in the flow operation device; wherein the third stream endpoint is in an unused working state;

[0161] The first channel establishment module is used to establish a streaming data transmission channel with the data source device through the third stream endpoint and the second stream endpoint when the third media capability information is consistent with the second media capability information.

[0162] Optionally, the data transfer device further includes:

[0163] The first quantity acquisition module is used to acquire a first number of streaming endpoints in the destination device that are in use, so as to acquire the first media capability information of the first streaming endpoint in the destination device when the first number is less than a preset first quantity threshold.

[0164] The second quantity acquisition module is used to acquire a second quantity of the stream endpoints in the data source device that are in use, so as to acquire the second media capability information of the second stream endpoints in the data source device when the second quantity is less than a preset second quantity threshold.

[0165] It should be noted that the data transfer device described above in this embodiment can implement any step in the data transfer method embodiment applied to the transfer operation device in this invention and achieve the same beneficial effect, which will not be elaborated here.

[0166] See Figure 11 , Figure 11This is another structural block diagram of a data transfer device provided in an embodiment of the present invention. The data transfer device is applied to a data source device and includes:

[0167] The second information sending module 21 is used to send the second media capability information of the second stream endpoint in the data source device to the streaming operation device; wherein the second stream endpoint is in an unused working state;

[0168] The second channel establishment module 22 is used to establish a stream data transmission channel with the stream destination device when the stream destination device receives the stream establishment request sent by the stream operation device;

[0169] Wherein, if the first media capability information and the second media capability information of the first stream endpoint in the destination device are consistent, the destination device receives the stream establishment request sent by the stream operation device, and the first stream endpoint is in an unused working state.

[0170] Optionally, the data transfer device includes:

[0171] The third channel establishment module is used to establish a streaming data transmission channel with the streaming operation device through the second streaming endpoint and the third streaming endpoint when the second media capability information is consistent with the third media capability information of the third streaming endpoint in the streaming operation device; wherein the third streaming endpoint is in an unused working state.

[0172] Optionally, the second information sending module 21 is further configured to:

[0173] Receive a second stream endpoint discovery request sent by the streaming operation device, and send the ID of the second stream endpoint in the data source device to the streaming operation device;

[0174] The system receives a second media capability query request sent by the streaming operation device and sends the second media capability information of the second streaming endpoint to the streaming operation device; the second media capability query request carries at least the ID of the second streaming endpoint.

[0175] It should be noted that the data transfer device described above in this embodiment can implement any step in the data transfer method embodiment applied to the data source device in this invention and achieve the same beneficial effect, which will not be elaborated here.

[0176] See Figure 12 , Figure 12 This is another structural block diagram of a data transfer device provided in an embodiment of the present invention. The data transfer device is applied to the target device for data transfer, and the data transfer method includes:

[0177] The first information sending module 31 is used to send the first media capability information of the first streaming endpoint in the streaming destination device to the streaming operation device; wherein the first streaming endpoint is in an unused working state;

[0178] The fourth channel establishment module 32 is used to receive the stream establishment request sent by the stream operation device and establish a stream data transmission channel with the data source device;

[0179] Specifically, if the first media capability information and the second media capability information of the second stream endpoint in the data source device are consistent, a stream establishment request is received from the stream operation device, and the second stream endpoint is in an unused working state.

[0180] Optionally, the fourth channel establishment module 32 is further configured to:

[0181] Receive and parse the stream establishment request sent by the streaming operation device to obtain the ID of the first stream endpoint corresponding to the first media capability information and the ID of the second stream endpoint corresponding to the second media capability information when the first media capability information and the second media capability information are consistent;

[0182] A streaming data transmission channel is established with the data source device using the ID of the corresponding first streaming endpoint and the ID of the corresponding second streaming endpoint.

[0183] It should be noted that the data transfer device described above in this embodiment can implement any step in the data transfer method embodiment applied to the transfer destination device in this invention, and achieve the same beneficial effect, which will not be repeated here.

[0184] This invention also provides a computer-readable storage medium, which includes a stored computer program; wherein, when the computer program is executed, it controls the device where the computer-readable storage medium is located to perform the data transfer method as described in any of the above embodiments.

[0185] See Figure 13 , Figure 13 This is a structural block diagram of a data transfer device provided in an embodiment of the present invention. The data transfer device includes: a processor 41, a memory 42, and a computer program stored in the memory 42 and executable on the processor 41. When the processor 41 executes the computer program, it implements the steps in the above-described data transfer method embodiments. Alternatively, when the processor 41 executes the computer program, it implements the functions of each module / unit in the above-described device embodiments.

[0186] For example, the computer program can be divided into one or more modules / units, which are stored in the memory 42 and executed by the processor 41 to complete the present invention. The one or more modules / units can be a series of computer program instruction segments capable of performing a specific function, which describe the execution process of the computer program in the data transfer device.

[0187] The data transfer device may include, but is not limited to, a processor 41 and a memory 42. Those skilled in the art will understand that the schematic diagram is merely an example of a data transfer device and does not constitute a limitation on the data transfer device. It may include more or fewer components than illustrated, or combine certain components, or different components. For example, the data transfer device may also include input / output devices, network access devices, buses, etc.

[0188] The processor 41 may be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor. The processor 41 is the control center of the data transfer device, connecting all parts of the data transfer device via various interfaces and lines.

[0189] The memory 42 can be used to store the computer programs and / or modules. The processor 41 implements various functions of the data transfer device by running or executing the computer programs and / or modules stored in the memory 42 and calling the data stored in the memory 42. The memory 42 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created according to the use of the mobile phone (such as audio data, phonebook, etc.). In addition, the memory 42 may include high-speed random access memory, and may also include non-volatile memory, such as hard disk, memory, plug-in hard disk, smart media card (SMC), secure digital card (SD) card, flash card, at least one disk storage device, flash memory device, or other volatile solid-state storage device.

[0190] If the modules / units integrated into the data transfer device are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by the processor 41, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include: any entity or device capable of carrying the computer program code, recording media, USB flash drives, portable hard drives, magnetic disks, optical disks, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc.

[0191] It should be noted that the device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Furthermore, in the accompanying drawings of the device embodiments provided by this invention, the connection relationships between modules indicate that they have communication connections, which can be specifically implemented as one or more communication buses or signal lines. Those skilled in the art can understand and implement this without any creative effort.

[0192] The above description represents the preferred embodiments of the present invention. It should be noted that those skilled in the art can make various improvements and modifications without departing from the principles of the present invention, and these improvements and modifications are also considered to be within the scope of protection of the present invention.

Claims

1. A data transfer method, characterized in that, The data transfer method, applied to data transfer operation equipment, includes: When the streaming operation device is transmitting streaming data with the data source device, it acquires the first media capability information of the first streaming endpoint in the streaming destination device and the second media capability information of the second streaming endpoint in the data source device; wherein the first streaming endpoint and the second streaming endpoint are in an unused working state; When the first media capability information and the second media capability information are consistent, a stream establishment request is sent to the streaming destination device; wherein, the stream establishment request is used to instruct the streaming destination device to establish a stream data transmission channel with the data source device; The acquisition of the first media capability information of the first streaming endpoint in the destination device includes: Send a first-stream endpoint discovery request to the destination device; Receive the ID of the first stream endpoint in the destination device, sent by the destination device based on the first stream endpoint discovery request; Send a first query media capability request to the destination device of the stream, wherein the first query media capability request carries at least the ID of the first stream endpoint; Receive the first media capability information of the first streaming endpoint sent by the destination device based on the first query media capability request; The acquisition of the second media capability information of the second stream endpoint in the data source device includes: Send a second-stream endpoint discovery request to the data source device; Receive the ID of the second stream endpoint in the data source device, sent by the data source device based on the second stream endpoint discovery request; Send a second query media capability request to the data source device, the second query media capability request carrying at least the ID of the second stream endpoint; Receive the second media capability information of the second streaming endpoint sent by the data source device based on the second query media capability request.

2. The data transfer method as described in claim 1, characterized in that, When the first media capability information and the second media capability information are consistent, sending a stream establishment request to the streaming destination device includes: When the first media capability information and the second media capability information are consistent, the streaming data transmission channel between the data source device and the streaming operation device is destroyed and released; Obtain the destination device ID corresponding to the first media capability information, and send a stream establishment request to the destination device of the device ID.

3. The data transfer method as described in claim 1, characterized in that, Before the data transfer destination device and the data source device establish a data transfer channel, the data transfer method further includes: Obtain the third media capability information of the third stream endpoint in the flow operation device; wherein the third stream endpoint is in an unused working state; When the third media capability information is consistent with the second media capability information, a streaming data transmission channel is established with the data source device through the third streaming endpoint and the second streaming endpoint.

4. The data transfer method as described in claim 1, characterized in that, Before acquiring the first media capability information of the first streaming endpoint in the destination device, the data transfer method further includes: The first number of streaming endpoints in the destination device that are in use is obtained, so as to obtain the first media capability information of the first streaming endpoint in the destination device when the first number is less than a preset first number threshold. Before acquiring the second media capability information of the second stream endpoint in the data source device, the data transfer method further includes: The second number of streaming endpoints in the data source device that are in use is obtained, in order to obtain the second media capability information of the second streaming endpoints in the data source device when the second number is less than a preset second number threshold.

5. A data transfer method, characterized in that, Applied to data source devices, the data transfer method includes: When the streaming operation device is transmitting streaming data with the data source device, it sends the second media capability information of the second streaming endpoint in the data source device to the streaming operation device; wherein the second streaming endpoint is in an unused working state; When the destination device receives the stream establishment request sent by the stream operation device, a stream data transmission channel is established with the destination device. Wherein, if the first media capability information and the second media capability information of the first stream endpoint in the streaming destination device are consistent, the streaming destination device receives the stream establishment request sent by the streaming operation device, and the first stream endpoint is in an unused working state; Sending the second media capability information of the second stream endpoint in the data source device to the streaming operation device includes: Receive a second stream endpoint discovery request sent by the streaming operation device, and send the ID of the second stream endpoint in the data source device to the streaming operation device; The system receives a second media capability query request sent by the streaming operation device and sends the second media capability information of the second streaming endpoint to the streaming operation device; the second media capability query request carries at least the ID of the second streaming endpoint. The transfer operation equipment is also used for: Send a first-stream endpoint discovery request to the destination device; Receive the ID of the first stream endpoint in the destination device, sent by the destination device based on the first stream endpoint discovery request; Send a first query media capability request to the destination device of the stream, wherein the first query media capability request carries at least the ID of the first stream endpoint; Receive the first media capability information of the first streaming endpoint sent by the destination device based on the first query media capability request.

6. The data transfer method as described in claim 5, characterized in that, Before the data transfer operation device is transmitting data with the data source device, the data transfer method includes: When the second media capability information is consistent with the third media capability information of the third stream endpoint in the streaming operation device, a streaming data transmission channel is established with the streaming operation device through the second stream endpoint and the third stream endpoint; wherein the third stream endpoint is in an unused working state.

7. A data transfer method, characterized in that, The data transfer method, applied to the destination device, includes: When the streaming operation device is transmitting streaming data with the data source device, the first media capability information of the first streaming endpoint in the streaming destination device is sent to the streaming operation device; wherein the first streaming endpoint is in an unused working state; Receive the stream establishment request sent by the stream operation device and establish a stream data transmission channel with the data source device; Where the first media capability information and the second media capability information of the second stream endpoint in the data source device are consistent, a stream establishment request is received from the stream operation device, and the second stream endpoint is in an unused working state. Sending the first media capability information of the first streaming endpoint in the streaming destination device to the streaming operation device includes: Receive a first stream endpoint discovery request sent by the streaming operation device, and send the ID of the first stream endpoint in the streaming destination device to the streaming operation device; The system receives a first media capability query request sent by the streaming operation device and sends the first media capability information of the first streaming endpoint to the streaming operation device; the first media capability query request carries at least the ID of the first streaming endpoint. The transfer operation equipment is also used for: Send a second-stream endpoint discovery request to the data source device; Receive the ID of the second stream endpoint in the data source device, sent by the data source device based on the second stream endpoint discovery request; Send a second query media capability request to the data source device, the second query media capability request carrying at least the ID of the second stream endpoint; Receive the second media capability information of the second streaming endpoint sent by the data source device based on the second query media capability request.

8. A data transfer device, characterized in that, It includes a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein the processor, when executing the computer program, implements the data transfer method as described in any one of claims 1 to 7.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored computer program; wherein, when the computer program is executed, it controls the device on which the computer-readable storage medium is located to perform the data transfer method as described in any one of claims 1 to 7.

Images