Data transmission method, device and equipment applied to multi-screen cloud service and medium

Abstract

The present disclosure provides a data transmission method and device applied to multi-screen cloud service, equipment and medium, relating to the technical field of data communication. The method comprises: a cloud platform receiving a receiver report of a transmission path sent by a plurality of terminals, the transmission path comprising an end-to-end P2P transmission path and an end-cloud transmission path, and the receiver report comprising transmission parameters; based on the transmission parameters of each transmission path, the path score of each P2P transmission path and the path score of each end-cloud transmission path are calculated; based on the path score of the P2P transmission path and the path score of the end-cloud transmission path, the data transmission strategy of each terminal is determined among the end-cloud transmission strategy, the P2P transmission strategy and the hybrid transmission strategy, and data transmission is performed. According to the embodiment of the present disclosure, the transmission strategy can be adjusted in time when the network environment of end-cloud transmission changes, the transmission efficiency is improved, the time difference of multi-screen display content is reduced, and thus the fluency of multi-screen cloud service is improved and the user experience is improved.

Description

Technical Field

[0001] This disclosure relates to the field of data communication technology, and in particular to a data transmission method, apparatus, device and medium for multi-screen cloud services. Background Technology

[0002] Multi-screen cloud services are cloud service types implemented on multiple terminal screens, including simultaneous two-player cloud gaming, cross-screen cloud gaming, simultaneous multi-player cloud education, and cross-screen cloud education. In related technologies, due to differences in network conditions between different terminals, the video streams received and the information streams sent by different terminals vary significantly, resulting in time differences in the content displayed on multiple screens and affecting the user's multi-screen cloud service experience.

[0003] It should be noted that the information disclosed in the background section above is only used to enhance the understanding of the background of this disclosure, and therefore may include information that does not constitute prior art known to those skilled in the art. Summary of the Invention

[0004] This disclosure provides a data transmission method, apparatus, device, and medium for multi-screen cloud services, which at least to some extent overcomes the problem of time differences in multi-screen display content and poor user experience caused by differences in network status of different terminals in related technologies.

[0005] Other features and advantages of this disclosure will become apparent from the following detailed description, or may be learned in part from practice of this disclosure.

[0006] According to one aspect of this disclosure, a data transmission method for multi-screen cloud services is provided, comprising:

[0007] The cloud platform receives receiver reports of transmission paths sent by multiple terminals. The transmission paths include end-to-end P2P transmission paths and end-to-cloud transmission paths. The receiver reports include transmission parameters.

[0008] Based on the transmission parameters of each transmission path, the path score of each P2P transmission path and the path score of each end-to-cloud transmission path are calculated.

[0009] Based on the path scores of the P2P transmission path and the edge-cloud transmission path, the data transmission strategy for each terminal is determined among the edge-cloud transmission strategy, P2P transmission strategy and hybrid transmission strategy, and then data transmission is performed.

[0010] In one embodiment of this disclosure, the receiver report includes one or more of the following transmission parameters:

[0011] Latency, estimated bandwidth, packet loss rate.

[0012] In one embodiment of this disclosure, the method further includes:

[0013] When providing multi-screen cloud services, determine whether the multiple terminals carrying the services have P2P transmission channels;

[0014] Receiver reports of the transmission path sent by multiple terminals, including:

[0015] Receiver reports of transmission paths sent by multiple terminals with P2P transmission channels.

[0016] In one embodiment of this disclosure, determining whether multiple terminals carrying services have a P2P transmission channel includes:

[0017] Based on the WiFi P2P list reported by the terminal, and combined with the multi-screen cloud service ID, determine whether there is a terminal that can transmit via WiFi P2P and has the same multi-screen cloud service ID.

[0018] In one embodiment of this disclosure, when data is transmitted from a first terminal to a second terminal via P2P, the first terminal and the second terminal are controlled to perform transmission coordination, and the video stream and signaling stream are transmitted through the first terminal as a proxy.

[0019] According to another aspect of this disclosure, a data transmission method for multi-screen cloud services is provided, comprising:

[0020] The terminal sends a receiver report of the transmission path to the cloud platform. The transmission path includes an end-to-end P2P transmission path and an end-to-cloud transmission path. The receiver report includes transmission parameters so that the cloud platform can calculate the path score of each P2P transmission path and the path score of each end-to-cloud transmission path based on the transmission parameters of each transmission path. Based on the path scores of the P2P transmission path and the end-to-cloud transmission path, the cloud platform determines the data transmission strategy for each terminal among the end-to-cloud transmission strategy, P2P transmission strategy and hybrid transmission strategy, and then performs data transmission.

[0021] In one embodiment of this disclosure, the method further includes:

[0022] When the data transmission strategy selected by the cloud platform is a P2P transmission strategy or a hybrid transmission strategy, a P2P transmission channel is established with the third terminal in response to the instructions of the cloud platform to carry out data transmission.

[0023] In one embodiment of this disclosure, the method further includes:

[0024] Negotiate network status with the third terminal;

[0025] The delay of decoding and playback is controlled according to the network status.

[0026] According to another aspect of this disclosure, a data transmission apparatus for multi-screen cloud services is provided, comprising:

[0027] The report receiving module is used by the cloud platform to receive receiver reports of transmission paths sent by multiple terminals. The transmission paths include end-to-end P2P transmission paths and end-to-cloud transmission paths. The receiver reports include transmission parameters.

[0028] The scoring calculation module is used to calculate the path score of each P2P transmission path and the path score of each end-to-cloud transmission path based on the transmission parameters of each transmission path.

[0029] The strategy determination module is used to determine the data transmission strategy for each terminal based on the path score of the P2P transmission path and the path score of the end-to-cloud transmission path, and to perform data transmission.

[0030] According to another aspect of this disclosure, a data transmission apparatus for multi-screen cloud services is provided, comprising:

[0031] The report sending module is used by the terminal to send a receiver report of the transmission path to the cloud platform. The transmission path includes an end-to-end P2P transmission path and an end-to-cloud transmission path. The receiver report includes transmission parameters so that the cloud platform can calculate the path score of each P2P transmission path and the path score of each end-to-cloud transmission path based on the transmission parameters of each transmission path. Based on the path scores of the P2P transmission path and the end-to-cloud transmission path, the cloud platform determines the data transmission strategy of each terminal among the end-to-cloud transmission strategy, P2P transmission strategy and hybrid transmission strategy, and then performs data transmission.

[0032] According to another aspect of this disclosure, an electronic device is provided, comprising: a memory for storing instructions; and a processor for calling the instructions stored in the memory to implement the above-described data transmission method applied to multi-screen cloud services.

[0033] According to another aspect of this disclosure, a computer-readable storage medium is provided that stores computer instructions thereon, which, when executed by a processor, implement the above-described data transmission method for multi-screen cloud services.

[0034] According to another aspect of this disclosure, a computer program product is provided, which stores instructions that, when executed by a computer, cause the computer to implement the above-described data transmission method applied to multi-screen cloud services.

[0035] According to another aspect of this disclosure, a chip is provided, including at least one processor and an interface;

[0036] An interface is used to provide program instructions or data to at least one processor;

[0037] At least one processor is used to execute program instructions to implement the data transmission method described above for multi-screen cloud services.

[0038] The data transmission method for multi-screen cloud services provided in this disclosure calculates the path score of each P2P transmission path and the path score of each end-to-cloud transmission path based on the receiver report of the transmission path. Then, based on the path scores of the P2P transmission paths and the end-to-cloud transmission paths, a data transmission strategy for each terminal is determined from the end-to-cloud transmission strategy, the P2P transmission strategy, and the hybrid transmission strategy for data transmission. This allows for timely adjustment of the transmission strategy when the network environment of the end-to-cloud transmission changes, improving transmission efficiency, reducing the time difference of multi-screen display content, thereby improving the smoothness of multi-screen cloud services and enhancing the user experience.

[0039] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0040] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0041] Obviously, the accompanying drawings described below are merely some embodiments of this disclosure. Those skilled in the art can obtain other drawings based on these drawings without any creative effort.

[0042] Figure 1 A schematic diagram of a data transmission scheme applied to multi-screen cloud services is shown in the related technology.

[0043] Figure 2 This illustration shows a data transmission scheme for multi-screen cloud services according to an embodiment of the present disclosure;

[0044] Figure 3 This illustration shows an architecture diagram of a data transmission system applied to multi-screen cloud services according to an embodiment of the present disclosure;

[0045] Figure 4 A flowchart illustrating a data transmission method applied to multi-screen cloud services is shown in an embodiment of this disclosure.

[0046] Figure 5 This illustration shows a flowchart of another data transmission method applied to multi-screen cloud services in an embodiment of this disclosure;

[0047] Figure 6 This illustration shows a flowchart of another data transmission method applied to multi-screen cloud services in an embodiment of this disclosure;

[0048] Figure 7This illustration shows a flowchart of another data transmission method applied to multi-screen cloud services in an embodiment of the present disclosure;

[0049] Figure 8 This illustration shows a data transmission device applied to multi-screen cloud services according to an embodiment of the present disclosure;

[0050] Figure 9 This illustration shows a schematic diagram of another data transmission device applied to multi-screen cloud services in an embodiment of this disclosure;

[0051] Figure 10 A structural block diagram of an electronic device according to an embodiment of the present disclosure is shown. Detailed Implementation

[0052] The exemplary implementation will now be described more fully with reference to the accompanying drawings.

[0053] It should be noted that the example implementation can be implemented in many forms and should not be construed as being limited to the examples set forth herein.

[0054] Multi-screen cloud services on terminals, such as simultaneous two-player cloud gaming, cross-screen cloud gaming, simultaneous multi-player cloud education, and cross-screen cloud education, are cloud service types based on two or more screens. Ensuring clear display of multi-screen content, smooth visuals, and time synchronization is key to guaranteeing a good service experience.

[0055] Figure 1 The diagram illustrates a data transmission scheme for multi-screen cloud services. This scheme uses SVC scalable coding to resist network jitter. When network transmission fluctuates, the terminal chooses to reduce audio and video resolution, frame rate, and quality. It also places high demands on the cloud platform encoder and terminal decoding playback, has poor H.265 support, and requires software decoding support. Network jitter can cause playback synchronization deviations between terminals due to packet loss retransmission or packet reassembly recovery.

[0056] Multi-screen cloud services on terminals are affected by the network of end-to-end cloud transmission, resulting in the following problems:

[0057] The conventional approach uses SVC encoding to combat network jitter, which has high requirements for terminal hardware and is not friendly to H.265 hardware encoding, resulting in a huge drain on the terminal's CPU performance and battery (using software decoding).

[0058] The content displayed on multiple cloud terminal screens is not synchronized. The network status of multiple terminals is different, and the received video stream and sent information stream are significantly different, resulting in a time difference in the content displayed on multiple screens, which affects the user's multi-screen service experience.

[0059] To address the aforementioned issues, embodiments of this disclosure propose that multiple terminals located close to each other can adaptively adopt hybrid network transmission based on network conditions, thereby maintaining the consistency of video stream and information stream transmission status across multiple cloud terminals and improving the smoothness of multi-screen cloud services.

[0060] Figure 2 This diagram illustrates a data transmission scheme for multi-screen cloud services in an embodiment of this disclosure. It employs adaptive hybrid transmission, establishing a transmission channel between cloud terminals via P2P, with direct transmission between the hybrid terminals or end-to-end proxy transmission. When network transmission fluctuates, the platform controls two terminals to coordinate transmission, with video streams and signaling streams being transmitted through another terminal. The terminals can negotiate network status to ensure clear and stable video streams while maintaining synchronized video playback.

[0061] exist Figure 2 In the scheme shown, the terminal supports end-to-end P2P transmission. The cloud platform can provide adaptive switching between direct cloud transmission and terminal proxy transmission (P2P transmission) when the transmission network fluctuates. The collaborative transmission of multiple terminals is achieved through cloud platform control, ensuring the clarity, smoothness and synchronization of multi-screen content in multi-screen cloud services.

[0062] It should be noted that the terminals in this disclosure include, but are not limited to, mobile phones, tablets, laptops, vehicle communication devices, drones, communication modules on drones, remote-controlled aircraft, aircraft, small aircraft, vehicles, RSUs, wireless sensors, internet cards, IoT terminals, RFID terminals, NB-IoT terminals, MTC (Machine Type Communication) terminals, eMTC (enhanced MTC) terminals, data cards, internet cards, vehicle communication devices, low-cost mobile phones, low-cost tablets, and other wireless communication devices.

[0063] The following is combined with Figure 2 and Figure 3 This invention describes the cloud platform and terminal in the embodiments of this disclosure.

[0064] Virtual machines on the cloud platform: mobile phones or computers simulated by x86 / ARM servers, which process user commands from real mobile phones, identify different service types, and are used to notify the PT value of RTP.

[0065] Video encoder on the cloud platform: After the virtual machine renders the image, it hands the image over to the video encoder for encoding. The server's GPU performs the video encoding.

[0066] When the cloud platform processes instructions, it feeds back the received instructions to the virtual machine state machine. If P2P transmission is carried out, it is also necessary to distinguish the cloud terminal from which the instructions come and feed back the different instructions to the state machine.

[0067] RTP transmission packages the video stream from the video encoder into RTP packets and sends them to the cloud terminal for processing; or it receives signaling network packets sent from the cloud terminal and hands them over to the instruction processing.

[0068] Network status analysis analyzes the current cloud transmission network status based on receiver reports (RR) to determine the cloud-to-end transmission strategy, whether to use direct cloud transmission, end-to-end proxy transmission, or a hybrid transmission strategy.

[0069] The collaborative control module coordinates and controls multiple cloud terminals to perform P2P proxy transmission.

[0070] Terminal command collection: Collect user touch, key input, and other inputs, and transmit them to a virtual machine on the cloud platform for processing.

[0071] Terminal RTP transmission: Receive video streams sent by the cloud platform; send signaling streams to the cloud platform; or send / receive video streams and signaling streams via the P2P transmission module.

[0072] Terminal P2P transmission: Exchange data with other cloud terminals and transmit video streams / signaling streams.

[0073] The terminal's video decoder decodes and outputs the video stream from the RTP, and then displays the cloud services to the user.

[0074] The terminal's decoding control module controls the decoding and playback latency based on the network status of P2P transmission, ensuring video synchronization for multi-frequency cloud services.

[0075] Figure 4 This illustrates a data transmission method applied to multi-screen cloud services, such as... Figure 4 As shown, steps S402-S406 are included.

[0076] S402, the terminal sends a receiver report of the transmission path to the cloud platform. The transmission path includes an end-to-end P2P transmission path and an end-to-cloud transmission path. The receiver report includes transmission parameters.

[0077] Transmission parameters are used to indicate the data transmission quality of the transmission path.

[0078] In some embodiments, the receiver report may include one or more of the following transmission parameters: latency, estimated bandwidth, and packet loss rate.

[0079] S402, the cloud platform calculates the path score for each P2P transmission path and the path score for each end-to-cloud transmission path based on the transmission parameters of each transmission path.

[0080] S402, the cloud platform determines the data transmission strategy for each terminal based on the path score of the P2P transmission path and the path score of the end-to-cloud transmission path, among the end-to-cloud transmission strategy, P2P transmission strategy, and hybrid transmission strategy, and then performs data transmission.

[0081] The following is for reference. Figure 5 This disclosure details the data transmission method for multi-screen cloud services provided in its embodiments, focusing on three aspects: initiating multi-screen cloud services, transmitting service data, and calculating network transmission paths.

[0082] Step 1: Business Launch.

[0083] 1) Launch Multi-Screen Cloud Service: Multiple cloud terminals launch multi-screen cloud service, search for nearby cloud terminals via WiFi P2P, and report to the cloud platform.

[0084] 2) The platform starts the virtual machine for multi-screen cloud services.

[0085] 3) Check if a P2P transmission environment is available: The cloud platform determines whether there are terminals that can transmit via WiFi P2P and have the same multi-screen cloud service ID based on the WiFi P2P list reported by each terminal.

[0086] 4) Start network transmission: Perform network transmission according to the policy, and the default is to use the end-to-cloud transmission method.

[0087] In one embodiment, two terminals initiate multi-screen cloud services (such as cloud gaming), and each uses WiFi P2P (such as WiFi Direct Peer Search) to search for nearby terminals (also known as cloud terminals) and reports their respective Peer Lists to the cloud platform. The Peer Lists contain the MAC addresses, device types, device names, and configuration methods of both parties. This step requires the two cloud terminals to be in a close-range communication scenario, such as both parties supporting WiFi Direct transmission; otherwise, they will not be able to scan for each other.

[0088] The platform launches virtual machines for multi-screen cloud services, such as cloud gaming with simultaneous multiplayer battles, configures the corresponding multi-screen cloud service ID, and distributes them to two cloud terminals A and B.

[0089] Check if a P2P transmission environment is available: The cloud platform determines whether the current multi-screen cloud service has the conditions for WiFi P2P transmission based on the WiFi P2P list reported by cloud terminals A and B, combined with the multi-screen cloud service IDs of both parties.

[0090] Start network transmission: The platform and the two cloud terminals each use the default end-to-cloud transmission method.

[0091] The second step is to transmit business data.

[0092] 1) Business data transmission: The cloud platform and cloud terminal transmit data according to the transmission strategy, including video footage and user data.

[0093] 2) After receiving the data, the terminal decodes and plays the data according to the delay / time difference of each terminal, and collects user input and sends it back to the platform.

[0094] 3) Send RR: Each cloud terminal sends a receiver report to the platform for the P2P link and the end-to-cloud transmission link, including latency, estimated bandwidth, packet loss rate, etc.

[0095] In some embodiments, during business data transmission, the cloud platform and two cloud terminals use end-to-cloud data transmission according to the transmission strategy, including video footage and user data.

[0096] After receiving the data, the two cloud terminals decode and play the data according to the latency / time difference of each terminal, and collect user input and send it back to the platform.

[0097] The methods for calculating delay and time difference are as follows:

[0098] The latency from terminal A to the platform is 60ms;

[0099] The latency from client B to the platform is 90ms;

[0100] After receiving the video stream, A should wait an additional 90ms-60ms from memory to decoder to ensure playback synchronization between A and B.

[0101] Send RR: The two cloud terminals send receiver reports for the P2P link and the end-to-cloud transmission link to the platform, including latency, estimated bandwidth, packet loss rate, etc.

[0102] The third step is to calculate the network transmission path.

[0103] 1) Calculate the score for each path: Based on the transmission path's latency, expected bandwidth, packet loss rate, etc., input the scoring model to calculate the scores for each cloud terminal's end-to-end cloud transmission and end-to-end transmission (P2P).

[0104] 2) Calculate the overall path: score each path and calculate the overall system transmission path.

[0105] 3) Select transmission strategy: Based on the calculated terminal path, select an end-to-end transmission, end-to-end transmission, or hybrid transmission strategy for each cloud terminal and proceed to the next transmission stage. The cloud terminal will use this strategy for data transmission.

[0106] In some embodiments, scores are calculated for each path: The cloud platform inputs the transmission path's latency, estimated bandwidth, packet loss rate, etc., into a scoring model to calculate the scores for each cloud terminal's end-to-end cloud transmission and end-to-end transmission (P2P). The following is a calculation method for a simple model:

[0107] Delay (Δt) 60ms 90ms 12ms (100ms-△t) / 100ms*50 Expected bandwidth (B) 30Mbps 12Mbps 75Mbps B / 100Mbps*25 Packet loss rate (L) 0％ 0.1％ 0％ (1％-L) / 1％*25

[0108] The scores for the three transmission paths are:

[0109] From terminal A to platform: 20 + 7.5 + 25 = 52.5

[0110] From terminal B to platform: 5 + 3 + 22.5 = 30.5

[0111] From end A to end B: 44 + 18.75 + 25 = 87.75

[0112] Calculate the overall system transmission path: Based on the scores of each path, the platform calculates the overall system transmission path.

[0113] The link score at endpoint B is low. The platform determines that a transmission path exists from B to A to the platform and estimates its latency, bandwidth capacity, and packet loss rate changes:

[0114] Time delay variation: Δt = 60ms + 12ms

[0115] Bandwidth capacity: 10Mbps for video transmission and 1Mbps for command transmission. The bandwidth from terminal A to the platform is sufficient for two-link transmission. (Since it is a multi-screen game service, the video screens of terminal A and terminal B are the same. The video stream received by terminal A can be copied and forwarded to terminal B.)

[0116] Packet loss rate L = 0% + 0%;

[0117] Therefore, its link score is: 14 + 7.5 + 25 = 46.5;

[0118] Select a transmission strategy: Based on the calculated terminal path, select an end-to-end transmission, end-to-end transmission, or hybrid transmission strategy for each cloud terminal.

[0119] Cloud terminal A adopts an end-to-cloud transmission method, with video streams and command streams being transmitted directly to the platform;

[0120] Cloud terminal B uses an end-to-end transmission method, transmitting video streams and command streams to cloud terminal A via WiFi Direct. Terminal A then merges the command streams and sends them to the platform.

[0121] In the next round of transmission, cloud terminals A and B will use this strategy for data transmission.

[0122] This embodiment of the disclosure establishes a WiFi P2P transmission channel between cloud terminals. The platform assesses the transmission quality of each transmission link on the mobile phone and selects the optimal transmission strategy, enabling cloud terminals to support end-to-end transmission, end-to-end transmission, or hybrid transmission methods. This satisfies the requirements of consistent image quality, low latency, and image synchronization across all cloud terminals. Furthermore, this embodiment of the disclosure does not impose any additional access methods on the cloud terminals.

[0123] Compared with existing technologies, the technical solution proposed in this disclosure can ensure that multi-screen cloud services maintain consistent display, low latency, and synchronized screens across different screens / cloud terminals:

[0124] Display consistency: Transmission is guaranteed through an additional transmission link, eliminating the need to reduce video quality using the original SVC method;

[0125] Low latency: Both user control signaling and video streams can flexibly choose transmission strategies, and the transmission links are dynamically allocated by the platform based on the overall network conditions to ensure the response and screen latency of multi-screen cloud services;

[0126] Video synchronization: Multiple cloud terminals can align video decoding and playback based on the latency of each link, ensuring video synchronization for multi-screen cloud services.

[0127] Figure 6 This illustration shows a flowchart of a data transmission method applied to multi-screen cloud services according to an embodiment of this disclosure, such as... Figure 6 As shown in the embodiments of this disclosure, the data transmission method for multi-screen cloud services includes the following steps:

[0128] In S602, the cloud platform receives receiver reports of transmission paths sent by multiple terminals. The transmission paths include end-to-end P2P transmission paths and end-to-cloud transmission paths. The receiver reports include transmission parameters.

[0129] In some embodiments, the receiver report includes one or more of the following transmission parameters: latency, estimated bandwidth, and packet loss rate.

[0130] In some embodiments, the method may further include: when providing multi-screen cloud services, determining whether the multiple terminals carrying the services have P2P transmission channels. Accordingly, receiving receiver reports of transmission paths sent by multiple terminals may be receiving receiver reports of transmission paths sent by multiple terminals with P2P transmission channels.

[0131] In some embodiments, determining whether multiple terminals carrying services have a P2P transmission channel includes: based on the WiFi P2P list reported by the terminals and combined with the multi-screen cloud service ID, determining whether there are terminals that can transmit via WiFi P2P and have the same multi-screen cloud service ID.

[0132] In S604, based on the transmission parameters of each transmission path, the path score of each P2P transmission path and the path score of each end-to-cloud transmission path are calculated.

[0133] In S606, based on the path score of the P2P transmission path and the path score of the end-to-cloud transmission path, the data transmission strategy for each terminal is determined among the end-to-cloud transmission strategy, P2P transmission strategy and hybrid transmission strategy, and then data transmission is performed.

[0134] When terminals use multi-screen cloud services, transmission can be achieved through end-to-end cloud transmission, P2P transmission, or a hybrid method. Hybrid transmission can combine end-to-end cloud transmission and P2P transmission. When terminals use multi-screen cloud services, the cloud platform selects the optimal transmission strategy based on the transmission path from the cloud platform to each terminal.

[0135] Terminals discover, scan, and connect to each other via WiFi P2P; the terminals send the list of connections discovered via WiFi P2P to the cloud platform; the cloud platform determines whether there is a P2P link between the terminals that can execute multi-screen cloud services based on the P2P connection list and the current multi-screen cloud service ID of the cloud terminal.

[0136] In some embodiments, when data is transmitted from the first terminal to the second terminal via P2P, the first terminal and the second terminal are controlled to perform transmission coordination, and the video stream and signaling stream are transmitted through the first terminal as a proxy.

[0137] Based on the same inventive concept, this disclosure also provides a data transmission method for multi-screen cloud services, such as... Figure 7 As shown, the data transmission method applied to multi-screen cloud services includes the following steps:

[0138] S702, the terminal sends a receiver report of the transmission path to the cloud platform. The transmission path includes an end-to-end P2P transmission path and an end-to-cloud transmission path. The receiver report includes transmission parameters so that the cloud platform can calculate the path score of each P2P transmission path and the path score of each end-to-cloud transmission path based on the transmission parameters of each transmission path. Based on the path scores of the P2P transmission paths and the end-to-cloud transmission paths, the cloud platform determines the data transmission strategy of each terminal among the end-to-cloud transmission strategy, P2P transmission strategy and hybrid transmission strategy, and performs data transmission.

[0139] In some embodiments, the method may further include: when the data transmission strategy selected by the cloud platform is a P2P transmission strategy or a hybrid transmission strategy, establishing a P2P transmission channel with the third terminal in response to the instructions of the cloud platform, and performing data transmission.

[0140] In some embodiments, the method may further include: negotiating network status with a third terminal; and controlling the delay of decoding playback based on the network status.

[0141] In embodiments of this disclosure, the terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0142] In this disclosure, the term "and / or" is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. Additionally, the character " / " in this document generally indicates that the preceding and following related objects have an "or" relationship.

[0143] Furthermore, although the steps of the method in this disclosure are described in a specific order in the accompanying drawings, this does not require or imply that the steps must be performed in that specific order, or that all the steps shown must be performed to achieve the desired result.

[0144] In some embodiments, certain steps may be omitted, multiple steps may be combined into one step for execution, and / or one step may be broken down into multiple steps for execution.

[0145] Based on the same inventive concept, this disclosure also provides a data transmission device for multi-screen cloud services, as described in the following embodiments. Since the principle by which this device embodiment solves the problem is similar to that of the above method embodiments, the implementation of this device embodiment can refer to the implementation of the above method embodiments, and repeated details will not be elaborated further.

[0146] Figure 8 This illustration shows a schematic diagram of a data transmission device applied to multi-screen cloud services according to an embodiment of the present disclosure, such as... Figure 8 As shown, the data transmission device 800 applied to multi-screen cloud services includes:

[0147] The report receiving module 802 is used for the cloud platform to receive receiver reports of transmission paths sent by multiple terminals. The transmission paths include end-to-end P2P transmission paths and end-to-cloud transmission paths. The receiver reports include transmission parameters.

[0148] The scoring calculation module 804 is used to calculate the path score of each P2P transmission path and the path score of each end-to-cloud transmission path based on the transmission parameters of each transmission path.

[0149] The strategy determination module 806 is used to determine the data transmission strategy for each terminal based on the path score of the P2P transmission path and the path score of the end-to-cloud transmission path, and to perform data transmission.

[0150] In some embodiments, the receiver report includes one or more of the following transmission parameters:

[0151] Latency, estimated bandwidth, packet loss rate.

[0152] In some embodiments, the data transmission device 800 applied to multi-screen cloud services may further include:

[0153] The judgment module is used to determine whether the multiple terminals carrying the service have a P2P transmission channel when providing multi-screen cloud services.

[0154] The report receiving module 802 is used to receive receiver reports from multiple terminals with P2P transmission channels and transmission paths.

[0155] In some embodiments, the judgment module is used to determine, based on the WiFi P2P list reported by the terminal and combined with the multi-screen cloud service ID, whether there is a terminal that can transmit via WiFi P2P and has the same multi-screen cloud service ID.

[0156] The judgment module controls the first and second terminals to coordinate transmission when data is transmitted from the first terminal to the second terminal via P2P, with video streams and signaling streams being transmitted through the first terminal.

[0157] Based on the same inventive concept, this disclosure also provides a schematic diagram of a data transmission device applied to multi-screen cloud services, such as... Figure 9 As shown, the data transmission device 900 applied to multi-screen cloud services includes:

[0158] The report sending module 902 is used by the terminal to send a receiver report of the transmission path to the cloud platform. The transmission path includes an end-to-end P2P transmission path and an end-to-cloud transmission path. The receiver report includes transmission parameters so that the cloud platform can calculate the path score of each P2P transmission path and the path score of each end-to-cloud transmission path based on the transmission parameters of each transmission path. Based on the path scores of the P2P transmission path and the end-to-cloud transmission path, the cloud platform determines the data transmission strategy of each terminal among the end-to-cloud transmission strategy, P2P transmission strategy and hybrid transmission strategy, and performs data transmission.

[0159] In some embodiments, the data transmission device 900 applied to multi-screen cloud services may further include:

[0160] The channel establishment module is used to establish a P2P transmission channel with the third terminal in response to the instructions of the cloud platform when the data transmission strategy selected by the cloud platform is a P2P transmission strategy or a hybrid transmission strategy, so as to carry out data transmission.

[0161] In some embodiments, the data transmission device 900 applied to multi-screen cloud services may further include:

[0162] The network negotiation module is used to negotiate network status with third-party terminals;

[0163] The delay control module is used to control the delay of decoding and playback based on the network status.

[0164] The concepts of "first" and "second" mentioned in this disclosure are used only to distinguish different devices, modules or units, and are not used to define the order of functions performed by these devices, modules or units or their interdependencies.

[0165] It should be noted that although several modules or units of the device used for action execution are mentioned in the detailed description above, this division is not mandatory.

[0166] In fact, according to embodiments of this disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units.

[0167] Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software, in one or more hardware modules or integrated circuits, or in different network and / or processor devices and / or microcontroller devices.

[0168] The following reference Figure 10 This describes the electronic device provided in the embodiments of this disclosure. Figure 10 The electronic device 1000 shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments disclosed herein.

[0169] Figure 10 This diagram illustrates the architecture of an electronic device 1000 according to an embodiment of the present invention. Figure 10 As shown, the electronic device 1000 includes, but is not limited to, at least one processor 1010 and at least one memory 1020.

[0170] Memory 1020 is used to store instructions.

[0171] In some embodiments, memory 1020 may include a readable medium in the form of volatile storage cells, such as random access memory (RAM) 10201 and / or cache memory 10202, and may further include read-only memory (ROM) 10203.

[0172] In some embodiments, the memory 1020 may also include a program / utility 10204 having a set (at least one) of program modules 10205, such program modules 10205 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each or some combination of these examples may include an implementation of a network environment.

[0173] In some embodiments, the memory 1020 may store an operating system. This operating system may be a real-time operating system (RTX), such as Linux, UNIX, Windows, or OS X.

[0174] In some embodiments, the memory 1020 may also store data.

[0175] As an example, processor 1010 can read data stored in memory 1020, which may be stored at the same memory address as the instruction, or the data may be stored at a different memory address than the instruction.

[0176] Processor 1010 is configured to invoke instructions stored in memory 1020 to implement the steps described in the "Exemplary Methods" section above, according to various exemplary embodiments of this disclosure. For example, processor 1010 may execute the steps of the above method embodiments.

[0177] It should be noted that the processor 1010 described above can be a general-purpose processor or a special-purpose processor. The processor 1010 may include one or more processing cores, and the processor 1010 executes various functional applications and data processing by running instructions.

[0178] In some embodiments, processor 1010 may include a central processing unit (CPU) and / or a baseband processor.

[0179] In some embodiments, the processor 1010 may determine an instruction based on the priority identifier and / or function category information carried in each control instruction.

[0180] In this disclosure, the processor 1010 and the memory 1020 can be configured separately or integrated together.

[0181] As an example, the processor 1010 and memory 1020 can be integrated on a single board or a system on chip (SOC).

[0182] like Figure 10As shown, the electronic device 1000 is embodied in the form of a general-purpose computing device. The electronic device 1000 may also include a bus 1030.

[0183] Bus 1030 can represent one or more of several types of bus structures, including a memory bus or memory controller, peripheral bus, graphics acceleration port, processor, or a local bus using any of the various bus structures.

[0184] The electronic device 1000 can also communicate with one or more external devices 1040 (e.g., keyboard, pointing device, Bluetooth device, etc.), and with one or more devices that enable a user to interact with the electronic device 1000, and / or with any device that enables the electronic device 1000 to communicate with one or more other computing devices (e.g., router, modem, etc.). Such communication can be performed through the input / output (I / O) interface 1050.

[0185] Furthermore, the electronic device 1000 can also communicate with one or more networks (such as local area networks (LANs), wide area networks (WANs), and / or public networks, such as the Internet) via the network adapter 1060.

[0186] like Figure 10 As shown, network adapter 1060 communicates with other modules of electronic device 1000 via bus 1030.

[0187] It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device 1000, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0188] It is understood that the structures illustrated in the embodiments of this disclosure do not constitute a specific limitation on the electronic device 1000. In other embodiments of this disclosure, the electronic device 1000 may include... Figure 10 This may involve more or fewer components, or combining certain components, or splitting certain components, or different component arrangements. Figure 10 The components shown can be implemented in hardware, software, or a combination of both.

[0189] This disclosure also provides a computer-readable storage medium storing computer instructions thereon, which, when executed by a processor, implement the data transmission method for multi-screen cloud services described in the above method embodiments.

[0190] In this embodiment of the disclosure, the computer-readable storage medium is a computer instruction that can be sent, propagated, or transmitted for use by or in conjunction with an instruction execution system, apparatus, or device.

[0191] As an example, a computer-readable storage medium is a non-volatile storage medium.

[0192] In some embodiments, more specific examples of computer-readable storage media in this disclosure may include, but are not limited to: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, USB flash drives, portable hard drives, or any suitable combination of the foregoing.

[0193] In this embodiment of the disclosure, the computer-readable storage medium may include data signals propagated in baseband or as part of a carrier wave, wherein computer instructions (readable program code) are carried.

[0194] The transmitted data signal can take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof.

[0195] In some examples, computational instructions contained on a computer-readable storage medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical fiber, RF, etc., or any suitable combination thereof.

[0196] This disclosure also provides a computer program product that stores instructions that, when executed by a computer, cause the computer to implement the data transmission method for multi-screen cloud services described in the above method embodiments.

[0197] The aforementioned instructions can be program code. In practice, the program code can be written using any combination of one or more programming languages.

[0198] Programming languages ​​include object-oriented programming languages—such as Java and C++—as well as conventional procedural programming languages—such as the "C" language or similar programming languages.

[0199] The program code can be executed entirely on the user's computing device, partially on the user's computing device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0200] In cases involving remote computing devices, the remote computing devices can be connected to user computing devices via any type of network, including local area networks (LANs) or wide area networks (WANs), or they can be connected to external computing devices (e.g., via the Internet using an Internet service provider).

[0201] This disclosure also provides a chip, including at least one processor and an interface;

[0202] An interface is used to provide program instructions or data to at least one processor;

[0203] At least one processor is used to execute program instructions to implement the data transmission method for multi-screen cloud services described in the above method embodiments.

[0204] In some embodiments, the chip may further include a memory for storing program instructions and data, the memory being located within or outside the processor.

[0205] Those skilled in the art will understand that all or part of the steps of the above embodiments can be specifically implemented in the following forms: a completely hardware implementation, a completely software implementation (including firmware, microcode, etc.), or a combination of hardware and software implementations, which can be collectively referred to as "circuit", "module" or "system".

[0206] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein.

[0207] This disclosure is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the appended claims.

Claims

1. A data transmission method for multi-screen cloud services, characterized in that, include: The cloud platform receives receiver reports of transmission paths sent by multiple terminals. The transmission paths include end-to-end P2P transmission paths and end-to-cloud transmission paths. The receiver reports include transmission parameters. Based on the transmission parameters of each transmission path, the path score of each P2P transmission path and the path score of each end-to-cloud transmission path are calculated. The overall system transmission path is calculated based on the path score of the P2P transmission path and the path score of the end-to-cloud transmission path. When a proxy transmission path exists, the transmission parameter change value of the proxy transmission path is estimated. Based on the characteristic that the video screens of each terminal in the multi-screen cloud service are the same, the bandwidth of the proxy terminal is determined to meet the requirements of video stream copying and forwarding. Based on the system transmission path, a data transmission strategy for each terminal is determined from the end-to-cloud transmission strategy, P2P transmission strategy, and hybrid transmission strategy, and data transmission is performed to synchronize the content displayed on the screens of the multiple terminals. When transmitting data from the first terminal to the second terminal via P2P, the first terminal and the second terminal are controlled to coordinate transmission, and the video stream and signaling stream are transmitted through the first terminal as a proxy.

2. The method according to claim 1, characterized in that, The receiver report includes one or more of the following transmission parameters: Latency, estimated bandwidth, packet loss rate.

3. The method according to claim 1, characterized in that, The method further includes: When providing multi-screen cloud services, determine whether the multiple terminals carrying the services have P2P transmission channels; The receiver report of the transmission path sent by multiple terminals includes: Receiver reports of transmission paths sent by multiple terminals with P2P transmission channels.

4. The method according to claim 3, characterized in that, Determining whether multiple terminals carrying the service have a P2P transmission channel includes: Based on the WiFi P2P list reported by the terminal, and combined with the multi-screen cloud service ID, determine whether there is a terminal that can transmit via WiFi P2P and has the same multi-screen cloud service ID.

5. A data transmission method applied to multi-screen cloud services, characterized in that, include: The terminal sends a receiver report of the transmission path to the cloud platform. The transmission path includes an end-to-end P2P transmission path and an end-to-cloud transmission path. The receiver report includes transmission parameters, enabling the cloud platform to calculate the path score of each P2P transmission path and the path score of each end-to-cloud transmission path based on the transmission parameters of each transmission path. Based on the path scores of the P2P transmission paths and the end-to-cloud transmission paths, the overall system transmission path is calculated. When a proxy transmission path exists, the change value of the transmission parameters of the proxy transmission path is estimated. Based on the characteristic that the video screens of each terminal in the multi-screen cloud service are the same, the bandwidth of the proxy terminal is determined to meet the requirements of video stream replication and forwarding. Based on the system transmission path, the data transmission strategy of each terminal is determined among the end-to-cloud transmission strategy, P2P transmission strategy, and hybrid transmission strategy, and data transmission is performed to synchronize the content displayed on multiple terminal screens. When transmitting data from the first terminal to the second terminal via P2P, the first terminal and the second terminal are controlled to coordinate transmission, and the video stream and signaling stream are transmitted through the first terminal as a proxy.

6. The method according to claim 5, characterized in that, The method further includes: When the data transmission strategy selected by the cloud platform is a P2P transmission strategy or a hybrid transmission strategy, a P2P transmission channel is established with the third terminal in response to the instructions of the cloud platform to carry out data transmission.

7. The method according to claim 6, characterized in that, The method further includes: Negotiate network status with the third terminal; The delay of decoding and playback is controlled based on the network status.

8. A data transmission device for multi-screen cloud services, characterized in that, include: The report receiving module is used for the cloud platform to receive receiver reports of transmission paths sent by multiple terminals. The transmission paths include end-to-end P2P transmission paths and end-to-cloud transmission paths. The receiver reports include transmission parameters. The scoring calculation module is used to calculate the path score of each P2P transmission path and the path score of each end-to-cloud transmission path based on the transmission parameters of each transmission path. The strategy determination module is used to calculate the overall system transmission path based on the path score of the P2P transmission path and the path score of the end-to-cloud transmission path. When a proxy transmission path exists, it estimates the transmission parameter changes of the proxy transmission path and, based on the characteristic that the video screens of each terminal in the multi-screen cloud service are the same, determines that the bandwidth of the proxy terminal meets the requirements for video stream replication and forwarding. Based on the system transmission path, it determines the data transmission strategy for each terminal among the end-to-cloud transmission strategy, P2P transmission strategy, and hybrid transmission strategy, and performs data transmission to synchronize the content displayed on the screens of the multiple terminals. Specifically, when transmitting data from the first terminal to the second terminal via P2P, the first terminal and the second terminal are controlled to perform transmission coordination, and the video stream and signaling stream are transmitted through the first terminal as a proxy.

9. A data transmission device for multi-screen cloud services, characterized in that, include: The report sending module is used by the terminal to send a receiver report of the transmission path to the cloud platform. The transmission path includes an end-to-end P2P transmission path and an end-to-cloud transmission path. The receiver report includes transmission parameters, so that the cloud platform can calculate the path score of each P2P transmission path and the path score of each end-to-cloud transmission path based on the transmission parameters of each transmission path. Based on the path scores of the P2P transmission paths and the end-to-cloud transmission paths, the overall system transmission path is calculated. When a proxy transmission path exists, the changes in the transmission parameters of the proxy transmission path are estimated. Based on the characteristic that the video screens of each terminal in the multi-screen cloud service are the same, the bandwidth of the proxy terminal is determined to meet the requirements of video stream replication and forwarding. Based on the system transmission path, the data transmission strategy of each terminal is determined among the end-to-cloud transmission strategy, P2P transmission strategy, and hybrid transmission strategy, and data transmission is performed to synchronize the content displayed on multiple terminal screens. Specifically, when transmitting data from the first terminal to the second terminal via P2P, the first terminal and the second terminal are controlled to perform transmission coordination, and the video stream and signaling stream are transmitted through the first terminal as a proxy.

10. An electronic device, characterized in that, include: Memory, used to store instructions; A processor is configured to invoke instructions stored in the memory to implement the data transmission method for multi-screen cloud services as described in any one of claims 1-7.

11. A computer-readable storage medium storing computer instructions thereon, characterized in that, When the computer instructions are executed by the processor, they implement the data transmission method for multi-screen cloud services as described in any one of claims 1-7.

Images