Multi-network collaborative operation method and device, and storage medium

Abstract

The invention provides a multi-network collaborative operation method and device and a storage medium. According to the method, when a WIFI network currently accessed by a first terminal device is not enough to meet the service requirements of multiple service flows needing to be processed in the first terminal device, the WIFI network and a hotspot network opened by a second terminal device are used at the same time, the service flows with high priorities are transmitted and received by the hotspot network, and other service flows are reserved in the WIFI network to be transmitted and received, so that the service requirements of the multiple service flows needing to be processed in the first terminal device are met. Therefore, the normal processing of the service flow can be ensured, and the consumption of the cellular flow can be reduced.

Description

[0001] This application is a divisional application. The application number of the original application is 202211470740.2, and the original application date is November 23, 2022. The entire contents of the original application are incorporated into this application by reference. Technical Field

[0002] The present application relates to the field of communication technology, and in particular to a multi-network collaborative operation method, device and storage medium. Background Art

[0003] The development and popularization of Internet technology has brought convenience to people's daily life, work and entertainment. For example, users can access wireless local area networks, such as WIFI networks, or cellular network (mobile network) terminal devices for audio and video conferencing, live broadcasting, games and other services.

[0004] However, for some terminal devices that only have WIFI communication capabilities but no cellular communication capabilities, when there is no available WIFI network or the WIFI network is poor, services that rely on the network, such as audio and video conferencing, live broadcasts, online games, etc., will not be able to be carried out. Summary of the invention

[0005] In order to solve the above technical problems, the present application provides a multi-network collaborative operation method, device and storage medium, which aims to enable terminal devices without cellular communication capabilities to perform business processing with the help of terminal devices with cellular communication capabilities, realize multi-network collaborative operation, and thus ensure that the business can proceed normally.

[0006] In the first aspect, the present application provides a multi-network collaborative operation method, which is applied to a first terminal device. The method includes: when there are first-priority business flows and second-priority business flows that need to be processed, obtaining the current WIFI network information; determining the user experience QoE quality evaluation result according to the WIFI network information, the first-priority business flows and the second-priority business flows, the QoE quality evaluation result is used to indicate whether the WIFI network can process the first-priority business flows and the second-priority business flows at the same time, and the first priority is higher than the second priority; when the QoE quality evaluation result indicates that the WIFI network cannot process the first-priority business flows and the second-priority business flows at the same time, the first-priority business flows are scheduled to the hotspot network opened by the second terminal device, and the second-priority business flows are scheduled to the WIFI network; wherein the second terminal device establishes a mobile connection with the base station through the cellular network, and establishes a wireless connection with the first terminal device through the hotspot network.

[0007] Therefore, when the WIFI network currently accessed by the first terminal device is insufficient to meet the business needs of multiple business flows that need to be processed in the first terminal device, the WIFI network and the hotspot network opened by the second terminal device are used at the same time, and the high-priority business flows are sent and received by the hotspot network, while other business flows are retained in the WIFI network for sending and receiving, thereby ensuring that the business flows are processed normally and reducing the consumption of cellular traffic.

[0008] According to the first aspect, during the process of the first terminal device using the WIFI network, the method also includes: determining the application currently running on the first terminal device, the application including a first application of a first priority and a second application of a second priority; using the service flow corresponding to the first application as the service flow of the first priority; and using the service flow corresponding to the second application as the service flow of the second priority.

[0009] As a result, concurrent processing of business flows between different applications is achieved. For details, please refer to the description of the application-level non-diversion mode below, which will not be repeated here.

[0010] According to the first aspect, or any implementation of the first aspect above, during the process of the first terminal device using the WIFI network, the method also includes: determining the application currently running on the first terminal device, the application including a first application of a first priority and a second application of a second priority; determining the source of the business flow corresponding to the first application; when the business flow corresponding to the first application comes from a business scenario, the business flow corresponding to the first application is used as a business flow of the first priority; when the source of the business flow corresponding to the first application includes at least two business scenarios, determining the priority corresponding to each business scenario; using the business flow corresponding to the business scenario with a high priority in the first application as a business flow of the first priority, and using the business flow corresponding to the business scenario with a low priority in the first application as a business flow of the second priority; determining the source of the business flow corresponding to the second application; when the business flow corresponding to the second application comes from a business scenario, using the business flow corresponding to the second application as a business flow of the second priority; when the source of the business flow corresponding to the second application includes at least two business scenarios, determining the priority corresponding to each business scenario; using the business flow corresponding to the business scenario with a high priority in the second application as a business flow of the first priority, and using the business flow corresponding to the business scenario with a low priority in the first application as a business flow of the second priority.

[0011] As a result, concurrent processing of business flows corresponding to different business scenarios in the same application is achieved. For details, please refer to the description of the concurrent diversion mode of different business flows in the same application below, which will not be repeated here.

[0012] According to the first aspect, or any implementation method of the first aspect above, determining the source of the business flow corresponding to the first application, including: determining the number of business scenarios included in the first application based on the attribute information of the first application; when the number of business scenarios included in the first application is 1, determining that the business flow corresponding to the first application comes from a business scenario; when the number of business scenarios included in the first application is greater than 1, determining the application programming interface called when the first application provides the business flow; wherein different application programming interfaces correspond to different business scenarios; deduplicating the called application programming interfaces to obtain the number of business scenarios for the business flow provided by the first application.

[0013] Therefore, by determining the number of business scenarios included in the first application, the source of the current business flow is determined, so that the subsequent business flow priority is determined based on the source of the business flow and concurrent diversion is performed, and scheduling to the WIFI network or hotspot network is more reasonable.

[0014] According to the first aspect, or any implementation method of the first aspect above, determine the source of the business flow corresponding to the second application, including: determining the number of business scenarios included in the second application based on the attribute information of the second application; when the number of business scenarios included in the second application is 1, determine that the business flow corresponding to the second application comes from a business scenario; when the number of business scenarios included in the second application is greater than 1, determine the application programming interface called when the second application provides the business flow; wherein different application programming interfaces correspond to different business scenarios; deduplicate the called application programming interfaces to obtain the number of business scenarios for the business flow provided by the second application.

[0015] Therefore, by determining the number of business scenarios included in the second application, the source of the current business flow is determined, so that the business flow priority is subsequently determined based on the source of the business flow and concurrent diversion is performed, and scheduling to the WIFI network or hotspot network is more reasonable.

[0016] According to the first aspect, or any implementation of the first aspect above, the method also includes: when the QoE quality evaluation result indicates that the WIFI network cannot process the first priority service flow or the second priority service flow, scheduling both the first priority service flow and the second priority service flow to the hotspot network turned on by the second terminal device.

[0017] Therefore, when there is no available WIFI network, by scheduling the service flow to be processed to the hotspot network, the first terminal device can be guaranteed to process the service normally and the user experience can be guaranteed. The specific implementation details can be found in the description section below in the two-choose-one network mode where only the hotspot network link exists, which will not be repeated here.

[0018] According to the first aspect, or any implementation of the first aspect above, after scheduling both the first-priority business flow and the second-priority business flow to the hotspot network turned on by the second terminal device, the method also includes: when the QoE quality evaluation result indicates that the WIFI network can process the first-priority business flow and the second-priority business flow at the same time, or searches for other accessible WIFI networks, stop scheduling the first-priority business flow and the second-priority business flow to the hotspot network, and schedule the first-priority business flow and the second-priority business flow to the WIFI network or search for other accessible WIFI networks.

[0019] Therefore, when there is an available WIFI network, all or part of the service flows are stopped from being scheduled to the hotspot network, and these service flows are scheduled to the WIFI network for processing, thereby reducing the consumption of cellular traffic of the second terminal device.

[0020] According to the first aspect, or any implementation of the first aspect above, the method also includes: when the QoE quality evaluation result indicates that the WIFI network can simultaneously process the first priority service flow and the second priority service flow, scheduling both the first priority service flow and the second priority service flow to the WIFI network.

[0021] Therefore, in the two-choose-one network mode, as long as there is an available WIFI network, the service flow that the first terminal device needs to process is scheduled to the WIFI network without relying on the hotspot network opened by the second terminal device, thereby reducing the consumption of cellular traffic of the second terminal device. For specific implementation details, please refer to the description section below in the two-choose-one network mode where only the WIFI network link exists, which will not be repeated here.

[0022] According to the first aspect, or any implementation of the first aspect above, the method also includes: determining whether the first terminal device has enabled the multi-network collaborative operation function; when the first terminal device has enabled the multi-network collaborative operation function, executing the step of scheduling the first priority service flow to the hotspot network enabled by the second terminal device; when the first terminal device has not enabled the multi-network collaborative operation function, displaying the first entrance; in response to the operation on the first entrance, enabling the multi-network collaborative operation function, and executing the step of scheduling the first priority service flow to the hotspot network enabled by the second terminal device.

[0023] Thus, by providing the first entrance, it is convenient for users to enable the multi-network collaborative operation function. The first entrance can be integrated into the setting interface corresponding to the setting application, such as Fig.12 The space 10b-1 is shown.

[0024] According to the first aspect, or any implementation of the first aspect above, before scheduling the first-priority service flow to the hotspot network opened by the second terminal device, the method also includes: determining whether to access the hotspot network opened by the second terminal device; when accessing the hotspot network opened by the second terminal device, executing the step of scheduling the first-priority service flow to the hotspot network opened by the second terminal device; when not accessing the hotspot network opened by the second terminal device, obtaining the hotspot network information within the connection range, the hotspot network information including the hotspot networks opened by all third terminal devices with cellular communication capabilities within the connection range; using the third terminal device with the best network quality of the hotspot network in the hotspot network information as the second terminal device; accessing the hotspot network opened by the second terminal device, and executing the step of scheduling the first-priority service flow to the hotspot network opened by the second terminal device.

[0025] Exemplarily, the method of searching for hotspot networks is similar to the existing method of searching for WIFI networks in a wireless LAN interface, and will not be described in detail here.

[0026] According to the first aspect, or any implementation of the first aspect above, after obtaining the hotspot network information within the connection range, the method also includes: displaying the hotspot network information in the interface of the first terminal device; in response to the user's selection operation of any hotspot network in the hotspot network information, using a third terminal device providing the hotspot network as a second terminal device, accessing the hotspot network turned on by the second terminal device, and executing the step of scheduling the first priority service flow to the hotspot network turned on by the second terminal device.

[0027] According to the first aspect, or any implementation of the first aspect above, before obtaining the hotspot network information within the connection range, the method also includes: determining whether a multi-screen collaborative connection is established between the first terminal device and the second terminal device; when a multi-screen collaborative connection is established between the first terminal device and the second terminal device, controlling the second terminal device to turn on the hotspot network, accessing the hotspot network turned on by the second terminal device, and executing the step of scheduling the first priority service flow to the hotspot network turned on by the second terminal device; when a multi-screen collaborative connection is not established between the first terminal device and the second terminal device, executing the step of obtaining the hotspot network information within the connection range.

[0028] According to the first aspect, or any implementation of the first aspect above, the priorities of the same application programs in different first terminal devices are the same, and the priorities of the same business scenarios are the same.

[0029] According to the first aspect, or any implementation of the first aspect above, the priorities of the same application in different first terminal devices are different, and the priorities of the same business scenarios are different.

[0030] In the second aspect, the present application provides a multi-network collaborative operation method, which is applied to a first terminal device. The method includes: in the process of displaying a first icon and a second icon in the display interface of the first terminal device, when there is a service flow that needs to be processed, the service flow of the first priority is scheduled to the hotspot network indicated by the second icon, and the service flow of the second priority is scheduled to the WIFI network indicated by the first icon; wherein the first priority is higher than the second priority, and the hotspot network is provided by the second terminal device that establishes a mobile connection with the base station.

[0031] For example, the style of the first icon is Fig.18 As shown in (a1) or (a2); the style of the second icon is, for example Fig.18 As shown in (b1), or as shown in (b2), or as shown in (b3).

[0032] According to the second aspect, the method further includes: when the first icon displayed in the display interface disappears and the second icon is displayed, when there is a business flow that needs to be processed, scheduling the business flow to the hotspot network indicated by the second icon.

[0033] According to the second aspect, or any implementation of the second aspect above, the method also includes: after redisplaying the first icon in the display interface, stopping scheduling the service flow to the hotspot network, and scheduling the service flow to the WIFI network indicated by the first icon; or, stopping scheduling the second priority service flow to the hotspot network, scheduling the first priority service flow to the hotspot network indicated by the second icon, and scheduling the second priority service flow to the WIFI network indicated by the first icon.

[0034] According to the second aspect, or any implementation of the second aspect above, the method also includes: when the second icon displayed in the display interface disappears and the first icon is displayed, when there is a business flow that needs to be processed, the business flow is scheduled to the WIFI network indicated by the first icon.

[0035] According to the second aspect, or any implementation method of the second aspect above, the first-priority business flow is the business flow generated by an audio or video call / conference type application or business scenario running in the foreground, and the second-priority business flow is the business flow generated by an application or business scenario running in the background.

[0036] Exemplarily, the priority relationship of different service flows can be found in Table 1 below, which will not be described in detail here.

[0037] According to the second aspect, or any implementation of the second aspect above, the first-priority business flow is the business flow generated by a game-type application or business scenario running in the foreground, and the second-priority business flow is the business flow generated by an application or business scenario running in the background.

[0038] Exemplarily, the priority relationship of different service flows can be found in Table 1 below, which will not be described in detail here.

[0039] The second aspect and any implementation of the second aspect correspond to the first aspect and any implementation of the first aspect respectively. The technical effects corresponding to the second aspect and any implementation of the second aspect can refer to the technical effects corresponding to the first aspect and any implementation of the first aspect, which will not be repeated here.

[0040] In the third aspect, the present application provides a multi-network collaborative operation collaboration. The system includes: a first terminal device and a second terminal device, the second terminal device establishes a mobile connection with a base station through a cellular network, and establishes a wireless connection with the first terminal device through a hotspot network; the first terminal device is used to: when there is a first-priority business flow and a second-priority business flow that need to be processed, obtain the current WIFI network information; according to the WIFI network information, the first-priority business flow and the second-priority business flow, determine the user experience QoE quality evaluation result, the QoE quality evaluation result is used to indicate whether the WIFI network can process the first-priority business flow and the second-priority business flow at the same time, and the first priority is higher than the second priority; when the QoE quality evaluation result indicates that the WIFI network cannot process the first-priority business flow and the second-priority business flow at the same time, the first-priority business flow is scheduled to the hotspot network opened by the second terminal device, and the second-priority business flow is scheduled to the WIFI network; the second terminal device is used to: through the cellular network, the first-priority business flow transmitted by the first terminal device through the hotspot network is scheduled to the base station for processing.

[0041] The third aspect and any implementation of the third aspect correspond to the first aspect and any implementation of the first aspect, or the second aspect and any implementation of the second aspect, respectively. The technical effects corresponding to the third aspect and any implementation of the third aspect can refer to the technical effects corresponding to the first aspect and any implementation of the first aspect, or the technical effects corresponding to the second aspect and any implementation of the second aspect, which will not be repeated here.

[0042] In a fourth aspect, the present application provides a terminal device. The terminal device includes: a memory and a processor, the memory and the processor are coupled; the memory stores program instructions, and when the program instructions are executed by the processor, the terminal device executes the instructions of the method in the first aspect or any possible implementation of the first aspect, or the second aspect and any possible implementation of the second aspect.

[0043] The fourth aspect and any implementation of the fourth aspect correspond to the first aspect and any implementation of the first aspect, or the second aspect and any implementation of the second aspect, respectively. The technical effects corresponding to the fourth aspect and any implementation of the fourth aspect can refer to the technical effects corresponding to the first aspect and any implementation of the first aspect, or the technical effects corresponding to the second aspect and any implementation of the second aspect, which will not be repeated here.

[0044] In a fifth aspect, the present application provides a computer-readable medium for storing a computer program, the computer program comprising instructions for executing the method in the first aspect or any possible implementation of the first aspect, or instructions for the method in the second aspect and any possible implementation of the second aspect.

[0045] The fifth aspect and any implementation of the fifth aspect correspond to the first aspect and any implementation of the first aspect, or the second aspect and any implementation of the second aspect, respectively. The technical effects corresponding to the fifth aspect and any implementation of the fifth aspect can refer to the technical effects corresponding to the first aspect and any implementation of the first aspect, or the technical effects corresponding to the second aspect and any implementation of the second aspect, which will not be repeated here.

[0046] In a sixth aspect, the present application provides a computer program comprising instructions for executing the method in the first aspect or any possible implementation of the first aspect, or instructions for the method in the second aspect and any possible implementation of the second aspect.

[0047] The sixth aspect and any implementation of the sixth aspect correspond to the first aspect and any implementation of the first aspect, or the second aspect and any implementation of the second aspect, respectively. The technical effects corresponding to the sixth aspect and any implementation of the sixth aspect can refer to the technical effects corresponding to the first aspect and any implementation of the first aspect, or the technical effects corresponding to the second aspect and any implementation of the second aspect, which will not be repeated here.

[0048] In a seventh aspect, the present application provides a chip, the chip comprising a processing circuit and a transceiver pin, wherein the transceiver pin and the processing circuit communicate with each other through an internal connection path, and the processing circuit executes the method in the first aspect or any possible implementation of the first aspect, or the method in the second aspect and any possible implementation of the second aspect, to control the receiving pin to receive a signal, and to control the sending pin to send a signal.

[0049] The seventh aspect and any implementation of the seventh aspect correspond to the first aspect and any implementation of the first aspect, or the second aspect and any implementation of the second aspect, respectively. The technical effects corresponding to the seventh aspect and any implementation of the seventh aspect can refer to the technical effects corresponding to the first aspect and any implementation of the first aspect, or the technical effects corresponding to the second aspect and any implementation of the second aspect, which will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] Figure 1 This is a schematic diagram showing an exemplary terminal device without cellular communication capability accessing a WIFI network through a router;

[0051] Figure 2 This is a schematic diagram of an interface for exemplarily performing business processing based on a WIFI network;

[0052] Figure 3 A schematic diagram showing an exemplary terminal device without cellular communication capability disconnecting from a router;

[0053] Figure 4 This is a schematic diagram of an interface for exemplarily showing a terminal device without cellular communication capability performing service processing after disconnecting from a WIFI network;

[0054] Figure 5 Another schematic diagram of an interface for exemplarily showing a terminal device without cellular communication capability performing service processing after disconnecting from a WIFI network;

[0055] Figure 6 A schematic diagram of the hardware structure of a terminal device is shown as an example;

[0056] Figure 7 A schematic diagram of the software structure of a terminal device of an operating system is shown as an example;

[0057] Figure 8 A schematic diagram of the software structure of a terminal device of another operating system is shown as an example;

[0058] Fig. 9 A network selection mode in a multi-network collaborative operation method provided by an embodiment of the present application is exemplarily shown;

[0059] Fig.10 For Fig. 9 A flowchart of a multi-network collaborative operation method in a network selection mode is shown;

[0060] Fig.11 One of the schematic diagrams of the interface for exemplarily providing a user entry to select a network selection mode;

[0061] Fig.12 The second schematic diagram of the interface for providing a user entry to select a network selection mode is shown as an example;

[0062] Fig.13 The third schematic diagram of the interface for providing a user entry to select a network selection mode is shown as an example;

[0063] Fig.14 Another network selection mode in the multi-network collaborative operation method provided by the embodiment of the present application is exemplarily shown;

[0064] Fig.15 For Fig.14 A flowchart of a multi-network collaborative operation method in a network selection mode is shown;

[0065] Fig.16 Another network selection mode in the multi-network collaborative operation method provided by the embodiment of the present application is exemplarily shown;

[0066] Fig.17 For Fig.16 A flowchart of a multi-network collaborative operation method in a network selection mode is shown;

[0067] Fig.18 is a schematic diagram of a first icon and a second icon shown as an example;

[0068] Fig.19 This is one of the schematic diagrams of the interface in a networkless environment after the multi-network collaborative operation function is enabled;

[0069] Fig. 20 The second schematic diagram of the interface in a networkless environment after the multi-network collaborative operation function is enabled is shown as an example;

[0070] Fig.21 The third schematic diagram of the interface in a networkless environment after the multi-network collaborative operation function is enabled is shown as an example;

[0071] Fig. 22 This is the fourth interface diagram showing an example of an interface in a networkless environment after the multi-network collaborative operation function is enabled. DETAILED DESCRIPTION

[0072] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0073] The term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0074] The terms "first" and "second" in the description and claims of the embodiments of the present application are used to distinguish different objects rather than to describe a specific order of objects. For example, a first target object and a second target object are used to distinguish different target objects rather than to describe a specific order of target objects.

[0075] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0076] In the description of the embodiments of the present application, unless otherwise specified, the meaning of "multiple" refers to two or more than two. For example, multiple processing units refer to two or more processing units; multiple systems refer to two or more systems.

[0077] In order to better understand the technical solution provided by the embodiments of the present application, before describing the technical solution of the embodiments of the present application, the applicable scenarios of the embodiments of the present application are first described in conjunction with the accompanying drawings.

[0078] For example, for some terminal devices that only have WIFI communication capabilities but no cellular communication capabilities, such as only wireless / wired network interfaces but no mobile network interfaces, or mobile network interfaces but no Subscriber Identity Module (SIM) that can provide cellular networks, when they want to process services that rely on the network, such as audio and video conferencing, live broadcasting, and online games, in some possible implementations, they need to first access the WIFI network with the help of a wireless / wired router, and then they can use the WIFI network to process services. Figure 1 As shown, when a user uses a tablet computer without cellular communication capability to handle business, the user can access the WIFI network through a wireless router.

[0079] For example, after the tablet computer is connected to the WIFI network through a wireless router, the tablet computer can be used to watch online videos. Figure 2As shown, when watching online videos using a WIFI network, if the user touches the current interface, in a feasible implementation, a playback progress bar of the online video will be displayed, as well as a control for pausing the current online video, and the current network connection status of the tablet computer and the connected network will be displayed in area 10a.

[0080] Continue to see Figure 2 For example, when the tablet computer is currently connected to a network and the connected network is a WIFI network, the word "WIFI" will be displayed in area 10a to indicate that the network currently connected to the tablet computer is a WIFI network.

[0081] For example, if the user carries the tablet computer and leaves the coverage of the wireless router, that is, leaves the place with the WIFI network, or the wireless router fails, or the WIFI network fails, resulting in the tablet computer being unable to access the available WIFI network, such as Figure 3 In this case, Figure 2 The word "WIFI" in area 10a on the interface of the tablet computer playing online videos will change to Figure 4 The words "No Network" are displayed in area 10a.

[0082] See also Figure 4 , for example, in one implementation, when the tablet computer is in a no-network state, the interface of the current online video playback may display the content shown in area 10b, and when the tablet computer reconnects to the WIFI network, it may automatically restore to Figure 2 The interface shown.

[0083] See also Figure 5 , exemplarily, in another implementation, when the tablet computer is in a no-network state, the interface currently playing the network video may directly turn into a black screen because no new data stream is obtained, and a prompt message "Video loading failed, please try again later" is displayed in the interface, as well as a control 10c for the user to retry.

[0084] For example, if the tablet computer reconnects to the WIFI network, when the user clicks the control 10c, the tablet computer will reacquire the data stream from the time when the video was interrupted for display, that is, restore to the time when the video was interrupted. Figure 2 In the interface shown, if the tablet computer has not been connected to a WIFI network, the user clicks control 10c and the interface may not change.

[0085] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0086] In view of this, the present application provides a multi-network collaborative operation method, which is applied to the above-mentioned terminal device (for the convenience of distinction, this embodiment is referred to as the first terminal device, and the terminal device providing the hotspot network is referred to as the second terminal device). Specifically, based on the multi-network collaborative operation method provided by the present application, for the first terminal device, when there are first-priority business flows and second-priority business flows that need to be processed, the current WIFI network information is obtained; based on the WIFI network information, the first-priority business flows and the second-priority business flows, the user experience QoE quality evaluation result is determined, and the QoE quality evaluation result is used to indicate whether the WIFI network can process the first-priority business flows and the second-priority business flows at the same time, and the first priority is higher than the second priority; when the QoE quality evaluation result indicates that the WIFI network cannot process the first-priority business flows and the second-priority business flows at the same time, the first-priority business flows are scheduled to the hotspot network opened by the second terminal device, and the second-priority business flows are scheduled to the WIFI network.

[0087] As a result, the first terminal device without cellular communication capability can perform service processing with the help of the second terminal device with cellular communication capability, realize multi-network collaborative operation, and thus ensure that the service can proceed normally.

[0088] In order to better understand the technical solution provided by the present application, before describing the technical solution of the present application, the hardware structure of the terminal device to which the technical solution of the present application is applicable is first described in conjunction with the accompanying drawings.

[0089] It can be seen from the above scenario description that in a possible implementation method, the technical solution of the present application is applicable to terminal devices that only have wireless / wired network interfaces but no mobile network interfaces, such as tablet computers, personal computers (PCs), laptops, large-screen devices (such as TVs), etc., which are not listed one by one here and the present application does not impose any restrictions on this.

[0090] Illustratively, in another possible implementation, the technical solution of the present application is applicable to a terminal device that has a wireless / wired network interface and a mobile network interface, but does not have a SIM card that can provide a cellular network, such as a smart phone, wearable device (smart watch), etc. These are not listed here one by one, and the present application does not impose any restrictions on this.

[0091] Exemplarily, in another implementation, the technical solution of the present application is applicable to a terminal device that has a wireless / wired network interface and a mobile network interface, and is inserted with a SIM card that can provide a cellular network.

[0092] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0093] In addition, from the above description, it can be seen that in actual applications, as long as there is a wireless / wired network interface and a terminal device with WIFI communication capability, regardless of whether it has a mobile network interface or whether it can currently use the cellular network provided by its own SIM card, when the WIFI network cannot support the current business, it can use the hotspot network opened by other terminal devices with cellular communication capabilities to process the business.

[0094] See also Figure 6 , exemplarily shows a schematic diagram of the hardware structure of a terminal device. It should be understood that Figure 6 The terminal device 100 shown is only an example of a terminal device that can be applied to the above-mentioned scenario, and the terminal device 100 may have more or fewer components than those shown in the figure, may combine two or more components, or may have a different component configuration. Figure 6 The various components shown in the EMBODIMENTS 2000 may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.

[0095] like Figure 6 As shown, the terminal device 100 may include: a central processing unit (CPU) 101, a memory 102 and a wired / wireless network interface 103, and the memory 102 stores one or more application programs or data.

[0096] The central processing unit 101 may be the nerve center and command center of the terminal device 100. The central processing unit 101 may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions. A memory may also be provided in the central processing unit 101 for storing instructions and data. In some implementations, the memory in the central processing unit 101 is a high-speed cache memory.

[0097] The memory 102 may be used to store computer executable program codes, which include instructions. The memory 102 may be a volatile memory or a persistent memory. The computer executable program codes stored in the memory 102 may include one or more modules, each of which may include a series of instruction operations in the terminal device. The memory 102 may include a program storage area and a data storage area.

[0098] Furthermore, the central processor 101 can be configured to communicate with the memory 102 to execute a series of instruction operations in the memory 102 on the terminal device 100. The central processor 101 executes various functions and data processing of the terminal device 100 by running the computer program instructions stored in the memory 102, for example, enabling the terminal device 100 to implement the multi-network collaborative operation method provided in the embodiment of the present application.

[0099] In addition, it should be noted that in some implementations, the terminal device 100 may include one or more central processors 101, one or more memories 102, and one or more wired / wireless network interfaces, which are determined by the product type of the terminal device, customer needs, etc., and this application does not impose any restrictions on this.

[0100] In addition, the terminal device 100 may also include one or more power supplies, sensors, display screens, etc., which are not listed here one by one and are not limited in this application.

[0101] The terminal device 100 can execute the operations executed by the first terminal device (a terminal device without cellular communication capability) in the following embodiments, and the details are not repeated here.

[0102] The software system of the terminal device 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes a layered architecture system as an example to exemplify the software structure of the terminal device 100.

[0103] Regarding the systems divided into architectures, such as Android, Windows Server™ (abbreviated as: Windows), Mac OSX™, Unix™, Linux™, FreeBSD™, etc., they are not listed one by one here, and this application does not limit this. For the convenience of explanation, this embodiment takes the Windows system and the Android system as examples, and describes the architectures of these two operating systems in conjunction with the accompanying drawings.

[0104] Figure 7 It is a software structure block diagram exemplarily showing the case where the terminal device 100 is a Windows system.

[0105] like Figure 7 As shown, for a terminal device 100 of a Windows system, its software structure can be divided into a user state (Windows User), a kernel state (Windows Kernel) and hardware.

[0106] Among them, the user state may include the application layer (application layer), framework layer / interface layer, modem (Modern), universal platform interface (UWP API), etc.

[0107] Exemplarily, the application layer may include settings, videos, games, downloads and other applications, which are not listed here one by one and are not limited in this application.

[0108] Exemplary, the framework layer / interface layer is, for example, Win32 API (Application Programming Interface for Microsoft 32-bit platform). It may include multiple interfaces for application programs in the application layer to call. Specifically, the technical solution provided in the embodiment of the present application mainly involves a perception module for perceiving the access environment and the current service flow.

[0109] It is understandable that in some implementations, the above two functions may be integrated into one function or into different functions, such as Figure 7 As shown, the access environment perception submodule can be separately encapsulated to perceive the access environment, and the service flow perception submodule can be encapsulated to perceive the current service flow. Therefore, by perceiving the above information, the specific concurrent scenario when multiple networks work together can be determined.

[0110] Exemplarily, the access environment perception submodule is specifically used to perceive the wireless network (WIFI network) environment. In some implementations, the access environment perception submodule can perceive whether there is an available WIFI network at the current location and the quality of the WIFI network based on multiple parameters such as the current signal strength, signal-to-noise ratio, noise, load, sending queue duration, sending rate, receiving rate, number of bytes sent, number of bytes received, number of packets sent, and number of packets received of the WIFI network.

[0111] Exemplarily, the business flow perception submodule is specifically used to perceive the following information of the current sent and received business flows, such as the number of data packets sent based on the Transmission Control Protocol (TCP) (TCP sent packets), the number of data packets received (TCP received packets), the number of bytes sent (TCP sent bytes), and the number of bytes received (TCP received bytes), as well as the number of data packets sent based on the User Datagram Protocol (UDP) (UDP sent packets), the number of data packets received (UDP received packets), the number of bytes sent (UDP sent bytes), and the number of bytes received (UDP received bytes), as well as round-trip delay, packet loss rate, retransmission rate, etc.

[0112] Therefore, after the above two sub-modules in the perception module perceive the WIFI network environment status and the relevant information of the currently received and sent business flow, they can hand over this information to the user interface framework (Windows Presentation Foundation, WPF) of the network driver layer in the kernel state, and then WPF determines whether it is necessary to use the hotspot network opened by the terminal device with cellular communication capability, and automatically selects the appropriate network selection mode according to the network selection mode selected by the user, or according to the currently running application / business scenario, and then according to the determined network selection mode, combined with the above access environment and business flow information provided by the perception module, all or part of the business flow is handed over to the hotspot network for sending and receiving processing, and the rest continues to be sent and received on the WIFI network.

[0113] For a description of the network selection mode and the sending and receiving processing of service flows under different network selection modes, see the following section for details. Figures 9 to 17 The description is not repeated here.

[0114] In addition, it should be noted that due to the differences in the operating systems of terminal devices, in actual applications, the parameters of the access environment information and business flow information perceived by the perception module may be different, but will basically include the parameter contents listed above. For other parameter information, reasonable selection can be made based on actual business needs and operating systems, which will not be repeated here.

[0115] In addition, regarding the determination of the currently running application / business scenario mentioned above, in some implementations, when an application is running in the foreground of the terminal device, the name of the currently running application can be determined based on the package name information in the data stream generated when the application is running. In this way, it is possible to know which application is currently running.

[0116] Exemplary, in other implementations, such as when it is necessary to be specific to the specific business scenario corresponding to the current application, for applications in multiple business scenarios, such as instant messaging applications, audio and video calls / conferences can be realized, files and chat messages can be sent, and content in Moments can be browsed, etc. It can be further determined that the current data stream is transmitted by calling which application programming interface (Application Programming Interface, API).

[0117] It is understandable that, since different business scenarios usually correspond to different APIs, the business scenario in which the terminal device is currently located can be determined by determining the currently called API.

[0118] Exemplarily, in other implementations, when it is impossible to determine the currently running application and the business scenario based on the package name information and the called API interface, it is also possible to perform image recognition analysis on the currently generated data stream through image recognition, and then obtain the currently running application / business scenario based on the page content corresponding to the data stream.

[0119] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0120] In addition, it should be noted that in order to facilitate the subsequent WPF to reasonably allocate network resources and allocate different business flows to the appropriate network, in some implementations, it is possible to prioritize the applications running on the terminal device or the business scenarios in which they are located. In this way, when allocating resources, it is possible to make reasonable allocations based on the priority of the application / business scenario, thereby better meeting the user's usage needs and improving the user experience.

[0121] Table 1 Priority matrix

[0122]

[0123] Exemplarily, Table 1 gives a priority matrix table of different application / business scenarios. Referring to Table 1, the corresponding content of the "foreground" row indicates that the application / business scenario of this type is currently running in the foreground of the terminal device (currently there is an active interface); the corresponding content of the "background" column indicates that the application / business scenario of this type is currently running in the background of the terminal device (currently there is no active interface); the content in the cell where the "foreground" and "background" contents meet indicates the current high-priority application / business scenario, that is, when processing business with the help of a hotspot network enabled by a terminal device with cellular communication capabilities, the object indicated in the cell where the "foreground" and "background" contents meet is the application / business scenario that needs to be scheduled to the hotspot network.

[0124] Continuing to refer to Table 1, illustratively, at a certain moment, when an audio or video call / conference type application or business scenario is running in the foreground of the terminal device, no matter what type of application / business scenario is running in the background, the priority of the audio or video call / conference type application or business scenario in the foreground is higher than that in the background, that is, the business flow corresponding to the audio or video call / conference type application or business scenario running in the foreground is to be scheduled to the hotspot network.

[0125] Continuing to refer to Table 1, illustratively, at a certain moment, when a game (in this application, online game) type application or business scenario is running in the foreground of the terminal device, no matter what type of application / business scenario is running in the background, the priority of the game type application or business scenario in the foreground is higher than that in the background, that is, the business flow corresponding to the game type application or business scenario running in the foreground is to be scheduled to the hotspot network.

[0126] Continuing to refer to Table 1, illustratively, at a certain moment, when the terminal device is currently running a download, or a browser, or an audio and video type application or business scenario, as long as there is an audio and video call / conference type application or business scenario running in the background, the priority of the audio and video call / conference type application or business scenario in the background is higher than that in the foreground, that is, the business flow corresponding to the audio and video call / conference type application or business scenario running in the background is to be scheduled to the hotspot network.

[0127] Continuing to refer to Table 1, illustratively, at a certain moment, when the terminal device is currently running a browser, or an audio and video type application or business scenario, as long as there is no audio and video call / conference type application or business scenario in the background running applications or business scenarios, the browser type, audio and video type application or business scenario in the foreground has a higher priority than that in the background, that is, the business flow corresponding to the browser type, audio and video type application or business scenario running in the foreground is to be scheduled to the hotspot network.

[0128] Continuing to refer to Table 1, exemplarily, when the terminal device is currently running a download-type application or business scenario, there is no audio or video call / conference type application or business scenario in the background running applications or business scenarios, and there is a game-type application or business scenario, the priority of the game-type application or business scenario in the background is higher than that in the foreground, that is, the business flow corresponding to the game-type application or business scenario running in the background is to be scheduled to the hotspot network; conversely, the priority of the download-type application or business scenario in the foreground is higher than that in the background, that is, the business flow corresponding to the download-type application or business scenario running in the foreground is to be scheduled to the hotspot network.

[0129] In addition, it should be noted that when limiting the network speed of background applications / business scenarios, that is, setting them to low priority, it is also necessary to consider whether the application / business scenario is in the preset whitelist (such as speed limit is not allowed and priority response is required). Accordingly, when it is in the whitelist, it cannot be set to low priority.

[0130] In addition, it should be noted that when setting priorities for applications / business scenarios in the foreground and background, the requirements for latency can also be considered. For example, for applications / business scenarios that are sensitive to latency (high real-time requirements and low latency requirements), such as audio and video calls / conferences, live broadcasts, online education, etc., they can be set to high priority.

[0131] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0132] Therefore, by assigning different priorities to different types of applications / business scenarios, WPF can schedule the business flows corresponding to high-priority applications / business scenarios to networks with better network quality when allocating resources. For example, when the quality of the WIFI network is poor and cannot meet the needs of high-priority applications / business scenarios, the business flows corresponding to high-priority applications / business scenarios can be scheduled to the hotspot network, and the business flows corresponding to low-priority applications / business scenarios can be kept on the WIFI network for processing.

[0133] Continue to see Figure 7 , exemplarily, the kernel state may include a system driver layer and a network driver layer.

[0134] Exemplarily, the system driver layer may include various system drivers, such as a WIFI driver (NativeWiFiFilter), an auxiliary function driver (Ancillary Function Driver), a Winsock Kernel that supports multiple types of transmission protocols, etc., which are not listed here one by one and are not limited in this application.

[0135] Exemplarily, the network driver layer, namely the Network Driver Interface Specification (NDIS) layer, may include various protocol drivers (Protocol Driver), various intermediate drivers (Intermediate Driver), various miniport drivers (Miniport Driver), WPF, and the Hardware Abstraction Layer (HAL).

[0136] Specifically in the technical solution provided in the embodiment of the present application, when performing multi-network collaborative operations, the allocation of network resources in concurrent scenarios is specifically implemented in WPF. The operations performed by the resource allocation module located in the kernel layer of the following Android system are similar to those performed by WPF in this embodiment, and the resource allocation processing logic of other operating systems is also roughly the same.

[0137] Regarding the technical solution provided in the embodiment of the present application, when performing multi-network collaborative operations, the allocation of network resources in concurrent scenarios can follow Table 2.

[0138] Table 2 Resource allocation rules

[0139]

[0140]

[0141] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0142] In addition, it should be noted that when allocating resources, that is, using a hotspot network enabled by a terminal device with cellular communication capabilities (the second terminal device), it is necessary to first ensure that the second terminal device has enabled the hotspot function and provided a hotspot network, and that the terminal device that currently does not have cellular communication capabilities (the first terminal device) can search for the hotspot network and automatically access the hotspot network. For details about enabling the hotspot function of the second terminal device and establishing a communication connection between the first terminal device and the second terminal device, please see below and will not be repeated here.

[0143] It can be seen from the above description that the technical solution provided by the embodiment of the present application needs to include application service startup. After the application service is started, the data flow (business flow) generated during the application service communication process can be collected. After the business flow is obtained, the application / business scenario can be identified, and the perception module perceives the current WIFI network environment and the current business flow (specifically, extracts the influencing factors of whether to trigger multi-network collaborative operations, such as the information included in the WIFI network and the information included in the business flow mentioned above), and then determines the current user experience / user perception (Quality of Finally, WPF (or the resource allocation module below) allocates resources according to the QoE quality evaluation results, the information recorded in Tables 1 and 2, and the content perceived by the perception module.

[0144] Continue to see Figure 7 For example, the hardware may include chips, graphics cards, sound cards, etc. provided by various chip manufacturers, which are not listed here one by one and are not limited in this application.

[0145] Understandably, Figure 7 The layers in the software structure shown and the components included in each layer do not constitute a specific limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 may include Figure 7The present application is not limited to the more or fewer layers shown and the more or fewer components included in each layer.

[0146] Figure 8 It is a software structure block diagram exemplarily showing the case where the terminal device 100 is an Android system.

[0147] like Figure 8 As shown, the layered architecture of the terminal device 100 divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some implementations, the Android system is divided into four layers, from top to bottom, namely, the application layer, the application framework layer, the Android runtime (Android runtime) and the system library, and the kernel layer.

[0148] The application layer may include a series of application packages. Figure 8 As shown, the application package may include games, settings, wireless local area network (Wireless Local Area Network, WLAN, for accessing WIFI network), video, download and other applications, which are not listed here one by one and are not limited in this application.

[0149] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. In some implementations, these programming interfaces and programming frameworks can be described as functions. Figure 8 As shown, the application framework layer may include functions such as a view system, a resource manager, and a perception module, which are not listed here one by one and are not limited in this application.

[0150] Exemplarily, in this embodiment, the perception module is a perception module for perceiving an access environment and a current service flow.

[0151] It is understandable that in some implementations, the above two functions may be integrated into one function or into different functions, such as Figure 8 As shown, the access environment perception submodule can be separately encapsulated to perceive the access environment, and the service flow perception submodule can be encapsulated to perceive the current service flow. Therefore, by perceiving the above information, the specific concurrent scenario when multiple networks work together can be determined. For details, see Figure 7 The description of the perception module will not be repeated here.

[0152] In addition, it should be noted that the view system located in the application framework layer includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying pictures.

[0153] In addition, it should be noted that the above-mentioned resource manager located in the application framework layer provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, etc., which are not listed one by one here and this application does not impose any restrictions on this.

[0154] Android Runtime includes core libraries and virtual machines. Android Runtime is responsible for scheduling and management of the Android system.

[0155] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0156] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0157] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0158] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0159] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0160] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0161] It can be understood that the 2D graphics engine mentioned above is a drawing engine for 2D drawing.

[0162] In addition, it is understandable that the kernel layer in the Android system is the layer between hardware and software. The kernel layer at least includes display drivers, Bluetooth drivers, WIFI drivers, camera drivers, and resource allocation modules for network resources in concurrent scenarios when performing multi-network collaborative operations. For details on the allocation of network resources, see Figure 7 The description of resource scheduling implemented in WPF is not repeated here.

[0163] Understandably, Figure 8 The layers in the software structure shown and the components included in each layer do not constitute a specific limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 may include Figure 8 The present application is not limited to the more or fewer layers shown and the more or fewer components included in each layer.

[0164] See also Fig. 9 , exemplarily illustrating a network selection mode in the multi-network collaborative operation method provided in an embodiment of the present application.

[0165] like Fig. 9 As shown in the figure, a two-choice network selection mode is given. For the two-choice network selection mode, only one network link is allowed to exist at the same time, for example, either Fig. 9 As shown in (1), a hotspot network is selected to send and receive data packets, either Fig. 9 As shown in (2), select the WIFI network to send and receive data packets.

[0166] For example, Fig. 9 In the scenario shown in (1), when the first terminal device is located in a place without a WIFI network, if no available WIFI network can be found, or the link between the first terminal device and the router connected to the WIFI network is interrupted, resulting in the inability to access the WIFI network, based on the multi-network collaborative operation method provided in the embodiment of the present application, the first terminal device can automatically switch to the second terminal device with the hotspot network turned on, and then use the hotspot network to send and receive data packets.

[0167] It should be noted that in actual applications, in order to ensure that the multi-network collaborative operation method provided in the embodiment of the present application can proceed smoothly, it is necessary to ensure that the first terminal device mentioned above can access the second terminal device and access the hotspot network opened by the second terminal device (for the first terminal device, the hotspot network is also a WIFI network).

[0168] Exemplarily, in some implementations, the multi-screen collaboration function is enabled for the first terminal device and the second terminal device. For example, when the interface content of the second terminal device is displayed on the display interface of the first terminal device, and the operation of the second terminal device is implemented through the interface of the second terminal device displayed in the display interface of the first terminal device, it is only necessary to enable the hotspot function in the second terminal device. When the first terminal device needs to connect to the cellular communication capability of the second terminal device, it can automatically access the hotspot network enabled by the second terminal device without performing operations such as hotspot search and password input, thereby processing services that rely on the network with the help of the cellular communication capability of the second terminal device.

[0169] For example, in some other implementations, when the first terminal device cannot access the WIFI network through the router (wireless or wired), Figures 3 to 5 When the problem is shown, a prompt message can be displayed on the interface of the first terminal device to prompt the user to operate the second terminal device to turn on the hotspot function. For example, the user can turn on the hotspot function on the second terminal device (you can set the hotspot name and hotspot password, or you can not set them), and then search for the hotspot network by operating the first terminal device and access it. In this way, when the first terminal device switches back to Figure 4 When the interface shown is displayed, it can automatically switch to the hotspot network, and subsequently when the second terminal device turns on the hotspot network, even if the first terminal device can access the WIFI network through the router, it can continue to use the hotspot network if it needs to use the WIFI network and the hotspot network to process business concurrently.

[0170] Exemplarily, in other implementations, a first terminal device can be set to initiate a hotspot request to a second terminal device registered and logged in using the same device account, so that the second terminal device in a set area with the first terminal device can automatically turn on the hotspot network in response to the request, thereby automatically connecting the first terminal to the hotspot network.

[0171] Regarding the use of the same device account mentioned above, for example, when the first terminal device is activated, the account registered and logged in is account A. If there is a second terminal device attached that also uses account A, then the second terminal device in the set area with the first terminal device will receive the hotspot request sent by the first terminal device.

[0172] Exemplarily, the hotspot request may be sent in a broadcasting form or a Bluetooth form, and this application does not impose any limitation on this.

[0173] Exemplarily, in other implementations, a first terminal device can be set to send a hotspot request to a second terminal device that also has the currently used application installed, and when the account used to log in to the application on the second terminal device is the same user account, the first terminal device can initiate a hotspot request so that a second terminal device within a set area with the first terminal device can automatically turn on the hotspot network in response to the request, thereby automatically connecting the first terminal device to the hotspot network.

[0174] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0175] For example, Fig. 9 In the scenario shown in (2), when the first terminal device re-accesses the WIFI network through the router, in order to reduce the consumption of cellular traffic of the second terminal device, it can automatically switch back to the WIFI network from the hotspot network, and the WIFI network will be used to send and receive data packets.

[0176] See also Fig.10 , showing an example of implementation Fig. 9 When the two-choose-one network selection mode is shown, the specific implementation process of the multi-network collaborative operation method provided in the embodiment of the present application is:

[0177] S101, determining applications currently running on a first terminal device, where the applications include a first application with a first priority and a second application with a second priority, where the first priority is higher than the second priority.

[0178] Exemplarily, in some implementations, the applications currently running on the first terminal device may all be foreground applications, for example, while using an audio or video application to watch audio or video content in small window mode, using an instant messaging application to send files and messages.

[0179] Exemplarily, in other implementations, the applications currently running on the first terminal device may all run corresponding programs in the background, for example, using a download-type application to download files while using a music-playing application to play music in the background.

[0180] Exemplarily, in other implementations, the applications currently running on the first terminal device may include some applications running in the foreground and others running in the background, such as using a download-type application to download files in the background and using a video playback application to watch videos in the foreground.

[0181] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0182] Regarding determining the application currently running on the first terminal device, for example, the package name information included in the currently acquired service flow can be extracted, and then the application providing the service flow, that is, the currently running application, can be determined based on the package name information.

[0183] In addition, for the identification of whether the currently running program is running in the foreground or in the background, for example, it can be determined whether the application has an active window (interface) on the display interface of the first terminal device. If so, it is an application running in the foreground, and if not, it is an application running in the background.

[0184] Accordingly, after the identification of the program running in the first terminal device is completed, its priority can be determined based on the attribute information corresponding to the application (indicating which type of application it is) and whether it is in the foreground or background.

[0185] It is understandable that the priority of each application can be determined, for example, according to Table 1 given above.

[0186] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0187] In this embodiment, the first terminal device currently runs at least two applications, and the priorities of the two applications are different, such as the first application with the first priority (high priority) and the second application with the second priority (low priority) mentioned above.

[0188] In addition, it should be noted that in some implementations, the same application running in different first terminal devices can be set to the same priority. For example, for the same application A, its priority on terminal device A, terminal device B, and terminal device C that do not have cellular communication capabilities is the same. In this way, the data table for indicating the priority of the application as shown in Table 1 can be uniformly managed and maintained by the server, and then sent to the corresponding first terminal device, or it can be retained in the server. When it is necessary to determine the priority, the first terminal device sends the name of the determined application and other information to the server to request the server to feedback the corresponding priority.

[0189] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0190] Exemplarily, in other implementations, the same application running in different first terminal devices may also be set to different priorities. For example, for the same application A, its priority on the terminal device A without cellular communication capability is the first priority mentioned above, while its priority on the terminal device B is the second priority mentioned above. In this way, the priority of the application can be set according to the needs of the user who actually uses the terminal device, so as to achieve different priorities for different people.

[0191] For this implementation scenario, in one implementation, for example, when the multi-network collaborative operation function is enabled, an entry for setting the priority of the currently installed application program may be provided.

[0192] Exemplarily, in another implementation, a priority matrix table suitable for the user may also be automatically generated based on the user's historical usage habits.

[0193] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0194] Similarly, for the business scenarios included in the same application, they can also be set based on the above logic, that is, the priorities of the same business scenarios in different first terminal devices can be the same or different, and the specific implementation method will not be repeated here.

[0195] S102, determining a user experience QoE quality evaluation result based on current WIFI network information, a service flow corresponding to the first application, and a service flow corresponding to the second application, wherein the QoE quality evaluation result is used to indicate whether the WIFI network can simultaneously process the service flow corresponding to the first application and the service flow corresponding to the second application.

[0196] The determination of the QoE quality evaluation result needs to be evaluated and determined based on the WiFi network information perceived by the access environment perception submodule and the service flow information perceived by the service flow perception submodule. The specific parameters and judgment criteria required in the evaluation can be set according to actual business needs and are not limited here.

[0197] S103, when the QoE quality evaluation result indicates that the WIFI network cannot process the service flow corresponding to the first application, nor can it process the service flow corresponding to the second application, the service flow corresponding to the first application and the service flow corresponding to the second application are both scheduled to the hotspot network opened by the second terminal device.

[0198] Understandably, this scenario, for example Fig. 9 The situation shown in (1).

[0199] S104, when the QoE quality evaluation result indicates that the WIFI network can simultaneously process the service flow corresponding to the first application and the service flow corresponding to the second application, schedule both the service flow corresponding to the first application and the service flow corresponding to the second application to the WIFI network.

[0200] Understandably, this scenario, for example Fig. 9 The situation shown in (2).

[0201] In addition, from the above description, it can be seen that in order to ensure that the first terminal device can schedule the business flow corresponding to the first application to the hotspot network opened by the second terminal device, before scheduling the business flow corresponding to the first application to the hotspot network opened by the second terminal device, the first terminal device can first determine whether the multi-network collaborative operation function is currently turned on, that is, based on the multi-network collaborative operation method provided in the embodiment of the present application, the function of processing business with the help of a terminal device with cellular communication capability is realized.

[0202] Accordingly, if this function is enabled, when the QoE quality evaluation result indicates that the WIFI network cannot process the service flow corresponding to the first application, nor can it process the service flow corresponding to the second application, the first terminal device can automatically schedule the service flow corresponding to the first application and the service flow corresponding to the second application to the hotspot network enabled by the second terminal device. Conversely, if this function is not enabled, it is not possible to schedule the service flow corresponding to the first application and the service flow corresponding to the second application to the hotspot network enabled by the second terminal device. In this case, in order to facilitate user use, a pop-up window can be displayed on the current interface to prompt the user to enable this function.

[0203] For example, in some implementations, an entry (first entry) for starting the function can be directly provided in the pop-up window, so that the user does not need to exit the current interface, but can find the entry for starting the function from the specified interface to start the function, and directly operate the first entry, such as clicking, to start the function. Accordingly, after starting the function, the first terminal device can automatically schedule the service flow corresponding to the first application and the service flow corresponding to the second application to the hotspot network started by the second terminal device.

[0204] In addition, it should be noted that when determining whether the user has turned on this function (multi-network collaborative operation function), it can also be further determined whether the first terminal device is currently connected to an available hotspot network, such as the hotspot network turned on by the second terminal device mentioned above.

[0205] Accordingly, if access is made, the first terminal device can automatically schedule the service flow corresponding to the first application and the service flow corresponding to the second application to the hotspot network opened by the second terminal device. Conversely, if access is not made, the hotspot network opened by the second terminal device needs to be connected first, and then the service flow corresponding to the first application and the service flow corresponding to the second application can be scheduled to the hotspot network opened by the second terminal device.

[0206] Regarding the method for the first terminal device to access the hotspot network opened by the second terminal device, for example, it can be through searching for hotspot network information within the connection range (hotspot networks opened by all third terminal devices with cellular communication capabilities within the connection range), and then automatically selecting a hotspot network with the best network quality from the hotspot network information as the hotspot network to be accessed, that is, the hotspot network opened by the second terminal device mentioned above.

[0207] For example, in other implementations, in order to improve user participation and better meet the actual needs of users, the searched hotspot network information can be displayed in the display interface of the first terminal device, so that the user can select a safe and available hotspot network.

[0208] Correspondingly, when receiving the user's selection operation on the hotspot network in the hotspot network information, the hotspot network provided by the third terminal device selected by the user can be accessed as the hotspot network of the second terminal device mentioned above.

[0209] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0210] In addition, from the above description, it can be seen that when a multi-screen collaborative connection is established between the first terminal device and the second terminal device, for example, the current interface content of the second terminal device is displayed in the display interface of the first terminal device, and the user can perform operations through the interface of the second terminal device displayed in the first terminal device, and then control the second terminal device to make a corresponding response, the first terminal device can directly control the second terminal device to turn on the hotspot network, and then access the hotspot network.

[0211] Therefore, the multi-network collaborative operation method provided in this embodiment, when the WIFI network currently connected to the first terminal device is unavailable, processes services through the hotspot network opened by the second terminal device with cellular communication capabilities, thereby ensuring that the first terminal device without cellular communication capabilities can also process network-dependent services in the scenario where there is no available WIFI network, avoiding business interruptions and thus ensuring user experience.

[0212] It is understandable that in order to improve user participation, in actual applications, a user portal can be provided, and the user can select a network selection mode according to his needs, such as the two-choice network selection mode mentioned above, and the application-level concurrent diversion network selection mode and the network selection mode for concurrent diversion of different business flows in the same application mentioned below.

[0213] For example, in some implementations, the user portal may be integrated into an application specifically managing multi-network collaborative operation functions, or may be integrated into a setting application. This embodiment takes integration into a setting application as an example and is described in conjunction with the accompanying drawings.

[0214] See also Fig.11 For example, taking a tablet computer as the first terminal device mentioned in this article, the display interface of the tablet computer displays the home page of the tablet computer. The home page includes one or more controls, such as icons of installed applications, a battery icon, a WIFI icon, etc. For example, after a user clicks the icon of a settings application displayed on the home page, the tablet computer responds to the user's operation behavior, starts the settings application, and displays the settings interface, such as Fig.12 shown.

[0215] See also Fig.12 For example, for a tablet computer with a larger screen area, its setting interface can be divided into area 10a and area 10b. Among them, area 10a can display one or more setting function options, such as "more connections", "desktop and wallpaper", "display and brightness", "multi-network collaboration", "sound and vibration", "notification", "battery", "storage", and search controls for users to search for these setting function options, etc., which are not listed here one by one, and this embodiment does not limit this.

[0216] It should be noted that in some implementations, the setting function option of "multi-network collaboration" can be as follows: Fig.12 As shown, it is directly displayed in area 10a. For this scenario, the user directly selects the "multi-network collaboration" function, and area 10b will display the content of setting the multi-network collaboration function.

[0217] For example, in some other implementations, the setting function option of "multi-network collaboration" can also be set in the directory of other setting function options displayed in area 10a. Corresponding to this scenario, when the user selects the setting function option, the setting entry of "multi-network collaboration" will be displayed in the content displayed in area 10b. Fig.12 The form shown is taken as an example.

[0218] Continue to see Fig.12 , for example, in some implementations, the multi-network collaboration function may be in an unenabled state by default, that is, the control 10b-1 for enabling the multi-network collaboration function is in Fig.12 Style shown.

[0219] For example, when a user clicks Fig.12 After the control 10b-1 shown in the figure is opened, the tablet computer responds to the user's operation behavior and turns on the multi-network collaboration function. The style of the control 10b-1 is switched to Fig.13 The style shown in .

[0220] For example, in order to facilitate users to set the network selection mode to be followed by the tablet computer when performing multi-network collaborative operations after the multi-network collaborative function is enabled, the style of the control 10b-1 is switched to Fig.13 After the style shown in , the area 10b may also display a control 10b-2 for selecting a network selection mode, such as Fig.13 shown.

[0221] See also Fig.13 For example, the control 10b-2 for selecting the network selection mode may provide a control 10b-21 for selecting a "two-choice network selection mode", a control 10b-22 for selecting an "application-level concurrent classification mode", and a control 10b-23 for selecting a "concurrent diversion mode of different business flows of the same application".

[0222] For example, in some implementations, it can be assumed that the controls 10b-21, 10b-22, and 10b-23 are all in an unactivated state. Fig.13 In this way, after the user turns on the multi-network collaboration function and displays the control 10b-2 in the area 10b, he can choose to turn it on according to his actual usage needs. Fig.13 Any one or several network selection modes shown in .

[0223] Exemplarily, when the user only turns on one network selection mode among controls 10b-21, controls 10b-22, and controls 10b-23, when the multi-network collaboration function is turned on, when an abnormality occurs in the WIFI network connected to the tablet computer, operations will only be performed according to the currently turned-on network selection mode. For example, when only the two-choice network selection mode is selected, only one network can be selected at the same time, and the WIFI network and the hotspot network are not allowed to operate at the same time.

[0224] For example, when a user turns on multiple network modes in controls 10b-21, 10b-22, and 10b-23, when the multi-network collaboration function is turned on, if an abnormality occurs in the WIFI network to which the tablet computer is connected, business processing can be performed according to the current WIFI network conditions and in accordance with the appropriate network selection mode. For example, when controls 10b-22 and 10b-23 are turned on at the same time, while performing application-level concurrent diversion, different business flows of each application can also be concurrently diverted.

[0225] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0226] In addition, it should be noted that, in order to reduce user operations, a control 10b-24 for selecting an "autonomous mode" can also be provided in the control 10b-2. Wherein, when the "autonomous mode" is turned on, regardless of whether the controls 10b-21, 10b-22, and 10b-23 are turned on, during the process of turning on the multi-network collaboration function, the tablet computer can autonomously switch between the two-choice network selection mode, the application-level concurrent diversion mode, and the same application different business non-classification mode according to the current WIFI network situation and the source of the business flow to be processed (application / business scenario), so as to make the multi-network collaboration operation effect better.

[0227] In addition, it should be understood that for terminal devices with smaller screen areas, such as mobile phones, smart watches, etc., when you click the icon of the settings application to start the settings application and enter the settings interface, the display interface may only show the content in the above-mentioned area 10a. When the user clicks the multi-network collaboration control, the terminal device responds to the user's operation and jumps to the interface of the content of display area 10b.

[0228] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0229] See also Fig.14 , exemplarily illustrating another network selection mode in the multi-network collaborative operation method provided in an embodiment of the present application.

[0230] like Fig.14 As shown in Figure 1, a network selection mode for application-level concurrent distribution is given. For the network selection mode for application-level concurrent distribution, at the same moment, both network links exist, that is, Fig.14 The WIFI network link accessed by the first terminal device through the router and the hotspot network link accessed by the second terminal device exist at the same time. Regarding the second terminal device turning on the hotspot function, the description of the first terminal device accessing the hotspot network turned on by the second terminal device is as described above, which will not be repeated here.

[0231] Exemplarily, when the user selects the network selection mode of application-level concurrent diversion, when multiple applications are running in the first terminal device (using the network to send and receive data packets), the first terminal device can perceive the business flows (data packets) provided by different applications through the perception module, as well as the network requirements of the business scenarios currently processed by each application, and then hand over the data packets of applications with high network requirements (such as high latency requirements and high bandwidth requirements) to the hotspot network for sending and receiving processing, while handing over the data packets of applications with low network requirements (such as low latency requirements and low bandwidth requirements) to the WIFI network for sending and receiving processing, thereby achieving the processing effect of concurrent diversion.

[0232] For example, regarding the above-mentioned applications with high network requirements (such as high latency requirements and high bandwidth requirements), such as audio and video conferencing, audio and video playback, online education, online games, etc., they are not listed here one by one, and this application does not impose any restrictions on this.

[0233] For example, regarding the above-mentioned applications with low network requirements (such as low latency requirements and low bandwidth requirements), sunset instant messaging, email and other applications are not listed here one by one, and this application does not impose any restrictions on this.

[0234] See also Fig.15 , showing an example of implementation Fig.14 When the network selection mode of application-level concurrent distribution is shown, the specific implementation process of the multi-network collaborative operation method provided in the embodiment of the present application is:

[0235] S201, determining applications currently running on a first terminal device, where the applications include a first application with a first priority and a second application with a second priority, where the first priority is higher than the second priority.

[0236] S202, determining a user experience QoE quality evaluation result based on current WIFI network information, a service flow corresponding to the first application, and a service flow corresponding to the second application, wherein the QoE quality evaluation result is used to indicate whether the WIFI network can simultaneously process the service flow corresponding to the first application and the service flow corresponding to the second application.

[0237] The implementation details of step S201 and step S202 may refer to step S101 and step S102 in the above embodiment, which will not be described again here.

[0238] S203, when the QoE quality evaluation result indicates that the WIFI network cannot simultaneously process the service flow corresponding to the first application and the service flow corresponding to the second application, the service flow corresponding to the first application is scheduled to the hotspot network turned on by the second terminal device, and the service flow corresponding to the second application is scheduled to the WIFI network.

[0239] Therefore, the multi-network collaborative operation method provided in this embodiment, when the WIFI network currently connected to the first terminal device is insufficient to meet the business needs of multiple applications running in the first terminal device, simultaneously uses the WIFI network and the hotspot network turned on by the second terminal device, and sends and receives data packets of applications with high latency requirements to the hotspot network, while data packets of other applications are retained in the WIFI network for sending and receiving, thereby ensuring that the business of multiple applications in operation is processed normally and reducing the consumption of cellular traffic.

[0240] See also Fig.16 , exemplarily illustrating another network selection mode in the multi-network collaborative operation method provided in an embodiment of the present application.

[0241] like Fig.16 As shown in Figure 1, a network selection mode for concurrent distribution of different business flows in the same application is given. For the network selection mode for concurrent distribution of different business flows in the same application, at the same moment, both network links exist, that is, Fig.16 The WIFI network link accessed by the first terminal device through the router and the hotspot network link accessed by the second terminal device exist at the same time. Regarding the second terminal device turning on the hotspot function, the description of the first terminal device accessing the hotspot network turned on by the second terminal device is as described above, which will not be repeated here.

[0242] Exemplarily, when the user selects a network selection mode for concurrent shunting of different business flows, when the application currently running in the first terminal device includes multiple business scenarios, such as a certain application having a business scenario of audio and video calls / conferences, and a business scenario of simply sending instant messaging messages and files, when the user uses the application for audio and video calls / conferences, the user also sends or receives files to a contact. In addition, if the perception module perceives that the currently connected WIFI network is insufficient to simultaneously support the sending and receiving of data packets generated in these two business scenarios, the resource allocation module can distribute through different networks according to the requirements of the corresponding networks for different business scenarios perceived by the perception module. For example, business scenarios with high network requirements (such as high latency requirements and bandwidth requirements), such as data packets corresponding to audio and video calls / conferences, are handed over to the hotspot network for sending and receiving processing, while business scenarios with low network requirements (such as low latency requirements and bandwidth requirements), such as data packets for sending files and messages, are handed over to the WIFI network for sending and receiving processing, thereby achieving the processing effect of concurrent shunting.

[0243] See also Fig.17 , showing an example of implementation Fig.16 When the network selection mode of concurrent diversion of different business flows of the same application is shown, the specific implementation process of the multi-network collaborative operation method provided in the embodiment of the present application is:

[0244] S301, determining applications currently running on a first terminal device, where the applications include a first application with a first priority and a second application with a second priority, where the first priority is higher than the second priority.

[0245] S302, determining a user experience QoE quality evaluation result based on the current WIFI network information, the service flow corresponding to the first application, and the service flow corresponding to the second application, wherein the QoE quality evaluation result is used to indicate whether the WIFI network can simultaneously process the service flow corresponding to the first application and the service flow corresponding to the second application.

[0246] The implementation details of step S301 and step S302 may refer to step S101 and step S102 in the above embodiment, which will not be described again here.

[0247] S303, when the QoE quality evaluation result indicates that the WIFI network cannot process the business flow corresponding to the first application and the business flow corresponding to the second application at the same time, the business flow corresponding to the high-priority business scenario in the first application is scheduled to the hotspot network opened by the second terminal device, and the business flow corresponding to the low-priority business scenario is scheduled to the WIFI network, the business flow corresponding to the high-priority business scenario in the second application is scheduled to the hotspot network opened by the second terminal device, and the business flow corresponding to the low-priority business scenario is scheduled to the WIFI network.

[0248] Specifically, for concurrent processing of different business flows within the same application, it is necessary to determine the source of the business flow corresponding to the application in the specific implementation. Specifically in this embodiment, for example, it is necessary to determine the source of the business flow corresponding to the first application, and to determine the source of the business flow corresponding to the second application. That is, the source of each business flow that needs to be processed.

[0249] Exemplarily, when the service flow comes from a service scenario, the network resources are allocated according to the priority corresponding to the application. For example, when the service flow corresponding to the first application comes from a service scenario, the priority corresponding to the first application (first priority) is followed, and the service flow corresponding to the first application is scheduled to the hotspot network opened by the second terminal device. Correspondingly, when the service flow corresponding to the second application comes from a service scenario, the priority corresponding to the second application (second priority) is followed, and the service flow corresponding to the second application is scheduled to the WIFI network.

[0250] Exemplarily, when the source of the service flow includes at least two service scenarios, the network resources are allocated for the service flow generated in each service scenario according to the priority of the service scenario, for example, the service flow corresponding to the service scenario with a high priority in the first application is scheduled to the hotspot network opened by the second terminal device, and the service flow corresponding to the service scenario with a low priority is scheduled to the WIFI network. Accordingly, the service flow corresponding to the service scenario with a high priority in the second application is scheduled to the hotspot network opened by the second terminal device, and the service flow corresponding to the service scenario with a low priority is scheduled to the WIFI network.

[0251] Regarding the method of determining the source of the business flow, for example, it can be by judging the number of business scenarios included in the application that provides the business flow.

[0252] Accordingly, when the number of business scenarios is 1, it is determined that the business flow comes from one business scenario; when the number of business scenarios is greater than 1, it is determined that the application programming interface called when the application (first application, second application) provides the business flow.

[0253] It is understandable that, usually, different application programming interfaces correspond to different business scenarios. Therefore, when determining the application programming interface called when providing a business flow, by deduplicating the called application programming interfaces, the number of business scenarios providing the business flow can be determined based on the number of called application programming interfaces after deduplication.

[0254] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0255] Therefore, in the multi-network collaborative operation method provided by this embodiment, when the application currently running on the first terminal device has multiple business scenarios, and the WIFI network currently connected to the first terminal device is insufficient to meet the transmission and reception of data packets generated in the business scenarios with high bandwidth and latency requirements in these business scenarios, the WIFI network and the hotspot network opened by the second terminal device are used simultaneously, and the data packets generated in the business scenarios with high latency and bandwidth requirements are sent and received by the hotspot network, and the data packets generated in other business scenarios are retained in the WIFI network for transmission and reception, thereby ensuring that the data packets in different business scenarios under the same application can be processed normally and reducing the consumption of cellular traffic.

[0256] In addition, it is understood that in order to implement the above functions, the terminal device includes hardware and / or software modules corresponding to the execution of each function. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of this application.

[0257] In addition, it should be noted that in actual applications, the first terminal device can also be set to automatically switch among the above three network selection modes. That is, when the multi-network collaborative operation function is turned on, all three network modes are checked by default, so that in the subsequent use of the first terminal device, the perception module determines which network selection mode is suitable for the current business scenario, and the resource allocation module dispatches different business flows to different networks based on the corresponding network selection mode, such as WIFI network or hotspot network, so that the multi-network collaborative operation is more in line with the actual scenario, better meets the user's usage needs, and improves the user experience.

[0258] In order to better understand the changes in the interface of the first terminal device when the multi-network collaborative operation function is enabled in the manner described in the above embodiment and a service flow needs to be processed, the first terminal device performs multi-network collaborative operation according to the network selection mode set by the user or the network selection mode automatically selected by the system according to the network status, the following is combined with Figures 18 to 22 Provide specific instructions.

[0259] See also Fig.18 , exemplarily showing the icon style displayed on a first terminal device, such as a tablet computer, after connecting to a WIFI network (referred to as the first icon in this embodiment), and the icon style displayed on the first terminal device after connecting to a hotspot network opened by a second terminal device (referred to as the second icon in this embodiment). Exemplarily, for the first icon, it can be as follows Fig.18 As shown in (a1), it can also be Fig.18 As shown in (a2); for the second icon, it can be as follows Fig.18 As shown in (b1), it can also be Fig.18 As described in (b2), it is also possible to Fig.18 Total (b3) shown.

[0260] It should be understood that the above description is only an example for better understanding the technical solution of this embodiment, and is not the only limitation of this embodiment. Fig.18 As shown in (a1), the second icon is Fig.18 Take (b2) as an example.

[0261] See also Fig.19 , exemplarily, when the first terminal device is a tablet computer, the user turns on the multi-network collaborative operation function in the manner given in the above embodiment, and sets the network selection mode to the application-level concurrent diversion mode (control 10b-22 is selected and is in the turned-on state, such as the style of control 10b-1) or the automatic mode (control 10b-24 is selected and is in the turned-on state, such as the style of control 10b-1), if there are currently available WIFI networks and hotspot networks, the tablet computer will connect to the WIFI network and the hotspot network, and the first icon and the second icon will be displayed simultaneously in the display interface.

[0262] Continue to see Fig.19 For example, when APP1 is running in the foreground of the tablet computer and the user uses it to watch audio and video images, it is necessary to use network resources to process the service flow 1 corresponding to the audio and video images of APP1, such as obtaining the service flow corresponding to the audio and video images from the server corresponding to APP1 and displaying it on the display interface of the tablet computer. If the user also uses APP2 to download files in the background while watching the audio and video images through APP1, the download icon will be displayed on the display interface of the tablet computer, such as Fig.19 As shown, the download icon indicates that APP2 is running in the background to download files. At this time, there will be a business flow 2 corresponding to the downloaded file that needs to use network resources for processing. Fig.19 In the scenario where the business flows corresponding to the two applications shown need to be processed using network resources, the business flow with higher priority among business flow 1 and business flow 2 can be scheduled to the hotspot network indicated by the second icon, while the business flow with lower priority can be scheduled to the WIFI network indicated by the first icon.

[0263] For example, through the description of the priority matrix table shown in Table 1 in the above embodiment, it can be known that the priority of the business flow generated in the audio and video type application or business scenario running in the foreground is higher than the priority of the download type application or business scenario running in the background. Therefore, when business flow 1 is of audio and video type and business flow 2 is of download type, the priority of business flow 1 is higher than the priority of business flow 2, so business flow 1 will be scheduled to the hotspot network indicated by the second icon, and business flow 2 will be scheduled to the WIFI network indicated by the first icon. In this way, concurrent diversion of business flows corresponding to different applications is achieved.

[0264] See also Fig. 20, exemplarily, when the first terminal device is a tablet computer, the user turns on the multi-network collaborative operation function in the manner given in the above embodiment, and sets the network selection mode to the concurrent diversion mode of different business flows of the same application (control 10b-23 is selected and is in the turned-on state, such as the style of control 10b-1) or the automatic mode (control 10b-24 is selected and is in the turned-on state, such as the style of control 10b-1), if there are currently available WIFI networks and hotspot networks, the tablet computer will connect to the WIFI network and the hotspot network, and the first icon and the second icon will be displayed on the display interface at the same time.

[0265] Continue to see Fig. 20 For example, when APP1 is running in the foreground of the tablet computer and the user uses it to watch audio and video images, it is necessary to use network resources to process the service flow 1 corresponding to the audio and video images of APP1, such as obtaining the service flow corresponding to the audio and video images from the server corresponding to APP1, and displaying it on the display interface of the tablet computer. If the user also uses APP1 to download files, such as downloading other audio and video content, while watching the audio and video images through APP1, the download icon will be displayed on the display interface of the tablet computer, such as Fig. 20 As shown, the download icon indicates that APP1 is downloading a file. At this time, there will be a business flow 3 corresponding to the downloaded file that needs to be processed using network resources. Fig. 20 In the scenario shown, different business flows corresponding to the same application need to be processed using network resources. The business flow with higher priority among business flow 1 and business flow 3 can be scheduled to the hotspot network indicated by the second icon, while the business flow with lower priority can be scheduled to the WIFI network indicated by the first icon.

[0266] For example, through the description of the priority matrix table shown in Table 1 in the above embodiment, it can be known that the priority of the business flow generated in the audio and video type application or business scenario running in the foreground is higher than the priority of the download type application or business scenario running in the background. Therefore, when business flow 1 is of audio and video type and business flow 3 is of download type, the priority of business flow 1 is higher than the priority of business flow 3, so business flow 1 will be scheduled to the hotspot network indicated by the second icon, and business flow 3 will be scheduled to the WIFI network indicated by the first icon. In this way, concurrent diversion of business flows corresponding to different business scenarios in the same application is achieved.

[0267] See also Fig.21For example, when the first terminal device is a tablet computer, the user turns on the multi-network collaborative operation function in the manner given in the above embodiment, and sets the network selection mode to the two-choice mode (control 10b-22 is selected and is in the turned-on state, such as the style of control 10b-1) or the automatic mode (control 10b-24 is selected and is in the turned-on state, such as the style of control 10b-1), if there is currently an available hotspot network and no available WIFI network, the tablet computer will connect to the hotspot network, and the second icon will be displayed in the display interface, and the first icon will not be displayed.

[0268] Continue to see Fig.21 For example, when APP1 is running in the foreground of the tablet computer and the user uses it to watch audio and video images, it is necessary to use network resources to process the service flow 1 corresponding to the audio and video images of APP1, such as obtaining the service flow corresponding to the audio and video images from the server corresponding to APP1, and displaying it on the display interface of the tablet computer. If the user also uses APP1 to download files, such as downloading other audio and video content, while watching the audio and video images through APP1, the download icon will be displayed on the display interface of the tablet computer, such as Fig.21 As shown, the download icon indicates that APP1 is downloading a file. At this time, there will be a business flow 3 corresponding to the downloaded file that needs to be processed using network resources. Fig.21 The scenario shown is that different service flows corresponding to the same application need to use network resources for processing. Since only the hotspot network is currently available, service flow 1 and service flow 2 will be scheduled to the hotspot network indicated by the second icon. Therefore, when there is no available WIFI network, by scheduling the service flow to be processed to the hotspot network, the tablet can ensure normal service processing and user experience.

[0269] See also Fig. 22 , exemplarily, when the first terminal device is a tablet computer, the user turns on the multi-network collaborative operation function in the manner given in the above embodiment, and sets the network selection mode to the two-choice mode (control 10b-22 is selected and is in the turned-on state, such as the style of control 10b-1) or the automatic mode (control 10b-24 is selected and is in the turned-on state, such as the style of control 10b-1), if there is currently an available WIFI network and no available hotspot network, or there are available WIFI network and hotspot network, the tablet computer will connect to the WIFI network, and the first icon will be displayed in the display interface, and the second icon will not be displayed.

[0270] Continue to see Fig. 22For example, when APP1 is running in the foreground of the tablet computer and the user uses it to watch audio and video images, it is necessary to use network resources to process the service flow 1 corresponding to the audio and video images of APP1, such as obtaining the service flow corresponding to the audio and video images from the server corresponding to APP1, and displaying it on the display interface of the tablet computer. If the user also uses APP1 to download files, such as downloading other audio and video content, while watching the audio and video images through APP1, the download icon will be displayed on the display interface of the tablet computer, such as Fig. 22 As shown, the download icon indicates that APP1 is downloading a file. At this time, there will be a business flow 3 corresponding to the downloaded file that needs to be processed using network resources. Fig. 22 The scenario shown is that different service flows corresponding to the same application need to use network resources for processing. Since only the WIFI network link currently exists, both service flow 1 and service flow 2 will be scheduled to the WIFI network indicated by the first icon. Therefore, in the two-choose-one network mode, as long as there is an available WIFI network, the service flow that the tablet needs to process will be scheduled to the WIFI network without the help of the hotspot network opened by the second terminal device, thereby reducing the consumption of cellular traffic of the second terminal device.

[0271] Regarding the technical details of the second terminal device turning on the hotspot network, the first terminal device accessing the first hotspot network, and the first terminal device turning on the multi-network collaborative operation function, please refer to the above embodiment and will not be repeated here.

[0272] In addition, it should be noted that the multi-network collaborative operation method provided by the above embodiments implemented by the terminal device in the actual application scenario can also be executed by a chip system included in the terminal device, wherein the chip system may include a processor. The chip system can be coupled to the memory so that the chip system calls the computer program stored in the memory when it is running to implement the steps executed by the above terminal device. The processor in the chip system can be an application processor or a processor other than an application processor.

[0273] In addition, the embodiment of the present application also provides a multi-network collaborative operation system. Exemplarily, the system includes the first terminal device and the second terminal device mentioned above. The second terminal device establishes a mobile connection with the base station through the cellular network and establishes a wireless connection with the first terminal device through the hotspot network.

[0274] Exemplarily, in some implementations, the first terminal device is configured to perform the following operations:

[0275] When there are first-priority and second-priority business flows that need to be processed, the current WIFI network information is obtained; based on the WIFI network information, the first-priority business flows and the second-priority business flows, the user experience QoE quality evaluation result is determined, and the QoE quality evaluation result is used to indicate whether the WIFI network can process the first-priority business flows and the second-priority business flows at the same time, and the first priority is higher than the second priority; when the QoE quality evaluation result indicates that the WIFI network cannot process the first-priority business flows and the second-priority business flows at the same time, the first-priority business flows are scheduled to the hotspot network opened by the second terminal device, and the second-priority business flows are scheduled to the WIFI network.

[0276] Correspondingly, the second terminal device is used to: schedule the first priority service flow transmitted by the first terminal device through the hotspot network to the base station for processing through the cellular network.

[0277] Regarding the technical details of the second terminal device turning on the hotspot network, the first terminal device accessing the first hotspot network, and the first terminal device turning on the multi-network collaborative operation function, please refer to the above embodiment and will not be repeated here.

[0278] In addition, an embodiment of the present application also provides a computer-readable storage medium, which stores computer instructions. When the computer instructions are executed on a terminal device, the terminal device executes the above-mentioned related method steps to implement the multi-network collaborative operation method in the above-mentioned embodiment.

[0279] In addition, an embodiment of the present application further provides a computer program product, which, when executed on a terminal device, enables the terminal device to execute the above-mentioned related steps to implement the multi-network collaborative operation method in the above-mentioned embodiment.

[0280] In addition, an embodiment of the present application also provides a chip (which may also be a component or module), which may include one or more processing circuits and one or more transceiver pins; wherein the transceiver pins and the processing circuit communicate with each other through an internal connection path, and the processing circuit executes the above-mentioned related method steps to implement the multi-network collaborative operation method in the above-mentioned embodiment, so as to control the receiving pin to receive the signal, so as to control the sending pin to send the signal.

[0281] In addition, it can be seen from the above description that the terminal device, computer-readable storage medium, computer program product or chip provided in the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0282] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A multi-network collaborative operation method, characterized in that: Applied to a first terminal device, the method includes: When there are multiple service flows that need to be processed, obtain the current WIFI network information; According to the WIFI network information and the multiple service flows, determining whether the WIFI network can process the multiple service flows simultaneously, the multiple service flows respectively having matching priorities; When the WIFI network cannot process the multiple service flows at the same time, different service flows are scheduled to the WIFI network or the hotspot network opened by the second terminal device according to the matching priorities; When the WIFI network can process the multiple service flows simultaneously, scheduling the multiple service flows to the WIFI network; Wherein, the second terminal device establishes a mobile connection with the base station via a cellular network, and establishes a wireless connection with the first terminal device via the hotspot network; When matching priorities for service flows, if the service scenario to which the service flow belongs is in a preset whitelist, it cannot be matched as a low priority.

2. The method according to claim 1, characterized in that During the process of the first terminal device using the WIFI network, the method further includes: Determine an application currently running on the first terminal device, the application comprising a first application of a first priority and a second application of a second priority; the first priority is higher than the second priority; Using the service flow corresponding to the first application as the service flow of the first priority; The service flow corresponding to the second application is used as the service flow of the second priority.

3. The method according to claim 1, characterized in that During the process of the first terminal device using the WIFI network, the method further includes: Determine an application currently running on the first terminal device, the application comprising a first application of a first priority and a second application of a second priority; Determining a source of a service flow corresponding to the first application; When the business flow corresponding to the first application comes from a business scenario, taking the business flow corresponding to the first application as the business flow of the first priority; When the source of the business flow corresponding to the first application includes at least two business scenarios, determining a priority corresponding to each business scenario; Using the business flow corresponding to the business scenario with a high priority in the first application as the business flow with the first priority, and using the business flow corresponding to the business scenario with a low priority in the first application as the business flow with the second priority; Determining a source of a service flow corresponding to the second application program; When the business flow corresponding to the second application is from a business scenario, taking the business flow corresponding to the second application as the business flow of the second priority; When the source of the business flow corresponding to the second application includes at least two business scenarios, determining a priority corresponding to each business scenario; The business flow corresponding to the high-priority business scenario in the second application is used as the first-priority business flow, and the business flow corresponding to the low-priority business scenario in the second application is used as the second-priority business flow.

4. The method according to claim 3, characterized in that The determining a source of a service flow corresponding to the first application program includes: Determining the number of business scenarios included in the first application according to the attribute information of the first application; When the number of business scenarios included in the first application is one, determining that a business flow corresponding to the first application comes from one business scenario; When the number of business scenarios included in the first application is greater than one, determining an application programming interface called when the first application provides the business flow; wherein different application programming interfaces correspond to different business scenarios; The called application programming interface is deduplicated to obtain the number of business scenarios of the business flow provided by the first application.

5. The method according to claim 3, characterized in that: The determining a source of a service flow corresponding to the second application program includes: Determining the number of business scenarios included in the second application according to the attribute information of the second application; When the number of business scenarios included in the second application is one, determining that the business flow corresponding to the second application comes from one business scenario; When the number of business scenarios included in the second application is greater than one, determining an application programming interface called when the second application provides the business flow; wherein different application programming interfaces correspond to different business scenarios; The called application programming interface is deduplicated to obtain the number of business scenarios of the business flow provided by the second application.

6. The method according to claim 1, characterized in that After scheduling both the first-priority service flow and the second-priority service flow to the hotspot network opened by the second terminal device, the method further includes: When the QoE quality evaluation result indicates that the WIFI network can simultaneously process the first priority service flow and the second priority service flow, or when other accessible WIFI networks are searched, stop scheduling the first priority service flow and the second priority service flow to the hotspot network, and schedule the first priority service flow and the second priority service flow to the WIFI network or search for other accessible WIFI networks.

7. The method according to any one of claims 1 to 6, characterized in that: The method further comprises: Determining whether the multi-network collaborative operation function is enabled on the first terminal device; When the first terminal device turns on the multi-network collaborative operation function, executing the step of scheduling the first priority service flow to the hotspot network turned on by the second terminal device; When the multi-network collaborative operation function is not enabled on the first terminal device, displaying a first entrance; In response to the operation on the first entrance, the multi-network collaborative operation function is turned on, and the step of scheduling the first priority service flow to the hotspot network turned on by the second terminal device is executed.

8. The method according to claim 7, characterized in that Before scheduling the service flow of the first priority to the hotspot network opened by the second terminal device, the method further includes: Determine whether to access the hotspot network opened by the second terminal device; When accessing the hotspot network opened by the second terminal device, executing the step of scheduling the service flow of the first priority to the hotspot network opened by the second terminal device; When the hotspot network opened by the second terminal device is not accessed, obtaining hotspot network information within the connection range, the hotspot network information including hotspot networks opened by all third terminal devices with cellular communication capabilities within the connection range; Using a third terminal device with the best network quality in the hotspot network information as the second terminal device; Access the hotspot network opened by the second terminal device, and execute the step of scheduling the first priority service flow to the hotspot network opened by the second terminal device.

9. The method according to claim 8, characterized in that After obtaining the hotspot network information within the connection range, the method further includes: Displaying the hotspot network information in the interface of the first terminal device; In response to the user's selection operation of any hotspot network in the hotspot network information, the third terminal device providing the hotspot network will be used as the second terminal device, accessing the hotspot network turned on by the second terminal device, and executing the step of scheduling the first priority service flow to the hotspot network turned on by the second terminal device.

10. The method according to claim 8, characterized in that Before obtaining the hotspot network information within the connection range, the method further includes: Determining whether a multi-screen collaborative connection is established between the first terminal device and the second terminal device; When the multi-screen collaborative connection is established between the first terminal device and the second terminal device, controlling the second terminal device to turn on the hotspot network, accessing the hotspot network turned on by the second terminal device, and executing the step of scheduling the first priority service flow to the hotspot network turned on by the second terminal device; When the multi-screen collaborative connection is not established between the first terminal device and the second terminal device, the step of acquiring hotspot network information within the connection range is performed.

11. The method according to any one of claims 1 to 6, characterized in that: The priority of the same application in different first terminal devices is the same, and the priority of the same business scenario is the same.

12. The method according to any one of claims 1 to 6, characterized in that: The priorities of the same application in different first terminal devices are different, and the priorities of the same business scenarios are different.

13. A multi-network collaborative operation method, characterized in that: Applied to a first terminal device, the method includes: In the process of displaying the first icon and the second icon in the display interface of the first terminal device, when there is a service flow that needs to be processed, if the WiFi network indicated by the first icon cannot process the service flow of the first priority and the service flow of the second priority at the same time, the service flow of the first priority is scheduled to the hotspot network indicated by the second icon, and the service flow of the second priority is scheduled to the WiFi network indicated by the first icon; If the WiFi network indicated by the first icon cannot process the service flow of the first priority, nor can it process the service flow of the second priority, both the service flow of the first priority and the service flow of the second priority are scheduled to the hotspot network indicated by the second icon; If the WiFi network indicated by the first icon can process the service flow of the first priority and the service flow of the second priority at the same time, schedule both the service flow of the first priority and the service flow of the second priority to the WiFi network indicated by the first icon; Wherein, the first priority is higher than the second priority, and the hotspot network is provided by a second terminal device that establishes a mobile connection with the base station; When matching priorities for service flows, if the service scenario to which the service flow belongs is in a preset whitelist, it cannot be matched as a low priority.

14. The method according to claim 13, characterized in that The method further comprises: When the first icon displayed in the display interface disappears and the second icon is displayed, when there is a service flow that needs to be processed, the service flow is scheduled to the hotspot network indicated by the second icon.

15. The method according to claim 14, characterized in that The method further comprises: After the first icon is redisplayed in the display interface, the service flow is stopped from being dispatched to the hotspot network, and the service flow is dispatched to the WIFI network indicated by the first icon; or, Stop scheduling the second priority service flow to the hotspot network, schedule the first priority service flow to the hotspot network indicated by the second icon, and schedule the second priority service flow to the WIFI network indicated by the first icon.

16. The method according to claim 13, characterized in that The method further comprises: The second icon displayed in the display interface disappears. During the display of the first icon, when there is a service flow that needs to be processed, the service flow is scheduled to the WIFI network indicated by the first icon.

17. The method according to any one of claims 13 to 16, characterized in that The first-priority business flow is the business flow generated by an audio or video call / conference type application or business scenario running in the foreground, and the second-priority business flow is the business flow generated by an application or business scenario running in the background.

18. The method according to any one of claims 13 to 16, characterized in that The first-priority business flow is a business flow generated in a game-type application or business scenario running in the foreground, and the second-priority business flow is a business flow generated in an application or business scenario running in the background.

19. A multi-network collaborative operation system, characterized in that: The system comprises: a first terminal device and a second terminal device, wherein the second terminal device establishes a mobile connection with a base station via a cellular network and establishes a wireless connection with the first terminal device via the hotspot network; The first terminal device is used for: When there is a first-priority service flow and a second-priority service flow that need to be processed, obtain current WIFI network information; Determine, according to the WIFI network information, the service flow of the first priority and the service flow of the second priority, a user-experienced QoE quality evaluation result, wherein the QoE quality evaluation result is used to indicate whether the WIFI network can process the service flow of the first priority and the service flow of the second priority at the same time, and the first priority is higher than the second priority; When the QoE quality evaluation result indicates that the WIFI network cannot process the service flow of the first priority and the service flow of the second priority at the same time, the service flow of the first priority is scheduled to the hotspot network opened by the second terminal device, and the service flow of the second priority is scheduled to the WIFI network; When the QoE quality evaluation result indicates that the WIFI network cannot process the service flow of the first priority and cannot process the service flow of the second priority, scheduling both the service flow of the first priority and the service flow of the second priority to the hotspot network opened by the second terminal device; When the QoE quality evaluation result indicates that the WIFI network can process the service flow of the first priority and the service flow of the second priority at the same time, scheduling both the service flow of the first priority and the service flow of the second priority to the WIFI network; The second terminal device is used for: Through the cellular network, the service flow of the first priority and / or the second priority transmitted by the first terminal device through the hotspot network is scheduled to the base station for processing.

20. A terminal device, characterized in that: The terminal device includes: a memory and a processor, the memory and the processor are coupled; the memory stores program instructions, and when the program instructions are executed by the processor, the terminal device executes the multi-network collaborative operation method as described in any one of claims 1 to 12, or executes the multi-network collaborative operation method as described in any one of claims 13 to 18.

21. A computer-readable storage medium, characterized in that: It includes a computer program, which, when executed on a terminal device, enables the terminal device to execute the multi-network collaborative operation method as described in any one of claims 1 to 12, or to execute the multi-network collaborative operation method as described in any one of claims 13 to 18.

Images