Multi-network collaborative operation method and device, and storage medium

Abstract

The invention provides a multi-network collaborative operation method and device and a storage medium. According to the method, when a WIFI network currently accessed by a first terminal device is not enough to meet the service requirements of multiple service flows needing to be processed in the first terminal device, the WIFI network and a hotspot network opened by a second terminal device are used at the same time, the service flows with high priorities are transmitted and received by the hotspot network, and other service flows are reserved in the WIFI network to be transmitted and received, so that the service requirements of the multiple service flows needing to be processed in the first terminal device are met. Therefore, the normal processing of the service flow can be ensured, and the consumption of the cellular flow can be reduced.

Description

Multi-network collaborative operation method, device and storage medium

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on November 23, 2022, with application number 202211470740.2 and invention name “Multi-network collaborative operation method, device and storage medium”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of communication technology, and in particular to a multi-network collaborative operation method, device, and storage medium. Background Art

[0003] The development and popularization of Internet technology has brought convenience to people's daily lives, work, and entertainment. For example, users can use terminal devices connected to wireless local area networks (WLANs), such as Wi-Fi networks, or cellular networks (mobile networks) to conduct audio and video conferencing, live broadcasts, and games.

[0004] However, for some terminal devices that only have Wi-Fi communication capabilities but no cellular communication capabilities, when there is no available Wi-Fi network or the Wi-Fi network is poor, services that rely on the network, such as audio and video conferencing, live broadcasts, online games, etc., will not be able to be carried out.

[0005] Summary of the Invention

[0006] In order to solve the above technical problems, the present application provides a multi-network collaborative operation method, device and storage medium, which aims to enable terminal devices without cellular communication capabilities to perform business processing with the help of terminal devices with cellular communication capabilities, realize multi-network collaborative operation, and thus ensure that the business can proceed normally.

[0007] In the first aspect, the present application provides a multi-network collaborative operation method, which is applied to a first terminal device. The method includes: when there is a first-priority business flow and a second-priority business flow that need to be processed, obtaining the current WIFI network information; determining the user experience QoE quality evaluation result based on the WIFI network information, the first-priority business flow and the second-priority business flow, the QoE quality evaluation result is used to indicate whether the WIFI network can process the first-priority business flow and the second-priority business flow at the same time, and the first priority is higher than the second priority; when the QoE quality evaluation result indicates that the WIFI network cannot process the first-priority business flow and the second-priority business flow at the same time, scheduling the first-priority business flow to the hotspot network opened by the second terminal device, and scheduling the second-priority business flow to the WIFI network; wherein the second terminal device establishes a mobile connection with the base station through the cellular network, and establishes a wireless connection with the first terminal device through the hotspot network.

[0008] Therefore, when the WIFI network currently connected to the first terminal device is insufficient to meet the business needs of multiple business flows that need to be processed in the first terminal device, the WIFI network and the hotspot network opened by the second terminal device are used at the same time, and the high-priority business flows are sent and received by the hotspot network, and other business flows are retained in the WIFI network for sending and receiving, thereby ensuring that the business flows are processed normally and reducing the consumption of cellular traffic.

[0009] According to the first aspect, during the process of the first terminal device using the WIFI network, the method also includes: determining the application currently running on the first terminal device, the application including a first application of a first priority and a second application of a second priority; using the service flow corresponding to the first application as the service flow of the first priority; and using the service flow corresponding to the second application as the service flow of the second priority.

[0010] This enables concurrent processing of business flows between different applications. For details, please refer to the description of the application-level non-diversion mode below, which will not be repeated here.

[0011] According to the first aspect, or any implementation of the first aspect above, during the process of the first terminal device using the WIFI network, the method also includes: determining the application currently running on the first terminal device, the application including a first application of a first priority and a second application of a second priority; determining the source of the business flow corresponding to the first application; when the business flow corresponding to the first application comes from a business scenario, the business flow corresponding to the first application is used as a business flow of a first priority; when the source of the business flow corresponding to the first application includes at least two business scenarios, determining the priority corresponding to each business scenario; using the business flow corresponding to the business scenario with a high priority in the first application as a business flow of a first priority, and using the business flow corresponding to the business scenario with a low priority in the first application as a business flow of a second priority; determining the source of the business flow corresponding to the second application; when the business flow corresponding to the second application comes from a business scenario, using the business flow corresponding to the second application as a business flow of a second priority; when the source of the business flow corresponding to the second application includes at least two business scenarios, determining the priority corresponding to each business scenario; using the business flow corresponding to the business scenario with a high priority in the second application as a business flow of a first priority, and using the business flow corresponding to the business scenario with a low priority in the second application as a business flow of a second priority.

[0012] As a result, concurrent processing of business flows corresponding to different business scenarios in the same application is achieved. For details, please refer to the description of the concurrent diversion mode of different business flows in the same application below, which will not be repeated here.

[0013] According to the first aspect, or any implementation method of the first aspect above, determining the source of the business flow corresponding to the first application includes: determining the number of business scenarios included in the first application based on the attribute information of the first application; when the number of business scenarios included in the first application is 1, determining that the business flow corresponding to the first application comes from a business scenario; when the number of business scenarios included in the first application is greater than 1, determining the application programming interface called when the first application provides the business flow; wherein different application programming interfaces correspond to different business scenarios; deduplicating the called application programming interfaces to obtain the number of business scenarios of the business flow provided by the first application.

[0014] Therefore, by determining the number of business scenarios included in the first application, the source of the current business flow is determined, so that the subsequent business flow priority is determined based on the source of the business flow and then concurrent diversion is performed, and scheduling to the WIFI network or hotspot network is more reasonable.

[0015] According to the first aspect, or any implementation method of the first aspect above, determining the source of the business flow corresponding to the second application includes: determining the number of business scenarios included in the second application based on the attribute information of the second application; when the number of business scenarios included in the second application is 1, determining that the business flow corresponding to the second application comes from a business scenario; when the number of business scenarios included in the second application is greater than 1, determining the application programming interface called when the second application provides the business flow; wherein different application programming interfaces correspond to different business scenarios; deduplicating the called application programming interfaces to obtain the number of business scenarios for the business flow provided by the second application.

[0016] Therefore, by determining the number of business scenarios included in the second application, the source of the current business flow is determined, so that the subsequent business flow priority is determined based on the source of the business flow and concurrent diversion is performed, and scheduling to the WIFI network or hotspot network is more reasonable.

[0017] According to the first aspect, or any implementation of the first aspect above, the method also includes: when the QoE quality evaluation result indicates that the WIFI network cannot process the first priority business flow or the second priority business flow, scheduling both the first priority business flow and the second priority business flow to the hotspot network turned on by the second terminal device.

[0018] Therefore, when no Wi-Fi network is available, the service flow that needs to be processed is dispatched to the hotspot network, thereby ensuring that the first terminal device can process the service normally and protect the user experience. The specific implementation details can be seen in the description of the hotspot network link only in the two-choose-one network mode below, and will not be repeated here.

[0019] According to the first aspect, or any implementation of the first aspect above, after scheduling the first-priority business flow and the second-priority business flow to the hotspot network turned on by the second terminal device, the method also includes: when the QoE quality evaluation result indicates that the WIFI network can process the first-priority business flow and the second-priority business flow at the same time, or searches for other accessible WIFI networks, stop scheduling the first-priority business flow and the second-priority business flow to the hotspot network, and schedule the first-priority business flow and the second-priority business flow to the WIFI network or search for other accessible WIFI networks.

[0020] Therefore, when there is an available WIFI network, all or part of the service flows are stopped from being dispatched to the hotspot network, and these service flows are dispatched to the WIFI network for processing, thereby reducing the consumption of cellular traffic of the second terminal device.

[0021] According to the first aspect, or any implementation of the first aspect above, the method further includes: when the QoE quality evaluation result indicates that the WIFI network can simultaneously process the first priority business flow and the second priority business flow, scheduling both the first priority business flow and the second priority business flow to the WIFI network.

[0022] Therefore, in the "Choose One" mode, as long as there is an available Wi-Fi network, the service flow required by the first terminal device is dispatched to the Wi-Fi network instead of the hotspot network enabled by the second terminal device, thereby reducing the consumption of cellular data on the second terminal device. For specific implementation details, please refer to the description of the "Choose One" mode below, where only the Wi-Fi network link exists, and will not be repeated here.

[0023] According to the first aspect, or any implementation of the first aspect above, the method also includes: determining whether the first terminal device has enabled the multi-network collaborative operation function; when the first terminal device has enabled the multi-network collaborative operation function, executing the step of scheduling the first priority business flow to the hotspot network enabled by the second terminal device; when the first terminal device does not have the multi-network collaborative operation function enabled, displaying the first entrance; in response to the operation behavior on the first entrance, enabling the multi-network collaborative operation function, and executing the step of scheduling the first priority business flow to the hotspot network enabled by the second terminal device.

[0024] Thus, by providing the first entrance, it is convenient for users to enable the multi-network collaborative operation function. The first entrance can be integrated into the setting interface corresponding to the setting application, such as the space 10b-1 shown in FIG12.

[0025] According to the first aspect, or any implementation of the first aspect above, before scheduling the first-priority service flow to the hotspot network opened by the second terminal device, the method also includes: determining whether to access the hotspot network opened by the second terminal device; when accessing the hotspot network opened by the second terminal device, executing the step of scheduling the first-priority service flow to the hotspot network opened by the second terminal device; when not accessing the hotspot network opened by the second terminal device, obtaining the hotspot network information within the connection range, the hotspot network information includes the hotspot networks opened by all third terminal devices with cellular communication capabilities within the connection range; using the third terminal device with the best network quality of the hotspot network in the hotspot network information as the second terminal device; accessing the hotspot network opened by the second terminal device, and executing the step of scheduling the first-priority service flow to the hotspot network opened by the second terminal device.

[0026] For example, the method of searching for hotspot networks is similar to the existing method of searching for WIFI networks in the wireless LAN interface, and will not be described in detail here.

[0027] According to the first aspect, or any implementation of the first aspect above, after obtaining the hotspot network information within the connection range, the method also includes: displaying the hotspot network information in the interface of the first terminal device; in response to the user's selection operation of any hotspot network in the hotspot network information, using the third terminal device providing the hotspot network as the second terminal device, accessing the hotspot network turned on by the second terminal device, and executing the step of scheduling the first priority service flow to the hotspot network turned on by the second terminal device.

[0028] According to the first aspect, or any implementation method of the first aspect above, before obtaining the hotspot network information within the connection range, the method also includes: determining whether a multi-screen collaborative connection is established between the first terminal device and the second terminal device; when a multi-screen collaborative connection is established between the first terminal device and the second terminal device, controlling the second terminal device to turn on the hotspot network, accessing the hotspot network turned on by the second terminal device, and executing the step of scheduling the first priority business flow to the hotspot network turned on by the second terminal device; when a multi-screen collaborative connection is not established between the first terminal device and the second terminal device, executing the step of obtaining the hotspot network information within the connection range.

[0029] According to the first aspect, or any implementation of the first aspect above, the priorities of the same application programs in different first terminal devices are the same, and the priorities of the same business scenarios are the same.

[0030] According to the first aspect, or any implementation of the first aspect above, the priorities of the same application in different first terminal devices are different, and the priorities of the same business scenarios are different.

[0031] In a second aspect, the present application provides a multi-network collaborative operation method, which is applied to a first terminal device. The method includes: in the process of displaying a first icon and a second icon on the display interface of the first terminal device, when there is a business flow that needs to be processed, scheduling the business flow of the first priority to the hotspot network indicated by the second icon, and scheduling the business flow of the second priority to the Wi-Fi network indicated by the first icon; wherein the first priority is higher than the second priority, and the hotspot network is provided by the second terminal device that establishes a mobile connection with the base station.

[0032] Exemplarily, the style of the first icon is as shown in (a1) or (a2) in FIG. 18 ; the style of the second icon is as shown in (b1) or (b2) or (b3) in FIG. 18 .

[0033] According to the second aspect, the method further includes: when the first icon displayed in the display interface disappears and the second icon is displayed, when there is a business flow that needs to be processed, scheduling the business flow to the hotspot network indicated by the second icon.

[0034] According to the second aspect, or any implementation of the second aspect above, the method also includes: after redisplaying the first icon in the display interface, stopping scheduling the business flow to the hotspot network, and scheduling the business flow to the WIFI network indicated by the first icon; or, stopping scheduling the second-priority business flow to the hotspot network, scheduling the first-priority business flow to the hotspot network indicated by the second icon, and scheduling the second-priority business flow to the WIFI network indicated by the first icon.

[0035] According to the second aspect, or any implementation of the above second aspect, the method also includes: when the second icon displayed in the display interface disappears and the first icon is displayed, when there is a business flow that needs to be processed, the business flow is scheduled to the WIFI network indicated by the first icon.

[0036] According to the second aspect, or any implementation method of the above second aspect, the first-priority business flow is the business flow generated by an audio and video call / conference type application or business scenario running in the foreground, and the second-priority business flow is the business flow generated by an application or business scenario running in the background.

[0037] For example, the priority relationship of different service flows can be found in Table 1 below, which will not be described in detail here.

[0038] According to the second aspect, or any implementation of the above second aspect, the first-priority business flow is the business flow generated in a game-type application or business scenario running in the foreground, and the second-priority business flow is the business flow generated in an application or business scenario running in the background.

[0039] For example, the priority relationship of different service flows can be found in Table 1 below, which will not be described in detail here.

[0040] The second aspect and any implementation of the second aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the second aspect and any implementation of the second aspect can be referred to the technical effects corresponding to the first aspect and any implementation of the first aspect, and will not be repeated here.

[0041] In a third aspect, the present application provides a multi-network collaborative operation system. The system includes: a first terminal device and a second terminal device, the second terminal device establishing a mobile connection with a base station through a cellular network, and establishing a wireless connection with the first terminal device through a hotspot network; the first terminal device is used to: when there is a first-priority business flow and a second-priority business flow that need to be processed, obtain the current WIFI network information; determine the user experience QoE quality evaluation result based on the WIFI network information, the first-priority business flow and the second-priority business flow, the QoE quality evaluation result is used to indicate whether the WIFI network can process the first-priority business flow and the second-priority business flow at the same time, the first priority being higher than the second priority; when the QoE quality evaluation result indicates that the WIFI network cannot process the first-priority business flow and the second-priority business flow at the same time, the first-priority business flow is scheduled to the hotspot network opened by the second terminal device, and the second-priority business flow is scheduled to the WIFI network; the second terminal device is used to: schedule the first-priority business flow transmitted by the first terminal device through the hotspot network to the base station for processing through the cellular network.

[0042] The third aspect and any implementation of the third aspect correspond to the first aspect and any implementation of the first aspect, or the second aspect and any implementation of the second aspect, respectively. The technical effects corresponding to the third aspect and any implementation of the third aspect can refer to the technical effects corresponding to the first aspect and any implementation of the first aspect, or the technical effects corresponding to the second aspect and any implementation of the second aspect, and will not be repeated here.

[0043] In a fourth aspect, the present application provides a terminal device. The terminal device includes: a memory and a processor, the memory and the processor being coupled; the memory storing program instructions, which, when executed by the processor, cause the terminal device to execute the instructions of the method in the first aspect or any possible implementation of the first aspect, or the instructions of the method in the second aspect and any possible implementation of the second aspect.

[0044] The fourth aspect and any implementation of the fourth aspect correspond to the first aspect and any implementation of the first aspect, or the second aspect and any implementation of the second aspect, respectively. The technical effects corresponding to the fourth aspect and any implementation of the fourth aspect can refer to the technical effects corresponding to the first aspect and any implementation of the first aspect, or the technical effects corresponding to the second aspect and any implementation of the second aspect, and are not further described here.

[0045] In a fifth aspect, the present application provides a computer-readable medium for storing a computer program, which includes instructions for executing the method in the first aspect or any possible implementation of the first aspect, or instructions for the method in the second aspect and any possible implementation of the second aspect.

[0046] The fifth aspect and any implementation of the fifth aspect correspond to the first aspect and any implementation of the first aspect, or the second aspect and any implementation of the second aspect, respectively. The technical effects corresponding to the fifth aspect and any implementation of the fifth aspect can refer to the technical effects corresponding to the first aspect and any implementation of the first aspect, or the technical effects corresponding to the second aspect and any implementation of the second aspect, and are not further described here.

[0047] In a sixth aspect, the present application provides a computer program comprising instructions for executing the method of the first aspect or any possible implementation of the first aspect, or instructions for the method of the second aspect and any possible implementation of the second aspect.

[0048] The sixth aspect and any implementation of the sixth aspect correspond to the first aspect and any implementation of the first aspect, or the second aspect and any implementation of the second aspect, respectively. The technical effects corresponding to the sixth aspect and any implementation of the sixth aspect can refer to the technical effects corresponding to the first aspect and any implementation of the first aspect, or the technical effects corresponding to the second aspect and any implementation of the second aspect, and are not further described here.

[0049] In a seventh aspect, the present application provides a chip comprising a processing circuit and a transceiver pin. The transceiver pin and the processing circuit communicate with each other via an internal connection path, and the processing circuit executes the method of the first aspect or any possible implementation of the first aspect, or the method of the second aspect and any possible implementation of the second aspect, to control the receive pin to receive a signal and to control the transmit pin to send a signal.

[0050] The seventh aspect and any implementation of the seventh aspect correspond to the first aspect and any implementation of the first aspect, or the second aspect and any implementation of the second aspect, respectively. The technical effects corresponding to the seventh aspect and any implementation of the seventh aspect can refer to the technical effects corresponding to the first aspect and any implementation of the first aspect, or the technical effects corresponding to the second aspect and any implementation of the second aspect, and are not further described here. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] FIG1 is a schematic diagram showing an exemplary embodiment of a terminal device without cellular communication capability accessing a WIFI network through a router;

[0052] FIG2 is a schematic diagram of an interface for exemplarily performing business processing based on a WIFI network;

[0053] FIG3 is a schematic diagram exemplarily showing a terminal device without cellular communication capability disconnecting from a router;

[0054] FIG4 is a schematic diagram illustrating an interface for performing service processing after a terminal device without cellular communication capability is disconnected from a WIFI network;

[0055] FIG5 is another schematic diagram illustrating an exemplary interface for a terminal device without cellular communication capability to process services after disconnecting from a WIFI network;

[0056] FIG6 is a schematic diagram showing an exemplary hardware structure of a terminal device;

[0057] FIG7 is a schematic diagram showing a software structure of a terminal device of an exemplary operating system;

[0058] FIG8 is a schematic diagram showing a software structure of a terminal device of another operating system;

[0059] FIG9 is an illustrative diagram of a network selection mode in a multi-network collaborative operation method provided in an embodiment of the present application;

[0060] FIG10 is a flow chart of a multi-network collaborative operation method for the network selection mode shown in FIG9 ;

[0061] FIG11 is a schematic diagram illustrating one of the interfaces for providing a user with an entry for selecting a network selection mode;

[0062] FIG12 is a second schematic diagram of an interface for providing a user with an entry to select a network selection mode;

[0063] FIG13 is a third exemplary diagram of an interface for providing a user with an entry for selecting a network selection mode;

[0064] FIG14 is an exemplary diagram illustrating another network selection mode in the multi-network collaborative operation method provided in an embodiment of the present application;

[0065] FIG15 is a flow chart of a multi-network collaborative operation method for the network selection mode shown in FIG14 ;

[0066] FIG16 is an illustrative diagram of another network selection mode in the multi-network collaborative operation method provided in an embodiment of the present application;

[0067] FIG17 is a flow chart of a multi-network collaborative operation method for the network selection mode shown in FIG16 ;

[0068] FIG18 is a schematic diagram showing an exemplary first icon and a second icon;

[0069] FIG19 is a schematic diagram illustrating one of the interfaces in a disconnected network environment after the multi-network collaborative operation function is enabled;

[0070] FIG20 is a second schematic diagram illustrating an exemplary interface in a disconnected network environment after the multi-network collaborative operation function is enabled;

[0071] FIG21 is a third exemplary diagram of an interface in a disconnected network environment after the multi-network collaborative operation function is enabled;

[0072] FIG22 is a fourth diagram showing an exemplary interface in a disconnected network environment after the multi-network collaborative operation function is enabled. DETAILED DESCRIPTION

[0073] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0074] The term "and / or" in this article is merely a description of the association relationship between associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0075] In the description and claims of the embodiments of this application, the terms "first" and "second" are used to distinguish different objects, rather than to describe a specific order of objects. For example, the terms "first target object" and "second target object" are used to distinguish different objects, rather than to describe a specific order of objects.

[0076] In the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be interpreted as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0077] In the description of the embodiments of this application, unless otherwise specified, "multiple" means two or more. For example, "multiple processing units" means two or more processing units; "multiple systems" means two or more systems.

[0078] In order to better understand the technical solutions provided by the embodiments of the present application, before describing the technical solutions of the embodiments of the present application, the applicable scenarios of the embodiments of the present application are first described with reference to the accompanying drawings.

[0079] For example, for some terminal devices that only have WiFi communication capabilities but no cellular communication capabilities, such as those that only have a wireless / wired network interface but no mobile network interface, or have a mobile network interface but no Subscriber Identity Module (SIM) that can provide a cellular network, when they want to process network-dependent services such as audio and video conferencing, live broadcasts, and online games, in some possible implementations, they need to first use a wireless / wired router to access the WiFi network before they can use the WiFi network to process services. As shown in Figure 1, when a user uses a tablet computer without cellular communication capabilities to process services, they can access the WiFi network through a wireless router.

[0080] For example, after a tablet computer is connected to a WIFI network via a wireless router, the tablet computer can be used to watch online videos. As shown in FIG2 , when watching online videos using a WIFI network, if the user touches the current interface, in a feasible implementation, a progress bar for the online video will be displayed, a control for pausing the current online video will be displayed, and the current network connection status of the tablet computer and the connected network will be displayed in area 10a.

[0081] Continuing to refer to FIG. 2 , illustratively, when the tablet computer is currently connected to a network, and the connected network is a WIFI network, the word “WIFI” will be displayed in area 10 a to indicate that the network currently connected to the tablet computer is a WIFI network.

[0082] For example, if the user takes the tablet computer out of the coverage area of ​​the wireless router, that is, out of the location with the WIFI network, or the wireless router fails, or the WIFI network fails, the tablet computer will be unable to access the available WIFI network, as shown in Figure 3. In this case, the word "WIFI" in area 10a on the interface of the tablet computer playing online videos in Figure 2 will change to the word "No Network" in area 10a in Figure 4.

[0083] 4 , illustratively, in one implementation, when the tablet computer is in a no-network state, the interface currently playing the online video may display the content shown in area 10b , and when the tablet computer reconnects to the WIFI network, it may automatically restore to the interface shown in FIG. 2 .

[0084] 5 , illustratively, in another implementation, when the tablet computer is in an offline state, the interface for currently playing online videos may directly turn into a black screen due to the failure to obtain a new data stream, and display a prompt message “Video loading failed, please try again later” on the interface, as well as a control 10c for the user to retry.

[0085] For example, if the tablet computer is reconnected to the WIFI network, when the user clicks control 10c, the tablet computer will re-acquire the data stream from the time when the video was interrupted for display, that is, restore to the interface shown in Figure 2. If the tablet computer has not been connected to the WIFI network, the user clicks control 10c, and the interface may not change.

[0086] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0087] In view of this, the present application provides a multi-network collaborative operation method, which is applied to the above-mentioned terminal device (for the convenience of distinction, this embodiment is referred to as the first terminal device, and the terminal device providing the hotspot network is referred to as the second terminal device). Specifically, based on the multi-network collaborative operation method provided by the present application, for the first terminal device, when there is a first-priority business flow and a second-priority business flow that need to be processed, the current WIFI network information is obtained; based on the WIFI network information, the first-priority business flow and the second-priority business flow, the user experience QoE quality evaluation result is determined, and the QoE quality evaluation result is used to indicate whether the WIFI network can process the first-priority business flow and the second-priority business flow at the same time, and the first priority is higher than the second priority; when the QoE quality evaluation result indicates that the WIFI network cannot process the first-priority business flow and the second-priority business flow at the same time, the first-priority business flow is scheduled to the hotspot network opened by the second terminal device, and the second-priority business flow is scheduled to the WIFI network.

[0088] As a result, the first terminal device without cellular communication capability can perform service processing with the help of the second terminal device with cellular communication capability, thereby achieving multi-network collaborative operation and ensuring that the service can proceed normally.

[0089] In order to better understand the technical solution provided by the present application, before describing the technical solution of the present application, the hardware structure of the terminal device to which the technical solution of the present application is applicable is first described in conjunction with the accompanying drawings.

[0090] It can be seen from the above scenario description that in one possible implementation method, the technical solution of the present application is applicable to terminal devices that only have wireless / wired network interfaces but no mobile network interfaces, such as tablet computers, personal computers (PCs), laptops, large-screen devices (such as TVs), etc., which are not listed one by one here and this application does not impose any restrictions on this.

[0091] For example, in another possible implementation, the technical solution of the present application is applicable to terminal devices that have a wireless / wired network interface and a mobile network interface, but do not have a SIM card that can provide a cellular network, such as smart phones, wearable devices (smart watches), etc., which are not listed one by one here and are not limited by the present application.

[0092] Illustratively, in another implementation, the technical solution of the present application is applicable to a terminal device that has a wireless / wired network interface and a mobile network interface, and is inserted with a SIM card that can provide a cellular network.

[0093] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0094] In addition, from the above description, it can be seen that in actual applications, as long as there is a wireless / wired network interface and a terminal device with WIFI communication capabilities, regardless of whether it has a mobile network interface or whether it can currently use the cellular network provided by its own SIM card, when the WIFI network cannot support the current business, it can use the hotspot network opened by other terminal devices with cellular communication capabilities to process the business.

[0095] Referring to FIG6 , a schematic diagram of the hardware structure of a terminal device is shown. It should be understood that the terminal device 100 shown in FIG6 is merely an example of a terminal device that can be applied to the above-described scenario, and the terminal device 100 may have more or fewer components than shown in the figure, may combine two or more components, or may have a different component configuration. The various components shown in FIG6 may be implemented in hardware, including one or more signal processing and / or application-specific integrated circuits, software, or a combination of hardware and software.

[0096] As shown in FIG6 , the terminal device 100 may include a central processing unit (CPU) 101 , a memory 102 and a wired / wireless network interface 103 . The memory 102 may store one or more application programs or data.

[0097] The central processing unit 101 can serve as the nerve center and command center of the terminal device 100. Based on instruction opcodes and timing signals, the central processing unit 101 can generate operation control signals to control instruction fetching and execution. The central processing unit 101 can also include a memory for storing instructions and data. In some implementations, the memory in the central processing unit 101 is a cache memory.

[0098] Memory 102 can be used to store computer-executable program code, which includes instructions. Memory 102 can be volatile memory or persistent memory. The computer-executable program code stored in memory 102 can include one or more modules, each of which can include a series of instruction operations on the terminal device. Memory 102 can include a program storage area and a data storage area.

[0099] Furthermore, the central processing unit 101 can be configured to communicate with the memory 102 and execute a series of instruction operations in the memory 102 on the terminal device 100. The central processing unit 101 executes various functions and data processing of the terminal device 100 by running the computer program instructions stored in the memory 102, for example, enabling the terminal device 100 to implement the multi-network collaborative operation method provided in the embodiment of the present application.

[0100] In addition, it should be noted that in some implementations, the terminal device 100 may include one or more central processors 101, one or more memories 102, and one or more wired / wireless network interfaces, which are determined by the product type of the terminal device, customer needs, etc., and this application does not impose any restrictions on this.

[0101] In addition, the terminal device 100 may also include one or more power supplies, sensors, display screens, etc., which are not listed here one by one and are not limited in this application.

[0102] The terminal device 100 can execute the operations executed by the first terminal device (a terminal device without cellular communication capabilities) in the following embodiments, and the details are not repeated here.

[0103] The software system of the terminal device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes a layered architecture system as an example to exemplify the software structure of the terminal device 100.

[0104] Regarding systems with architectures, such as Android, Windows Server™ (abbreviated as: Windows), Mac OS X™, Unix™, Linux™, FreeBSD™, etc., they are not listed here one by one, and this application does not limit them. For the sake of convenience, this embodiment takes the Windows system and the Android system as examples, and describes the architectures of these two operating systems with reference to the accompanying drawings.

[0105] FIG. 7 is a block diagram of a software structure when the terminal device 100 is a Windows system.

[0106] As shown in FIG7 , for a terminal device 100 of a Windows system, its software structure can be divided into user state (Windows User), kernel state (Windows Kernel) and hardware.

[0107] Among them, the user state may include the application layer (application layer), framework layer / interface layer, modem (Modern), universal platform interface (UWP API), etc.

[0108] For example, the application layer may include settings, videos, games, downloads and other applications, which are not listed here one by one and are not limited in this application.

[0109] Exemplary framework / interface layers include, for example, the Win32 API (Microsoft 32-bit Application Programming Interface). These layers may include various interfaces for application programs in the application layer to call. Specifically, the technical solutions provided in the embodiments of this application primarily involve a perception module for sensing the access environment and current service flows.

[0110] It is understood that in some implementations, the above two functions can be integrated into a single function or into different functions. As shown in Figure 7, the access environment perception submodule can be separately encapsulated to perceive the access environment, and the service flow perception submodule can be encapsulated to perceive the current service flow. Thus, by perceiving the above information, the specific concurrent scenarios during multi-network collaborative operations can be determined.

[0111] Exemplarily, the access environment perception submodule is specifically configured to perceive a wireless network (WiFi network) environment. In some implementations, the access environment perception submodule can perceive whether a WiFi network is available at the current location, as well as the WiFi network quality, based on multiple parameters such as the WiFi network's current signal strength, signal-to-noise ratio, noise, load, transmit queue duration, transmit rate, receive rate, number of bytes sent, number of bytes received, number of packets sent, and number of packets received.

[0112] Exemplarily, the business flow perception submodule is specifically used to perceive the following information of the current business flow being sent and received, such as the number of data packets sent based on the Transmission Control Protocol (TCP) (TCP sent packets), the number of data packets received (TCP received packets), the number of bytes sent (TCP sent bytes), and the number of bytes received (TCP received bytes), as well as the number of data packets sent based on the User Datagram Protocol (UDP) (UDP sent packets), the number of data packets received (UDP received packets), the number of bytes sent (UDP sent bytes), and the number of bytes received (UDP received bytes), as well as round-trip delay, packet loss rate, retransmission rate, etc.

[0113] Therefore, after the above two sub-modules in the perception module perceive the WIFI network environment status and the relevant information of the currently received and sent business flows, they can hand over this information to the user interface framework (Windows Presentation Foundation, WPF) of the network driver layer in the kernel state, and then WPF determines whether it is necessary to use the hotspot network opened by the terminal device with cellular communication capabilities, and automatically selects the appropriate network selection mode according to the network selection mode selected by the user, or according to the currently running application / business scenario. Then, based on the determined network selection mode and combined with the above access environment and business flow information provided by the perception module, all or part of the business flow will be handed over to the hotspot network for sending and receiving processing, and the rest will continue to be sent and received on the WIFI network.

[0114] For a description of the network selection mode and the sending and receiving processing of service flows under different network selection modes, please refer to the description of Figures 9 to 17 below, which will not be repeated here.

[0115] In addition, it should be noted that due to the differences in the operating systems of terminal devices, in actual applications, the parameters of the access environment information and business flow information perceived by the perception module may be different, but basically will include the parameter contents listed above. For other parameter information, reasonable selection can be made based on actual business needs and operating systems, and will not be repeated here.

[0116] In addition, regarding the determination of the currently running application / business scenario mentioned above, in some implementations, when an application is running in the foreground of the terminal device, the name of the currently running application can be determined based on the package name information in the data stream generated when the application is running, so that you can know which application is currently running.

[0117] For example, in other implementations, such as when it is necessary to be specific to the specific business scenario corresponding to the current application, for applications in multiple business scenarios, such as instant messaging applications, audio and video calls / conferences can be realized, files and chat messages can be sent, and content in the circle of friends can be browsed, etc., and it can be further determined by which application programming interface (API) the current data stream is transmitted.

[0118] It is understandable that, since different business scenarios usually correspond to different APIs, the business scenario in which the terminal device is currently located can be determined by determining the currently called API.

[0119] For example, in other implementations, when it is impossible to determine the currently running application and the business scenario based on the package name information and the called API interface, it is also possible to perform image recognition analysis on the currently generated data stream through image recognition, and then obtain the currently running application / business scenario based on the page content corresponding to the data stream.

[0120] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0121] In addition, it should be noted that in order to facilitate the subsequent WPF to reasonably allocate network resources and allocate different business flows to the appropriate network, in some implementation methods, priorities can be divided for the applications running on the terminal device or the business scenarios in which they are located. In this way, when allocating resources, reasonable allocation can be made based on the priority of the application / business scenario, thereby better meeting the user's usage needs and improving the user experience.

[0122] Table 1 Priority matrix

[0123] For example, Table 1 provides a priority matrix table for different application / business scenarios. Referring to Table 1, the content corresponding to the "foreground" row indicates that the application / business scenario of this type is currently running in the foreground of the terminal device (currently with an active interface); the content corresponding to the "background" column indicates that the application / business scenario of this type is currently running in the background of the terminal device (currently without an active interface); the content in the cell where the "foreground" and "background" contents intersect indicates the application / business scenario with the current high priority, that is, when processing business with the help of a hotspot network enabled by a terminal device with cellular communication capabilities, the object indicated in the cell where the "foreground" and "background" contents intersect is the application / business scenario that needs to be dispatched to the hotspot network.

[0124] Continuing to refer to Table 1, for example, at a certain moment, when the terminal device is running an audio and video call / conference type application or business scenario in the foreground, no matter what type of application / business scenario is running in the background, the priority of the audio and video call / conference type application or business scenario in the foreground is higher than that in the background, that is, the business flow corresponding to the audio and video call / conference type application or business scenario running in the foreground is to be scheduled to the hotspot network.

[0125] Continuing to refer to Table 1, for example, at a certain moment, when a game (in this application, an online game) type application or business scenario is running in the foreground of the terminal device, no matter what type of application / business scenario is running in the background, the priority of the game type application or business scenario in the foreground is higher than that in the background, that is, the business flow corresponding to the game type application or business scenario running in the foreground is to be scheduled to the hotspot network.

[0126] Continuing to refer to Table 1, for example, at a certain moment, when the terminal device is currently running a download, or a browser, or an audio and video type application or business scenario, as long as there is an audio and video call / conference type application or business scenario running in the background, the priority of the audio and video call / conference type application or business scenario in the background is higher than that in the foreground, that is, the business flow corresponding to the audio and video call / conference type application or business scenario running in the background is to be scheduled to the hotspot network.

[0127] Continuing to refer to Table 1, for example, at a certain moment, when the terminal device is currently running a browser, or an audio and video type application or business scenario, as long as there is no audio and video call / conference type application or business scenario in the background running applications or business scenarios, the browser type, audio and video type application or business scenario in the foreground has a higher priority than that in the background, that is, the business flow corresponding to the browser type, audio and video type application or business scenario running in the foreground is to be scheduled to the hotspot network.

[0128] Continuing to refer to Table 1, for example, when the terminal device is currently running a download-type application or business scenario, there is no audio and video call / conference type application or business scenario in the background running applications or business scenarios, and there is a game-type application or business scenario, the priority of the game-type application or business scenario in the background is higher than that in the foreground, that is, the business flow corresponding to the game-type application or business scenario running in the background is to be scheduled to the hotspot network; conversely, the priority of the download-type application or business scenario in the foreground is higher than that in the background, that is, the business flow corresponding to the download-type application or business scenario running in the foreground is to be scheduled to the hotspot network.

[0129] In addition, it should be noted that when limiting the network speed of background applications / business scenarios, that is, setting them to low priority, it is also necessary to consider whether the application / business scenario is in the preset whitelist (such as speed limit is not allowed and priority response is required). Accordingly, when it is in the whitelist, it cannot be set to low priority.

[0130] In addition, it should be noted that when setting priorities for applications / business scenarios in the foreground and background, the requirements for latency can also be considered. For example, for applications / business scenarios that are sensitive to latency (high real-time requirements and low latency requirements), such as audio and video calls / conferences, live broadcasts, online education, etc., they can be set to high priority.

[0131] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0132] Therefore, by assigning different priorities to different types of applications / business scenarios, WPF can schedule the business flows corresponding to high-priority applications / business scenarios to networks with better network quality when allocating resources. For example, when the quality of the Wi-Fi network is poor and cannot meet the needs of high-priority applications / business scenarios, the business flows corresponding to high-priority applications / business scenarios can be scheduled to hotspot networks, while the business flows corresponding to low-priority applications / business scenarios can remain on the Wi-Fi network for processing.

[0133] Continuing to refer to FIG. 7 , illustratively, the kernel state may include a system driver layer and a network driver layer.

[0134] Exemplarily, the system driver layer may include various system drivers, such as a WIFI driver (NativeWiFi Filter), an auxiliary function driver (Ancillary Function Driver), a Winsock Kernel that supports multiple types of transmission protocols, etc., which are not listed here one by one and are not limited in this application.

[0135] Exemplarily, the network driver layer, namely the Network Driver Interface Specification (NDIS) layer, may include various protocol drivers (Protocol Driver), various intermediate drivers (Intermediate Driver), various miniport drivers (Miniport Driver), WPF, and the Hardware Abstraction Layer (HAL).

[0136] Specifically in the technical solution provided in the embodiment of the present application, when performing multi-network collaborative operations, the allocation of network resources in concurrent scenarios is specifically implemented in WPF. The operations performed by the resource allocation module located in the kernel layer of the following Android system are similar to those performed by WPF in this embodiment, and the resource allocation processing logic of other operating systems is also roughly the same.

[0137] Regarding the technical solution provided in the embodiment of the present application, when performing multi-network collaborative operations, the allocation of network resources in concurrent scenarios can follow Table 2.

[0138] Table 2 Resource allocation rules

[0139] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0140] In addition, it should be noted that when allocating resources, that is, when using a hotspot network enabled by a terminal device with cellular communication capabilities (the second terminal device), it is necessary to first ensure that the second terminal device has the hotspot function enabled and provides a hotspot network. At the same time, the terminal device that does not currently have cellular communication capabilities (the first terminal device) can search for the hotspot network and automatically connect to it. For details about enabling the hotspot function on the second terminal device and establishing a communication connection between the first terminal device and the second terminal device, please see below and will not be repeated here.

[0141] From the above description, it can be seen that the technical solution provided by the embodiment of the present application needs to include application business startup. After the application business is started, the data flow (business flow) generated during the application business communication process can be collected. After obtaining the business flow, the application / business scenario can be identified, and the perception module perceives the current WIFI network environment and the current business flow (specifically, extracting the influencing factors of whether to trigger multi-network collaborative operations, such as the information included in the WIFI network and the information included in the business flow mentioned above), and then determines the current user experience / user perception (Quality of Experience, QoE) quality evaluation results based on these influencing factors. Finally, WPF (or the resource allocation module below) allocates resources based on the QoE quality evaluation results, the information recorded in Tables 1 and 2, and the content perceived by the perception module.

[0142] Continuing to refer to FIG7 , illustratively, the hardware may include chips, graphics cards, sound cards, etc. provided by various chip manufacturers, which are not listed here one by one and are not limited in this application.

[0143] It is understood that the layers in the software structure shown in FIG7 and the components contained in each layer do not constitute a specific limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 may include more or fewer layers than shown in FIG7, and each layer may include more or fewer components, and this application does not limit this.

[0144] FIG8 is a block diagram of a software structure showing an example of a terminal device 100 using an Android system.

[0145] As shown in Figure 8, the layered architecture of the terminal device 100 divides the software into several layers, each with clear roles and divisions of labor. Layers communicate with each other via software interfaces. In some implementations, the Android system is divided into four layers: from top to bottom, the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.

[0146] The application layer may include a series of application packages. As shown in FIG8 , the application package may include games, settings, wireless local area network (WLAN, for accessing WIFI networks), videos, downloads, and other applications. These are not listed here and are not limited in this application.

[0147] The application framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. In some implementations, these programming interfaces and programming frameworks can be described as functions. As shown in Figure 8, the application framework layer may include functions such as a view system, a resource manager, and a perception module. These functions are not listed here and are not limited in this application.

[0148] Exemplarily, in this embodiment, the perception module is a perception module for perceiving the access environment and the current service flow.

[0149] It is understandable that in some implementations, the above two functions can be integrated into one function or into different functions. As shown in Figure 8, the access environment perception submodule can be separately encapsulated to perceive the access environment, and the service flow perception submodule can be encapsulated to perceive the current service flow. Thus, by perceiving the above information, the specific concurrent scenario when multi-network collaborative operation is performed can be determined. For details, please refer to the description of the perception module in Figure 7 and will not be repeated here.

[0150] Furthermore, it should be noted that the view system located in the application framework layer includes visual controls, such as controls for displaying text and images. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface containing a text notification icon can include a view for displaying text and a view for displaying images.

[0151] In addition, it should be noted that the resource manager located in the application framework layer provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, etc., which are not listed one by one here, and this application does not impose any restrictions on this.

[0152] Android Runtime includes core libraries and a virtual machine. Android Runtime is responsible for scheduling and management of the Android system.

[0153] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0154] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0155] The system library can include multiple functional modules, such as a surface manager, media libraries, a 3D graphics processing library (e.g., OpenGL ES), and a 2D graphics engine (e.g., SGL).

[0156] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

[0157] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0158] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0159] It is understandable that the 2D graphics engine mentioned above is a drawing engine for 2D drawing.

[0160] Furthermore, it's understood that the kernel layer in the Android system is the layer between hardware and software. The kernel layer includes at least the display driver, Bluetooth driver, Wi-Fi driver, camera driver, and a module for allocating network resources in concurrent scenarios during multi-network collaboration. Details on network resource allocation are described in the description of resource scheduling implemented in WPF in Figure 7 and will not be repeated here.

[0161] It is understood that the layers in the software structure shown in FIG8 and the components contained in each layer do not constitute a specific limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 may include more or fewer layers than shown in FIG8, and each layer may include more or fewer components, and this application does not limit this.

[0162] Referring to FIG. 9 , a network selection mode in the multi-network collaborative operation method provided in an embodiment of the present application is exemplarily shown.

[0163] As shown in Figure 9, a two-choice network selection mode is given. For the two-choice network selection mode, only one network link is allowed to exist at the same time. For example, either (1) in Figure 9 shows that the hotspot network is selected for data packet transmission and reception, or (2) in Figure 9 shows that the WIFI network is selected for data packet transmission and reception.

[0164] For example, for the scenario shown in (1) in Figure 9, when the first terminal device is located in a place without a WIFI network, if no available WIFI network can be searched, or the link between the first terminal device and the router connected to the WIFI network is interrupted, resulting in the inability to access the WIFI network, based on the multi-network collaborative operation method provided in the embodiment of the present application, the first terminal device can automatically switch to the second terminal device with the hotspot network turned on, and then use the hotspot network to send and receive data packets.

[0165] It should be noted that in actual applications, in order to ensure that the multi-network collaborative operation method provided in the embodiment of the present application can proceed smoothly, it is necessary to ensure that the first terminal device mentioned above can access the second terminal device and access the hotspot network opened by the second terminal device (for the first terminal device, the hotspot network is also a WIFI network).

[0166] Exemplarily, in some implementations, the multi-screen collaboration function is enabled for the first terminal device and the second terminal device. For example, when the interface content of the second terminal device is displayed on the display interface of the first terminal device, and the operation of the second terminal device is implemented through the interface of the second terminal device displayed in the display interface of the first terminal device, it is only necessary to enable the hotspot function in the second terminal device. When the first terminal device needs to connect to the cellular communication capability of the second terminal device, it can automatically access the hotspot network enabled by the second terminal device without performing hotspot search, password input, etc., thereby using the cellular communication capability of the second terminal device to process services that rely on the network.

[0167] For example, in other implementations, when the first terminal device cannot access the WIFI network through the router (wireless or wired), such as the problems shown in Figures 3 to 5, a prompt message can be displayed on the interface of the first terminal device to prompt the user to operate the second terminal device to turn on the hotspot function. For example, the user can turn on the hotspot function on the second terminal device (the hotspot name and hotspot password can be set or not), and then search for the hotspot network by operating the first terminal device and access it. In this way, when the first terminal device switches back to the interface shown in Figure 4, it can automatically switch to the hotspot network, and subsequently in the process of turning on the hotspot network on the second terminal device, even if the first terminal device can access the WIFI network through the router, it can continue to use the hotspot network when it is necessary to use the WIFI network and the hotspot network to process business concurrently.

[0168] For example, in other implementations, a first terminal device can be set to initiate a hotspot request to a second terminal device that is registered and logged in using the same device account, so that the second terminal device in a set area with the first terminal device can automatically turn on the hotspot network in response to the request, thereby automatically connecting the first terminal to the hotspot network.

[0169] Regarding the use of the same device account mentioned above, for example, when the first terminal device is activated, the registered login is account A. If there is a second terminal device attached that also uses account A, then the second terminal device in the set area with the first terminal device will receive the hotspot request sent by the first terminal device.

[0170] Exemplarily, the hotspot request may be sent in a broadcasting form or a Bluetooth form, and this application does not impose any limitation on this.

[0171] Exemplarily, in other implementations, a first terminal device can be set to send a hotspot request to a second terminal device that also has the currently used application installed, and when the account used to log in to the application on the second terminal device is the same user account, the first terminal device initiates a hotspot request so that the second terminal device in the set area with the first terminal device can automatically turn on the hotspot network in response to the request, thereby automatically connecting the first terminal to the hotspot network.

[0172] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0173] For example, for the scenario shown in (2) in Figure 9, when the first terminal device re-accesses the WIFI network through the router, in order to reduce the consumption of cellular traffic of the second terminal device, it can automatically switch back to the WIFI network from the hotspot network, and the WIFI network will be used to send and receive data packets.

[0174] 10 , which exemplifies a specific implementation process of the multi-network collaborative operation method provided in an embodiment of the present application when implementing the two-choose-one network selection mode shown in FIG9 :

[0175] S101, determining applications currently running on a first terminal device, where the applications include a first application with a first priority and a second application with a second priority, where the first priority is higher than the second priority.

[0176] Exemplarily, in some implementations, the applications currently running on the first terminal device may all be foreground applications, for example, while using an audio and video application to watch audio and video content in small window mode, using an instant messaging application to send files and messages.

[0177] Exemplarily, in other implementations, the applications currently running on the first terminal device may all run corresponding programs in the background, for example, using a download-type application to download files while using a music-playing application to play music in the background.

[0178] Exemplarily, in other implementations, the applications currently running on the first terminal device may include some applications running in the foreground and others running in the background, such as using a download-type application to download files in the background and using a video playback application to watch videos in the foreground.

[0179] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0180] Regarding the determination of the application currently running on the first terminal device, for example, the package name information included in the currently acquired business flow can be extracted, and then the application providing the business flow, that is, the currently running application, can be determined based on the package name information.

[0181] In addition, for the identification of whether the currently running program is running in the foreground or in the background, for example, it can be determined whether the application has an active window (interface) on the display interface of the first terminal device. If so, it is an application running in the foreground; if not, it is an application running in the background.

[0182] Accordingly, after the identification of the program running in the first terminal device is completed, its priority can be determined based on the attribute information corresponding to the application (indicating which type of application it is) and whether it is in the foreground or background.

[0183] It is understandable that the priority of each application can be determined, for example, according to Table 1 given above.

[0184] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0185] In this embodiment, the first terminal device currently runs at least two applications, and the priorities of these two applications are different, such as the first application with the first priority (high priority) and the second application with the second priority (low priority) mentioned above.

[0186] In addition, it should be noted that in some implementations, the same priority can be set for the same application running on different first terminal devices. For example, for the same application A, its priority on terminal device A, terminal device B, and terminal device C that do not have cellular communication capabilities are the same. In this way, the data table for indicating the priority of the application shown in Table 1 can be centrally managed and maintained by the server and then distributed to the corresponding first terminal device, or it can be retained on the server. When the priority needs to be determined, the first terminal device sends information such as the name of the determined application to the server to request the server to feedback the corresponding priority.

[0187] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0188] For example, in other implementations, the same application running on different first terminal devices may be set to different priorities. For example, for the same application A, its priority on terminal device A, which does not have cellular communication capabilities, is the first priority mentioned above, while its priority on terminal device B is the second priority mentioned above. In this way, the priority of the application can be set according to the needs of the user who actually uses the terminal device, thereby achieving individualized application priorities.

[0189] For this implementation scenario, in one implementation, for example, when the multi-network collaborative operation function is enabled, an entry for setting the priority of the currently installed application program may be provided.

[0190] Exemplarily, in another implementation, a priority matrix table suitable for the user may be automatically generated based on the user's historical usage habits.

[0191] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0192] Similarly, the business scenarios included in the same application can also be set based on the above logic, that is, the priorities of the same business scenarios in different first terminal devices can be the same or different. The specific implementation method will not be repeated here.

[0193] S102: Determine a user experience QoE quality evaluation result based on current Wi-Fi network information, a service flow corresponding to the first application, and a service flow corresponding to the second application. The QoE quality evaluation result is used to indicate whether the Wi-Fi network can simultaneously process the service flow corresponding to the first application and the service flow corresponding to the second application.

[0194] The QoE quality assessment results are determined based on the Wi-Fi network information perceived by the access environment perception submodule and the service flow information perceived by the service flow perception submodule. The specific parameters and criteria used in the assessment can be set based on actual service needs and are not limited here.

[0195] S103, when the QoE quality evaluation result indicates that the WIFI network cannot process the service flow corresponding to the first application, nor can it process the service flow corresponding to the second application, the service flow corresponding to the first application and the service flow corresponding to the second application are both scheduled to the hotspot network opened by the second terminal device.

[0196] It is understandable that such a scenario is for example the one shown in (1) in FIG9 .

[0197] S104 , when the QoE quality evaluation result indicates that the WIFI network can simultaneously process the service flow corresponding to the first application and the service flow corresponding to the second application, schedule both the service flow corresponding to the first application and the service flow corresponding to the second application to the WIFI network.

[0198] It is understandable that this scenario is, for example, the situation shown in (2) in FIG9 .

[0199] In addition, it can be seen from the above description that in order to ensure that the first terminal device can dispatch the business flow corresponding to the first application to the hotspot network opened by the second terminal device, before dispatching the business flow corresponding to the first application to the hotspot network opened by the second terminal device, the first terminal device can first determine whether the multi-network collaborative operation function is currently turned on, that is, based on the multi-network collaborative operation method provided in the embodiment of the present application, the function of processing business with the help of a terminal device with cellular communication capabilities is realized.

[0200] Accordingly, if this function is enabled, then when the QoE quality assessment results indicate that the Wi-Fi network cannot process the service flow corresponding to the first application or the service flow corresponding to the second application, the first terminal device can automatically dispatch both the service flow corresponding to the first application and the service flow corresponding to the second application to the hotspot network enabled by the second terminal device. Conversely, if this function is not enabled, it is not possible to dispatch both the service flow corresponding to the first application and the service flow corresponding to the second application to the hotspot network enabled by the second terminal device. In this case, to facilitate user use, a pop-up window can be displayed on the current interface to prompt the user to enable this function.

[0201] For example, in some implementations, an entry (first entry) for activating the function can be directly provided in the pop-up window, so that the user does not need to exit the current interface and can find the entry for activating the function from a designated interface to activate the function. The user can directly operate the first entry, such as clicking, to activate the function. Accordingly, after activating the function, the first terminal device can automatically dispatch the service flow corresponding to the first application and the service flow corresponding to the second application to the hotspot network activated by the second terminal device.

[0202] In addition, it should be noted that when determining whether the user has turned on this function (multi-network collaborative operation function), it can be further determined whether the first terminal device is currently connected to an available hotspot network, such as the hotspot network turned on by the second terminal device mentioned above.

[0203] Accordingly, if access is established, the first terminal device will automatically schedule both the service flows corresponding to the first application and the service flows corresponding to the second application to the hotspot network enabled by the second terminal device. Conversely, if access is not established, the second terminal device will need to first connect to the hotspot network enabled by the second terminal device before scheduling both the service flows corresponding to the first application and the service flows corresponding to the second application to the hotspot network enabled by the second terminal device.

[0204] Regarding the method for the first terminal device to access the hotspot network opened by the second terminal device, for example, it can be through searching for hotspot network information within the connection range (hotspot networks opened by all third terminal devices with cellular communication capabilities within the connection range), and then automatically selecting a hotspot network with the best network quality from the hotspot network information as the hotspot network to be accessed, that is, the hotspot network opened by the second terminal device mentioned above can be accessed.

[0205] For example, in other implementations, in order to improve user participation and better meet the actual needs of users, the searched hotspot network information can be displayed on the display interface of the first terminal device. In this way, the user can select a safe and available hotspot network.

[0206] Correspondingly, when the user selects the hotspot network in the hotspot network information, the hotspot network provided by the third terminal device selected by the user is accessed as the hotspot network of the second terminal device mentioned above.

[0207] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0208] In addition, from the above description, it can be seen that when a multi-screen collaborative connection is established between the first terminal device and the second terminal device, for example, the current interface content of the second terminal device is displayed in the display interface of the first terminal device, and the user can perform operations through the interface of the second terminal device displayed in the first terminal device, and then control the second terminal device to make a corresponding response, the first terminal device can directly control the second terminal device to turn on the hotspot network, and then access the hotspot network.

[0209] Therefore, the multi-network collaborative operation method provided in this embodiment processes services by using the hotspot network opened by the second terminal device with cellular communication capabilities when the WIFI network currently connected to the first terminal device is unavailable, thereby ensuring that the first terminal device without cellular communication capabilities can also process network-dependent services in the scenario where there is no available WIFI network, avoiding business interruption and thus ensuring user experience.

[0210] It is understandable that in order to improve user participation, in actual applications, a user portal can be provided, and the user can select a network selection mode according to their needs, such as the two-choice network selection mode mentioned above, and the application-level concurrent diversion network selection mode and the network selection mode for concurrent diversion of different business flows in the same application mentioned below.

[0211] For example, in some implementations, the user portal can be integrated into an application specifically managing multi-network collaborative operation functions, or integrated into a settings application. This embodiment takes integration into a settings application as an example and is described in conjunction with the accompanying drawings.

[0212] Referring to Figure 11, for example, taking a tablet computer as the first terminal device referred to herein, the tablet computer's display interface displays the tablet computer's home page. The home page includes one or more controls, such as icons for installed applications, a battery icon, a Wi-Fi icon, and the like. For example, after a user clicks the icon for the settings application displayed on the home page, the tablet computer, in response to the user's operation, launches the settings application and displays the settings interface, as shown in Figure 12.

[0213] Referring to Figure 12, for example, for a tablet computer with a larger screen area, its settings interface can be divided into area 10a and area 10b. Area 10a can display one or more setting function options, such as "More Connections," "Desktop and Wallpaper," "Display and Brightness," "Multi-Network Collaboration," "Sound and Vibration," "Notifications," "Battery," and "Storage," as well as a search control for users to search for these setting function options. These are not listed here one by one, and this embodiment does not limit this.

[0214] It should be noted that in some implementations, the setting function option of "multi-network collaboration" can be directly displayed in area 10a as shown in Figure 12. For this scenario, the user directly selects the "multi-network collaboration" function, and area 10b will display the content of setting the multi-network collaboration function.

[0215] For example, in other implementations, the "Multi-network Collaboration" setting function option can also be set in the directory of other setting function options displayed in area 10a. In this scenario, when the user selects this setting function option, the "Multi-network Collaboration" setting entry will be displayed in the content displayed in area 10b. This embodiment takes the form shown in Figure 12 as an example.

[0216] Continuing to refer to FIG. 12 , illustratively, in some implementations, the multi-network collaboration function may be in an inactive state by default, that is, the control 10 b - 1 for enabling the multi-network collaboration function is in the style shown in FIG. 12 .

[0217] Exemplarily, when the user clicks the control 10b - 1 shown in FIG12 , the tablet computer responds to the user's operation and turns on the multi-network collaboration function, and the style of the control 10b - 1 switches to the style shown in FIG13 .

[0218] For example, to facilitate user self-setting of the network selection mode to be followed by the tablet computer during multi-network collaborative operations after the multi-network collaboration function is enabled, after the style of control 10b-1 is switched to the style shown in FIG13 , a control 10b-2 for selecting the network selection mode may also be displayed in area 10b , as shown in FIG13 .

[0219] Referring to Figure 13, exemplarily, the control 10b-2 for selecting the network selection mode may provide a control 10b-21 for selecting the "two-choice network selection mode", a control 10b-22 for selecting the "application-level concurrent classification mode", and a control 10b-23 for selecting the "concurrent diversion mode of different business flows of the same application".

[0220] For example, in some implementations, the controls 10b-21, 10b-22, and 10b-23 may be in an inactive state by default, as shown in FIG13. Thus, after the user turns on the multi-network collaboration function and displays the control 10b-2 in the area 10b, they can choose to turn on any one or more of the network selection modes shown in FIG13 according to their actual needs.

[0221] For example, when the user only turns on one network selection mode among controls 10b-21, controls 10b-22, and controls 10b-23, when the multi-network collaboration function is turned on, when an abnormality occurs in the WIFI network connected to the tablet computer, operations will only be performed according to the currently turned-on network selection mode. For example, when only the two-choice network selection mode is selected, only one network can be selected at the same time, and the WIFI network and the hotspot network are not allowed to operate at the same time.

[0222] For example, when the user turns on multiple network modes in controls 10b-21, controls 10b-22, and controls 10b-23, when the multi-network collaboration function is turned on, if an abnormality occurs in the WIFI network to which the tablet computer is connected, business processing can be performed according to the current WIFI network situation in accordance with the appropriate network selection mode. For example, when controls 10b-22 and 10b-23 are turned on at the same time, while performing application-level concurrent diversion, different business flows of each application can also be diverted concurrently.

[0223] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0224] In addition, it should be noted that, in order to reduce user operations, a control 10b-24 for selecting an "autonomous mode" can also be provided in control 10b-2. When the "autonomous mode" is turned on, regardless of whether controls 10b-21, 10b-22, and 10b-23 are turned on, during the process of enabling the multi-network collaboration function, the tablet computer can autonomously switch between the two-choice network selection mode, the application-level concurrent diversion mode, and the same application different services non-classified mode based on the current Wi-Fi network conditions and the source of the business flow to be processed (application / business scenario), thereby achieving a better multi-network collaboration effect.

[0225] In addition, it should be understood that for terminal devices with smaller screen areas, such as mobile phones, smart watches, etc., when clicking the icon of the settings application to start the settings application and enter the settings interface, the display interface may only display the content in the above-mentioned area 10a. When the user clicks the multi-network collaboration control, the terminal device responds to the user's operation and jumps to the interface displaying the content of area 10b.

[0226] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0227] Referring to FIG. 14 , another network selection mode in the multi-network collaborative operation method provided in an embodiment of the present application is exemplarily shown.

[0228] As shown in Figure 14, a network selection mode for application-level concurrent traffic diversion is provided. For the network selection mode for application-level concurrent traffic diversion, at the same moment, both network links exist, that is, the WiFi network link accessed by the first terminal device through the router in Figure 14 and the hotspot network link accessed by the second terminal device exist at the same time. Regarding the description of the second terminal device enabling the hotspot function and the first terminal device accessing the hotspot network enabled by the second terminal device, please refer to the above description and will not be repeated here.

[0229] For example, when the user selects the network selection mode of application-level concurrent diversion, when multiple applications are running in the first terminal device (using the network to send and receive data packets), the first terminal device can perceive the business flows (data packets) provided by different applications through the perception module, as well as the network requirements of the business scenarios currently processed by each application, and then hand over the data packets of applications with high network requirements (such as high latency requirements and high bandwidth requirements) to the hotspot network for sending and receiving processing, while handing over the data packets of applications with low network requirements (such as low latency requirements and low bandwidth requirements) to the WIFI network for sending and receiving processing, thereby achieving the processing effect of concurrent diversion.

[0230] For example, regarding the above-mentioned applications with high network requirements (such as high latency requirements and high bandwidth requirements), such as audio and video conferencing, audio and video playback, online education, online games, etc., they are not listed here one by one, and this application does not impose any restrictions on them.

[0231] For example, regarding the above-mentioned applications with low network requirements (such as low latency requirements and low bandwidth requirements), sunset instant messaging, email and other applications are not listed here one by one, and this application does not impose any restrictions on them.

[0232] 15 , which exemplifies the specific implementation process of the multi-network collaborative operation method provided by the embodiment of the present application when implementing the network selection mode of application-level concurrent offloading shown in FIG. 14 :

[0233] S201: Determine an application currently running on a first terminal device, where the application includes a first application with a first priority and a second application with a second priority, where the first priority is higher than the second priority.

[0234] S202: Determine a user experience QoE quality evaluation result based on current Wi-Fi network information, a service flow corresponding to the first application, and a service flow corresponding to the second application. The QoE quality evaluation result is used to indicate whether the Wi-Fi network can simultaneously process the service flow corresponding to the first application and the service flow corresponding to the second application.

[0235] The implementation details of step S201 and step S202 can be found in step S101 and step S102 in the above embodiment, which will not be repeated here.

[0236] S203, when the QoE quality evaluation result indicates that the WIFI network cannot simultaneously process the service flow corresponding to the first application and the service flow corresponding to the second application, the service flow corresponding to the first application is scheduled to the hotspot network opened by the second terminal device, and the service flow corresponding to the second application is scheduled to the WIFI network.

[0237] Therefore, the multi-network collaborative operation method provided in this embodiment, when the WIFI network currently connected to the first terminal device is insufficient to meet the business needs of multiple applications running in the first terminal device, simultaneously uses the WIFI network and the hotspot network opened by the second terminal device, and sends and receives data packets of applications with high latency requirements to the hotspot network, while data packets of other applications are retained in the WIFI network for sending and receiving, thereby ensuring that the business of multiple running applications is processed normally and reducing the consumption of cellular traffic.

[0238] Referring to FIG. 16 , another network selection mode in the multi-network collaborative operation method provided in an embodiment of the present application is exemplarily shown.

[0239] As shown in Figure 16, a network selection mode for concurrently splitting different business flows in the same application is given. For the network selection mode for concurrently splitting different business flows in the same application, at the same moment, both network links exist, that is, the WIFI network link accessed by the first terminal device through the router in Figure 16, and the hotspot network link accessed by the second terminal device exist at the same time. Regarding the description of the second terminal device turning on the hotspot function and the first terminal device accessing the hotspot network turned on by the second terminal device, please refer to the above and will not be repeated here.

[0240] For example, when the user selects a network selection mode for concurrent shunting of different business flows, when the application currently running in the first terminal device includes multiple business scenarios, such as a business scenario of an application with audio and video calls / conferences, and a business scenario of simply sending instant messaging messages and files, when the user uses the application to conduct an audio and video call / conference, he also sends or receives a file to a contact. In addition, if the perception module perceives that the currently connected WIFI network is insufficient to simultaneously support the sending and receiving of data packets generated in these two business scenarios, the resource allocation module can distribute them through different networks according to the requirements of the corresponding networks for different business scenarios perceived by the perception module. For example, data packets corresponding to business scenarios with high network requirements (such as high latency requirements and bandwidth requirements), such as audio and video calls / conferences, are handed over to the hotspot network for sending and receiving processing, while data packets for business scenarios with low network requirements (such as low latency requirements and bandwidth requirements), such as sending files and messages, are handed over to the WIFI network for sending and receiving processing, thereby achieving the processing effect of concurrent shunting.

[0241] 17 , which exemplifies a specific implementation process of the multi-network collaborative operation method provided in an embodiment of the present application when implementing the network selection mode for concurrently offloading different service flows of the same application as shown in FIG16 :

[0242] S301: Determine the application currently running on the first terminal device, where the application includes a first application with a first priority and a second application with a second priority, where the first priority is higher than the second priority.

[0243] S302: Determine a user experience QoE quality evaluation result based on current Wi-Fi network information, a service flow corresponding to the first application, and a service flow corresponding to the second application. The QoE quality evaluation result is used to indicate whether the Wi-Fi network can simultaneously process the service flow corresponding to the first application and the service flow corresponding to the second application.

[0244] The implementation details of step S301 and step S302 can be found in step S101 and step S102 in the above embodiment, which will not be repeated here.

[0245] S303. When the QoE quality evaluation result indicates that the WIFI network cannot simultaneously process the business flow corresponding to the first application and the business flow corresponding to the second application, the business flow corresponding to the high-priority business scenario in the first application is scheduled to the hotspot network opened by the second terminal device, and the business flow corresponding to the low-priority business scenario is scheduled to the WIFI network. The business flow corresponding to the high-priority business scenario in the second application is scheduled to the hotspot network opened by the second terminal device, and the business flow corresponding to the low-priority business scenario is scheduled to the WIFI network.

[0246] Specifically, for concurrent processing of different service flows within the same application, the source of the service flows corresponding to each application must be determined during implementation. Specifically, in this embodiment, for example, the source of the service flow corresponding to the first application and the source of the service flow corresponding to the second application must be determined. That is, the source of each service flow to be processed must be determined.

[0247] For example, when a service flow originates from a service scenario, network resources are allocated according to the priority corresponding to the application. For example, when a service flow originates from a service scenario, the service flow originating from the first application is dispatched to the hotspot network enabled by the second terminal device in accordance with the priority corresponding to the first application (first priority). Correspondingly, when a service flow originating from a service scenario, the service flow originating from the second application is dispatched to the Wi-Fi network in accordance with the priority corresponding to the second application (second priority).

[0248] Exemplarily, when the sources of a service flow include at least two service scenarios, network resources are allocated for the service flows generated in each service scenario based on the priority of that service scenario. For example, the service flow corresponding to the high-priority service scenario in the first application is scheduled to the hotspot network enabled by the second terminal device, while the service flow corresponding to the low-priority service scenario is scheduled to the WiFi network. Accordingly, the service flow corresponding to the high-priority service scenario in the second application is scheduled to the hotspot network enabled by the second terminal device, while the service flow corresponding to the low-priority service scenario is scheduled to the WiFi network.

[0249] Regarding the method of determining the source of the business flow, for example, it can be by judging the number of business scenarios included in the application program providing the business flow.

[0250] Accordingly, when the number of business scenarios is 1, it is determined that the business flow comes from one business scenario; when the number of business scenarios is greater than 1, it is determined that the application programming interface called when the application (first application, second application) provides the business flow.

[0251] It is understandable that, in general, different application programming interfaces correspond to different business scenarios. Therefore, when determining the application programming interfaces called when providing a business flow, by deduplicating the called application programming interfaces, the number of business scenarios providing the business flow can be determined based on the number of called application programming interfaces after deduplication.

[0252] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0253] Therefore, the multi-network collaborative operation method provided by this embodiment is that when the application currently running on the first terminal device has multiple business scenarios, and the WIFI network currently connected to the first terminal device is insufficient to meet the transmission and reception of data packets generated in these business scenarios with high bandwidth and latency requirements, the WIFI network and the hotspot network opened by the second terminal device are used simultaneously, and the data packets generated in the business scenarios with high latency and bandwidth requirements are sent and received by the hotspot network, and the data packets generated in other business scenarios are retained in the WIFI network for transmission and reception, thereby ensuring that the data packets in different business scenarios under the same application can be processed normally and reducing the consumption of cellular traffic.

[0254] In addition, it is understood that in order to implement the above functions, the terminal device includes hardware and / or software modules corresponding to the execution of each function. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of this application.

[0255] In addition, it should be noted that in actual applications, the first terminal device can also be set to automatically switch among the three network selection modes mentioned above. That is, when the multi-network collaborative operation function is turned on, all three network modes are checked by default. In this way, in the subsequent use of the first terminal device, the perception module determines which network selection mode is suitable for the current business scenario, and the resource allocation module dispatches different business flows to different networks based on the corresponding network selection mode, such as WIFI network or hotspot network, so that the multi-network collaborative operation is more in line with the actual scenario, better meets the user's usage needs, and improves the user experience.

[0256] In order to better understand the changes in the interface of the first terminal device when the multi-network collaborative operation function is enabled in the manner described in the above embodiment, when there is a business flow to be processed, the first terminal device performs multi-network collaborative operation according to the network selection mode set by the user, or the network selection mode automatically selected by the system according to the network conditions, the following is a specific explanation in conjunction with Figures 18 to 22.

[0257] Referring to Figure 18, an exemplary illustration shows the icon style displayed on a first terminal device, such as a tablet computer, after connecting to a WIFI network (referred to as the first icon in this embodiment), and the icon style displayed on the first terminal device after connecting to a hotspot network enabled by a second terminal device (referred to as the second icon in this embodiment). For example, the first icon may be as shown in (a1) or (a2) in Figure 18; the second icon may be as shown in (b1) or (b2) in Figure 18, or (b3) in Figure 18.

[0258] It should be understood that the above description is merely an example for better understanding the technical solution of this embodiment and is not intended to be the sole limitation of this embodiment. For ease of explanation, this embodiment takes the first icon as shown in FIG18 (a1) and the second icon as shown in FIG18 (b2) as an example.

[0259] Referring to Figure 19, exemplarily, when the first terminal device is a tablet computer, the user turns on the multi-network collaborative operation function in the manner given in the above embodiment, and sets the network selection mode to application-level concurrent diversion mode (control 10b-22 is selected and is in the turned-on state, such as the style of control 10b-1) or automatic mode (control 10b-24 is selected and is in the turned-on state, such as the style of control 10b-1). If there are currently available WIFI networks and hotspot networks, the tablet computer will connect to the WIFI network and the hotspot network, and the first icon and the second icon will be displayed simultaneously in the display interface.

[0260] Continuing to refer to Figure 19, for example, when APP1 is running in the foreground of the tablet computer and the user uses it to watch audio and video images, it is necessary to use network resources to process the business flow 1 corresponding to the audio and video images of APP1, such as obtaining the business flow corresponding to the audio and video images from the server corresponding to APP1 and displaying it on the display interface of the tablet computer. If, while watching the audio and video images through APP1, the user also uses APP2 to download files in the background, a download icon will be displayed on the display interface of the tablet computer, as shown in Figure 19. The download icon indicates that APP2 is running in the background to download files. At this time, the business flow 2 corresponding to the downloaded files will need to be processed using network resources. For this scenario where there are multiple business flows corresponding to the two applications shown in Figure 19 that need to be processed using network resources, the business flow with higher priority in business flow 1 and business flow 2 can be scheduled to the hotspot network indicated by the second icon, while the business flow with lower priority can be scheduled to the WIFI network indicated by the first icon.

[0261] For example, from the description of the priority matrix shown in Table 1 in the above embodiment, it can be seen that the priority of the business flow generated in the audio and video type application or business scenario running in the foreground is higher than the priority of the download type application or business scenario running in the background. Therefore, when business flow 1 is of audio and video type and business flow 2 is of download type, the priority of business flow 1 is higher than the priority of business flow 2, so business flow 1 will be scheduled to the hotspot network indicated by the second icon, and business flow 2 will be scheduled to the WIFI network indicated by the first icon. In this way, concurrent diversion of business flows corresponding to different applications is achieved.

[0262] Referring to Figure 20, exemplarily, when the first terminal device is a tablet computer, the user turns on the multi-network collaborative operation function in the manner given in the above embodiment, and sets the network selection mode to the concurrent diversion mode of different business flows of the same application (control 10b-23 is selected and is in the turned-on state, such as the style of control 10b-1) or the automatic mode (control 10b-24 is selected and is in the turned-on state, such as the style of control 10b-1). If there are currently available WIFI networks and hotspot networks, the tablet computer will connect to the WIFI network and the hotspot network, and the first icon and the second icon will be displayed on the display interface at the same time.

[0263] Continuing to refer to Figure 20, for example, when APP1 is running in the foreground of the tablet computer and the user uses it to watch audio and video images, it is necessary to use network resources to process the business flow 1 corresponding to the audio and video images of APP1, such as obtaining the business flow corresponding to the audio and video images from the server corresponding to APP1 and displaying it on the display interface of the tablet computer. If, while watching the audio and video images through APP1, the user also uses APP1 to download files, such as downloading other audio and video content, a download icon will be displayed on the display interface of the tablet computer, as shown in Figure 20. The download icon indicates that APP1 is downloading files. At this time, the business flow 3 corresponding to the downloaded file will need to be processed using network resources. For this scenario where there are multiple different business flows corresponding to the same application program as shown in Figure 20 that need to be processed using network resources, the business flow with higher priority in business flow 1 and business flow 3 can be scheduled to the hotspot network indicated by the second icon, while the business flow with lower priority can be scheduled to the WIFI network indicated by the first icon.

[0264] For example, from the description of the priority matrix shown in Table 1 in the above embodiment, it can be seen that the priority of the business flow generated in the audio and video type application or business scenario running in the foreground is higher than the priority of the download type application or business scenario running in the background. Therefore, when business flow 1 is of audio and video type and business flow 3 is of download type, the priority of business flow 1 is higher than the priority of business flow 3, so business flow 1 will be scheduled to the hotspot network indicated by the second icon, and business flow 3 will be scheduled to the WIFI network indicated by the first icon. In this way, concurrent diversion of business flows corresponding to different business scenarios within the same application is achieved.

[0265] Referring to Figure 21, exemplarily, when the first terminal device is a tablet computer, the user turns on the multi-network collaborative operation function in the manner given in the above embodiment, and sets the network selection mode to the two-choice mode (control 10b-22 is selected and is in the turned-on state, such as the style of control 10b-1) or the automatic mode (control 10b-24 is selected and is in the turned-on state, such as the style of control 10b-1). If there is currently an available hotspot network and no available WIFI network, the tablet computer will connect to the hotspot network, and the second icon will be displayed in the display interface, and the first icon will not be displayed.

[0266] Continuing with Figure 21, for example, when APP1 is running in the foreground of a tablet computer and a user is using it to watch audio and video, network resources are needed to process service flow 1 corresponding to APP1's audio and video, such as obtaining the service flow corresponding to the audio and video from the server corresponding to APP1 and displaying it on the tablet computer's display interface. If, while watching audio and video through APP1, the user also uses APP1 to download files, such as other audio and video content, a download icon will be displayed on the tablet computer's display interface, as shown in Figure 21. The download icon indicates that APP1 is downloading a file, and at this time, service flow 3 corresponding to the downloaded file will need to be processed using network resources. In this scenario where multiple different service flows corresponding to the same application, such as shown in Figure 21, need to be processed using network resources at the same time, since only hotspot networks are currently available, service flow 1 and service flow 2 will both be dispatched to the hotspot network indicated by the second icon. Thus, in the absence of an available Wi-Fi network, by dispatching the service flows that need to be processed to the hotspot network, the tablet computer can ensure normal service processing and user experience.

[0267] Referring to Figure 22, exemplarily, when the first terminal device is a tablet computer, the user turns on the multi-network collaborative operation function in the manner given in the above embodiment, and sets the network selection mode to the two-choice mode (control 10b-22 is selected and is in the turned-on state, such as the style of control 10b-1) or the automatic mode (control 10b-24 is selected and is in the turned-on state, such as the style of control 10b-1). If there is currently an available WIFI network and no available hotspot network, or there are available WIFI network and hotspot network, the tablet computer will connect to the WIFI network, and the first icon will be displayed in the display interface, and the second icon will not be displayed.

[0268] Continuing with Figure 22, for example, when APP1 is running in the foreground of a tablet computer and a user is using it to watch audio and video, network resources are needed to process service flow 1 corresponding to APP1's audio and video. For example, the service flow corresponding to the audio and video is obtained from the server corresponding to APP1 and displayed on the tablet computer's display interface. If, while watching audio and video through APP1, the user also uses APP1 to download files, such as other audio and video content, a download icon will be displayed on the tablet computer's display interface, as shown in Figure 22. The download icon indicates that APP1 is downloading a file. At this time, service flow 3 corresponding to the downloaded file will need to be processed using network resources. In this scenario where multiple different service flows corresponding to the same application program, such as shown in Figure 22, need to be processed using network resources at the same time, since only a WiFi network link is currently available, both service flow 1 and service flow 2 will be scheduled to the WiFi network indicated by the first icon. Thus, in the two-choose-one network mode, as long as there is an available WiFi network, the service flow that the tablet needs to process will be scheduled to the WiFi network, without relying on the hotspot network enabled by the second terminal device, thereby reducing the consumption of cellular data on the second terminal device.

[0269] Regarding the technical details of the second terminal device turning on the hotspot network, the first terminal device accessing the first hotspot network, and the first terminal device turning on the multi-network collaborative operation function, please refer to the above embodiment and will not be repeated here.

[0270] In addition, it should be noted that the multi-network collaborative operation methods provided in the above embodiments implemented by a terminal device in an actual application scenario can also be executed by a chip system included in the terminal device, wherein the chip system may include a processor. The chip system can be coupled to a memory so that when the chip system is running, it calls a computer program stored in the memory to implement the steps performed by the above terminal device. The processor in the chip system can be an application processor or a processor other than an application processor.

[0271] In addition, embodiments of the present application also provide a multi-network collaborative operation system. Exemplarily, the system includes the aforementioned first terminal device and second terminal device. The second terminal device establishes a mobile connection with a base station via a cellular network and a wireless connection with the first terminal device via a hotspot network.

[0272] Exemplarily, in some implementations, the first terminal device is configured to perform the following operations:

[0273] When there are first-priority and second-priority business flows that need to be processed, obtain current WIFI network information; determine the user experience QoE quality evaluation result based on the WIFI network information, the first-priority business flows, and the second-priority business flows, where the QoE quality evaluation result is used to indicate whether the WIFI network can simultaneously process the first-priority business flows and the second-priority business flows, with the first priority being higher than the second priority; when the QoE quality evaluation result indicates that the WIFI network cannot simultaneously process the first-priority business flows and the second-priority business flows, schedule the first-priority business flows to the hotspot network opened by the second terminal device, and schedule the second-priority business flows to the WIFI network.

[0274] Correspondingly, the second terminal device is used to: schedule the first-priority service flow transmitted by the first terminal device through the hotspot network to the base station for processing through the cellular network.

[0275] Regarding the technical details of the second terminal device turning on the hotspot network, the first terminal device accessing the first hotspot network, and the first terminal device turning on the multi-network collaborative operation function, please refer to the above embodiment and will not be repeated here.

[0276] In addition, an embodiment of the present application also provides a computer-readable storage medium, which stores computer instructions. When the computer instructions are executed on a terminal device, the terminal device executes the above-mentioned related method steps to implement the multi-network collaborative operation method in the above-mentioned embodiment.

[0277] In addition, an embodiment of the present application further provides a computer program product, which, when executed on a terminal device, enables the terminal device to execute the above-mentioned related steps to implement the multi-network collaborative operation method in the above-mentioned embodiment.

[0278] In addition, an embodiment of the present application also provides a chip (which may also be a component or module), which may include one or more processing circuits and one or more transceiver pins; wherein the transceiver pins and the processing circuit communicate with each other through an internal connection path, and the processing circuit executes the above-mentioned related method steps to implement the multi-network collaborative operation method in the above-mentioned embodiment to control the receiving pin to receive signals, so as to control the transmitting pin to send signals.

[0279] In addition, it can be seen from the above description that the terminal device, computer-readable storage medium, computer program product or chip provided in the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0280] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the above embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A multi-network collaborative operation method, characterized in that: Applied to a first terminal device, the method includes: When there are first-priority and second-priority traffic flows that need to be processed, obtain current Wi-Fi network information; Determining a user experience QoE quality evaluation result based on the WiFi network information, the first-priority service flow, and the second-priority service flow, where the QoE quality evaluation result indicates whether the WiFi network can simultaneously process the first-priority service flow and the second-priority service flow, where the first priority is higher than the second priority; When the QoE quality evaluation result indicates that the WIFI network cannot process the first-priority service flow and the second-priority service flow at the same time, scheduling the first-priority service flow to the hotspot network opened by the second terminal device, and scheduling the second-priority service flow to the WIFI network; The second terminal device establishes a mobile connection with the base station through a cellular network, and establishes a wireless connection with the first terminal device through the hotspot network.

2. The method according to claim 1, characterized in that During the process of the first terminal device using the WIFI network, the method further includes: Determining an application currently running on the first terminal device, the application including a first application of a first priority and a second application of a second priority; Using the service flow corresponding to the first application as the service flow of the first priority; The business flow corresponding to the second application is used as the business flow of the second priority.

3. The method according to claim 1, characterized in that During the process of the first terminal device using the WIFI network, the method further includes: Determining an application currently running on the first terminal device, the application including a first application of a first priority and a second application of a second priority; Determining a source of a service flow corresponding to the first application; When the business flow corresponding to the first application program comes from a business scenario, the business flow corresponding to the first application program is used as the business flow with the first priority; When the source of the business flow corresponding to the first application includes at least two business scenarios, determining a priority corresponding to each business scenario; The business flow corresponding to the business scenario with a high priority in the first application is used as the business flow with the first priority, and the business flow corresponding to the business scenario with a low priority in the first application is used as the business flow with the second priority; Determining a source of a service flow corresponding to the second application; When the business flow corresponding to the second application comes from a business scenario, the business flow corresponding to the second application is used as the business flow of the second priority; When the source of the business flow corresponding to the second application includes at least two business scenarios, determining a priority corresponding to each business scenario; The business flow corresponding to the high-priority business scenario in the second application is used as the first-priority business flow, and the business flow corresponding to the low-priority business scenario in the second application is used as the second-priority business flow.

4. The method according to claim 3, characterized in that Determining a source of a service flow corresponding to the first application includes: Determining the number of business scenarios included in the first application according to the attribute information of the first application; When the number of business scenarios included in the first application is one, determining that a business flow corresponding to the first application comes from one business scenario; When the first application includes more than one business scenario, determining an application programming interface called when the first application provides the business flow; wherein different application programming interfaces correspond to different business scenarios; Deduplication is performed on the called application programming interface to obtain the number of business scenarios of the business flow provided by the first application.

5. The method according to claim 3, characterized in that The determining a source of the service flow corresponding to the second application program includes: Determining the number of business scenarios included in the second application according to the attribute information of the second application; When the number of business scenarios included in the second application is one, determining that the business flow corresponding to the second application comes from one business scenario; When the second application includes more than one business scenario, determining an application programming interface called by the second application when providing the business flow; wherein different application programming interfaces correspond to different business scenarios; Deduplication is performed on the called application programming interface to obtain the number of business scenarios of the business flow provided by the second application.

6. The method according to claim 1, characterized in that The method further comprises: When the QoE quality evaluation result indicates that the WIFI network cannot process the first priority business flow or the second priority business flow, both the first priority business flow and the second priority business flow are scheduled to the hotspot network opened by the second terminal device.

7. The method according to claim 6, characterized in that After scheduling both the first-priority service flow and the second-priority service flow to the hotspot network enabled by the second terminal device, the method further includes: When the QoE quality evaluation result indicates that the WIFI network can simultaneously process the first priority service flow and the second priority service flow, or when other accessible WIFI networks are searched, stop scheduling the first priority service flow and the second priority service flow to the hotspot network, and schedule the first priority service flow and the second priority service flow to the WIFI network or search for other accessible WIFI networks.

8. The method according to claim 1, characterized in that The method further comprises: When the QoE quality evaluation result indicates that the WIFI network can process the first-priority service flow and the second-priority service flow simultaneously, both the first-priority service flow and the second-priority service flow are scheduled to the WIFI network.

9. The method according to any one of claims 1 to 8, characterized in that The method further comprises: Determining whether the multi-network collaborative operation function is enabled on the first terminal device; When the multi-network collaborative operation function is enabled on the first terminal device, executing the step of scheduling the service flow of the first priority to the hotspot network enabled on the second terminal device; When the multi-network collaborative operation function is not enabled on the first terminal device, displaying a first entrance; In response to the operation on the first entrance, the multi-network collaborative operation function is turned on, and the step of scheduling the first priority service flow to the hotspot network turned on by the second terminal device is executed.

10. The method according to claim 9, characterized in that Before scheduling the service flow of the first priority to the hotspot network opened by the second terminal device, the method further includes: Determining whether to access the hotspot network opened by the second terminal device; When accessing the hotspot network opened by the second terminal device, executing the step of scheduling the service flow of the first priority to the hotspot network opened by the second terminal device; When the hotspot network opened by the second terminal device is not connected, obtaining hotspot network information within the connection range, the hotspot network information including hotspot networks opened by all third terminal devices with cellular communication capabilities within the connection range; Using a third terminal device with the best network quality among the hotspot network information as the second terminal device; Access the hotspot network opened by the second terminal device, and execute the step of scheduling the service flow of the first priority to the hotspot network opened by the second terminal device.

11. The method according to claim 10, characterized in that After obtaining the hotspot network information within the connection range, the method further includes: Displaying the hotspot network information on the interface of the first terminal device; In response to the user's selection operation of any hotspot network in the hotspot network information, the third terminal device providing the hotspot network will be used as the second terminal device, accessing the hotspot network opened by the second terminal device, and executing the step of scheduling the first priority service flow to the hotspot network opened by the second terminal device.

12. The method according to claim 10, characterized in that Before obtaining hotspot network information within the connection range, the method further includes: Determining whether a multi-screen collaborative connection is established between the first terminal device and the second terminal device; When the multi-screen collaborative connection is established between the first terminal device and the second terminal device, controlling the second terminal device to open a hotspot network, accessing the hotspot network opened by the second terminal device, and performing the step of scheduling the first-priority service flow to the hotspot network opened by the second terminal device; When the multi-screen collaborative connection is not established between the first terminal device and the second terminal device, the step of obtaining hotspot network information within the connection range is performed.

13. The method according to any one of claims 1 to 8, characterized in that The same application in different first terminal devices has the same priority, and the same business scenario has the same priority.

14. The method according to any one of claims 1 to 8, characterized in that The priorities of the same application in different first terminal devices are different, and the priorities of the same business scenarios are different.

15. A multi-network collaborative operation method, characterized in that: Applied to a first terminal device, the method includes: During the process of displaying the first icon and the second icon on the display interface of the first terminal device, when there is a service flow that needs to be processed, the service flow of the first priority is scheduled to the hotspot network indicated by the second icon, and the service flow of the second priority is scheduled to the WiFi network indicated by the first icon; The first priority is higher than the second priority, and the hotspot network is provided by a second terminal device that establishes a mobile connection with a base station.

16. The method according to claim 15, characterized in that The method further comprises: When the first icon displayed in the display interface disappears and the second icon is displayed, when there is a business flow that needs to be processed, the business flow is scheduled to the hotspot network indicated by the second icon.

17. The method according to claim 16, characterized in that The method further comprises: After the first icon is redisplayed on the display interface, the service flow is stopped from being dispatched to the hotspot network, and the service flow is dispatched to the WiFi network indicated by the first icon; or, Stop scheduling the second priority service flow to the hotspot network, schedule the first priority service flow to the hotspot network indicated by the second icon, and schedule the second priority service flow to the WIFI network indicated by the first icon.

18. The method according to claim 15, characterized in that The method further comprises: The second icon displayed in the display interface disappears. During the display of the first icon, when there is a service flow that needs to be processed, the service flow is scheduled to the WIFI network indicated by the first icon.

19. The method according to any one of claims 15 to 18, characterized in that The first-priority business flow is the business flow generated by an audio and video call / conference type application or business scenario running in the foreground, and the second-priority business flow is the business flow generated by an application or business scenario running in the background.

20. The method according to any one of claims 15 to 18, characterized in that The first-priority business flow is a business flow generated in a game-type application or business scenario running in the foreground, and the second-priority business flow is a business flow generated in an application or business scenario running in the background.

21. A multi-network collaborative operation system, characterized in that: The system includes: a first terminal device and a second terminal device, wherein the second terminal device establishes a mobile connection with a base station via a cellular network and establishes a wireless connection with the first terminal device via the hotspot network; The first terminal device is configured to: When there are first-priority and second-priority traffic flows that need to be processed, obtain current Wi-Fi network information; Determining a user experience QoE quality evaluation result based on the WiFi network information, the first-priority service flow, and the second-priority service flow, where the QoE quality evaluation result indicates whether the WiFi network can simultaneously process the first-priority service flow and the second-priority service flow, where the first priority is higher than the second priority; When the QoE quality evaluation result indicates that the WIFI network cannot process the first-priority service flow and the second-priority service flow at the same time, scheduling the first-priority service flow to the hotspot network opened by the second terminal device, and scheduling the second-priority service flow to the WIFI network; The second terminal device is used to: Through the cellular network, the service flow of the first priority transmitted by the first terminal device through the hotspot network is scheduled to the base station for processing.

22. A terminal device, characterized in that: The terminal device includes: a memory and a processor, the memory and the processor are coupled; the memory stores program instructions, and when the program instructions are executed by the processor, the terminal device executes the multi-network collaborative operation method as described in any one of claims 1 to 14, or executes the multi-network collaborative operation method as described in any one of claims 15 to 20.

23. A computer-readable storage medium, characterized in that It includes a computer program, which, when running on a terminal device, enables the terminal device to execute the multi-network collaborative operation method as described in any one of claims 1 to 14, or execute the multi-network collaborative operation method as described in any one of claims 15 to 20.

Images