Multi-device cooperation data processing method, terminal, base station, storage medium, program product and computer device

Abstract

Disclosed are a data processing method for multi-device cooperation, a terminal, a base station, a storage medium, a program product, and a computer device, the method being applied to the terminal, the method comprising: sending a computing cooperation request carrying a plurality of cooperation modes to the base station, so that the base station feeds back a target cooperation mode, the target cooperation mode corresponds to a terminal calculation subtask and a base station calculation subtask; executing the terminal calculation subtask to obtain a terminal calculation result; base station subtask information is sent to the base station according to the target cooperation mode, the base station subtask information is used for indicating the base station to execute a base station calculation subtask, and a base station calculation result is obtained and transmitted to the terminal; and executing a display operation based on the terminal calculation result and the base station calculation result. The embodiments of the present application can adapt to the current conditions of the terminal and the base station to configure a suitable cooperation mode for the terminal and the base station, thereby improving the calculation efficiency when performing cooperation calculation between the terminal and the base station.

Description

Technical Field

[0001] This application relates to the field of communication technology, and in particular to a data processing method for multi-device collaboration, a terminal, a base station, a storage medium, a program product, and a computer device. Background Technology

[0002] In existing technologies, for collaborative computing between terminals and base stations, a fixed computing task collaboration method is generally used, such as allocating a fixed proportion of computing resources to terminals and base stations.

[0003] If the state of the terminal or base station changes, such as a change in the network transmission quality between the terminal and the base station or a limitation on the computing resources that the base station can access, the existing collaborative computing technology may struggle to adapt to these changes in a timely manner, thereby affecting the user experience brought about by collaborative computing. Summary of the Invention

[0004] To address the aforementioned technical problems, this application proposes a multi-device collaborative data processing method, a terminal, a base station, a storage medium, a program product, and a computer device.

[0005] This application provides a multi-device collaborative data processing method applied to a terminal, the method comprising:

[0006] A computing cooperation request carrying multiple cooperation modes is sent to the base station so that the base station can respond with a target cooperation mode, wherein the target cooperation mode corresponds to the terminal computing subtask and the base station computing subtask;

[0007] Execute the terminal computing subtask to obtain the terminal computing result;

[0008] According to the target cooperation mode, base station subtask information is sent to the base station, wherein the base station subtask information is used to instruct the base station to execute the base station calculation subtask, obtain the base station calculation result, and transmit it to the terminal;

[0009] The display operation is performed based on the calculation results of the terminal and the calculation results of the base station.

[0010] Furthermore, the computing collaboration request includes computing task collaboration requirement information and terminal information, wherein the computing task collaboration requirement information indicates the multiple collaboration modes;

[0011] The target collaboration mode is selected by the base station from multiple collaboration modes based on the base station's current available computing power, the computing task collaboration requirements, and the terminal information.

[0012] Furthermore, the computational task collaboration requirement information is also used to indicate filtering conditions with different priorities;

[0013] The filtering criteria include at least one of the following:

[0014] The terminal computing power requirements and base station computing power requirements corresponding to each collaboration mode;

[0015] The communication requirements for each collaboration mode;

[0016] The terminal battery life requirements for each collaboration mode.

[0017] Furthermore, the computing collaboration request is also used to trigger the base station to report configuration information.

[0018] The reporting configuration information is used to indicate the reporting rules, and the reporting content reported by the terminal to the base station is determined by the terminal's current measurement information and the reporting rules.

[0019] Furthermore, the reported content is used to instruct the base station to adjust at least one of the computing power resource allocation scheme, communication resource allocation scheme, and target cooperation mode according to the reported content and then feed it back to the terminal.

[0020] Furthermore, the current measurement information of the terminal includes at least one of the following:

[0021] The end-to-end latency of the computing task measured by the terminal;

[0022] The computation latency measured by the terminal when the terminal computation subtask is executed;

[0023] The terminal measures the computational latency when the display operation is executed;

[0024] The transmission delay achievement rate measured by the terminal based on the base station's calculation results.

[0025] Furthermore, the base station subtask information carries the execution program of the base station computing subtask, or the address of the execution program of the base station computing subtask.

[0026] Furthermore, before sending a computational cooperation request carrying multiple cooperation modes to the base station, the method further includes:

[0027] A computing power task bearer is constructed between the base station and the computing power task bearer, wherein the computing power task bearer includes at least one of the following: bearer identifier, bearer length, drop time, and header compression information.

[0028] Furthermore, the terminal computing subtask is used to instruct the terminal to acquire user input information and send it to the base station.

[0029] Furthermore, when the target collaboration mode is the base station full rendering mode, the base station calculation subtask is used to instruct the base station to render the entire screen based on the user input information, and the terminal calculation result is used to instruct the terminal to display the entire screen.

[0030] Furthermore, when the target collaboration mode is a saturated rendering collaboration mode, the base station computing subtask is used to instruct the base station to render a saturated image based on the user input information, and the terminal computing subtask is also used to instruct the terminal to determine the range of the image to be displayed for the display operation based on the user input information.

[0031] Furthermore, when the target collaboration mode is the image enhancement collaboration mode, the base station computing subtask is used to instruct the base station to render a low-resolution image based on the user input information, and the terminal computing subtask is also used to instruct the terminal to enhance the low-resolution image.

[0032] Furthermore, when the target collaboration mode is a layer overlay collaboration mode,

[0033] The terminal computing subtask is also used to instruct: the terminal to determine the first screen to be rendered and the second screen to be rendered based on the user input information, send the second screen to be rendered to the base station, and render the first screen to be rendered;

[0034] The base station computing subtask is used to instruct the base station to render the second image to be rendered based on the user input information;

[0035] The first image to be rendered and the second image to be rendered require different amounts of computing power to be rendered.

[0036] Furthermore, when the target collaboration mode is a virtual-real overlay collaboration mode, the terminal computing subtask is also used to instruct the terminal to collect the actual image according to the user input information and transmit it to the base station, and the base station computing subtask is used to instruct the base station to render the corresponding rendering entity according to the actual image.

[0037] This application also provides a multi-device collaborative data processing method applied to a base station, the method comprising:

[0038] In response to a computing cooperation request sent by a terminal carrying multiple cooperation modes, a target cooperation mode is fed back to the terminal. The target cooperation mode corresponds to the terminal computing subtask and the base station computing subtask. The target cooperation mode is used to instruct the terminal to execute the terminal computing subtask to obtain the terminal computing result.

[0039] In response to the base station subtask information sent by the terminal according to the target cooperation mode, the base station calculation subtask is executed to obtain the base station calculation result and transmit it to the terminal;

[0040] The base station calculation result is used to instruct the terminal to perform a display operation based on the terminal calculation result and the base station calculation result.

[0041] Furthermore, the computing collaboration request includes computing task collaboration requirement information and terminal information, wherein the computing task collaboration requirement information indicates the multiple collaboration modes;

[0042] The target collaboration mode is selected by the base station from multiple collaboration modes based on the base station's current available computing power, the computing task collaboration requirements, and the terminal information.

[0043] Furthermore, the computational task collaboration requirement information is also used to indicate filtering conditions with different priorities;

[0044] The filtering criteria include at least one of the following:

[0045] The terminal computing power requirements and base station computing power requirements corresponding to each collaboration mode;

[0046] The communication requirements for each collaboration mode;

[0047] The terminal battery life requirements for each collaboration mode.

[0048] Furthermore, the method also includes:

[0049] In response to the computing collaboration request, the system reports configuration information.

[0050] The reporting configuration information is used to indicate the reporting rules, and the reporting content reported by the terminal to the base station is determined by the terminal's current measurement information and the reporting rules.

[0051] Furthermore, the method also includes:

[0052] In response to the reported content, at least one of the computing power resource allocation scheme, communication resource allocation scheme, and target cooperation mode is adjusted according to the reported content and fed back to the terminal.

[0053] Furthermore, the current measurement information of the terminal includes at least one of the following:

[0054] The end-to-end latency of the computing task measured by the terminal;

[0055] The computation latency measured by the terminal when the terminal computation subtask is executed;

[0056] The terminal measures the computational latency when the display operation is executed;

[0057] The transmission delay achievement rate measured by the terminal based on the base station's calculation results.

[0058] Furthermore, the base station subtask information carries the execution program of the base station computing subtask, or the address of the execution program of the base station computing subtask.

[0059] Furthermore, before receiving the computing collaboration request, the method further includes:

[0060] A computing power task bearer is constructed between the terminal and the terminal, wherein the computing power task bearer includes at least one of the following: bearer identifier, bearer length, drop time, and header compression information.

[0061] Furthermore, the terminal computing subtask is used to instruct the terminal to acquire user input information and send it to the base station.

[0062] Furthermore, when the target collaboration mode is the base station full rendering mode, the base station calculation subtask is used to instruct the base station to render the entire screen based on the user input information, and the terminal calculation result is used to instruct the terminal to display the entire screen.

[0063] Furthermore, when the target collaboration mode is a saturated rendering collaboration mode, the base station computing subtask is used to instruct the base station to render a saturated image based on the user input information, and the terminal computing subtask is also used to instruct the terminal to determine the range of the image to be displayed for the display operation based on the user input information.

[0064] Furthermore, when the target collaboration mode is the image enhancement collaboration mode, the base station computing subtask is used to instruct the base station to render a low-resolution image based on the user input information, and the terminal computing subtask is also used to instruct the terminal to enhance the low-resolution image.

[0065] Furthermore, when the target collaboration mode is a layer overlay collaboration mode,

[0066] The terminal computing subtask is also used to instruct: the terminal to determine the first screen to be rendered and the second screen to be rendered based on the user input information, send the second screen to be rendered to the base station, and render the first screen to be rendered;

[0067] The base station computing subtask is used to instruct the base station to render the second image to be rendered based on the user input information;

[0068] The first image to be rendered and the second image to be rendered require different amounts of computing power to be rendered.

[0069] Furthermore, when the target collaboration mode is a virtual-real overlay collaboration mode, the terminal computing subtask is also used to instruct the terminal to collect the actual image according to the user input information and transmit it to the base station, and the base station computing subtask is used to instruct the base station to render the corresponding rendering entity according to the actual image.

[0070] This application also provides a terminal, including:

[0071] The computational cooperation request sending module is used to send a computational cooperation request carrying multiple cooperation modes to the base station, so that the base station can respond with a target cooperation mode, wherein the target cooperation mode corresponds to the terminal computational subtask and the base station computational subtask.

[0072] The terminal computing subtask execution module is used to execute the terminal computing subtask and obtain the terminal computing result;

[0073] The base station subtask information sending module is used to send base station subtask information to the base station according to the target cooperation mode, wherein the base station subtask information is used to instruct the base station to perform the base station calculation subtask, obtain the base station calculation result, and transmit it to the terminal;

[0074] The display operation execution module is used to perform display operations based on the terminal calculation results and the base station calculation results.

[0075] This application also provides a base station, including:

[0076] The computational collaboration request receiving module is used to respond to a computational collaboration request carrying multiple collaboration modes sent by a terminal, and to feed back a target collaboration mode to the terminal. The target collaboration mode corresponds to a terminal computational subtask and a base station computational subtask. The target collaboration mode is used to instruct the terminal to execute the terminal computational subtask to obtain the terminal computational result.

[0077] The base station calculation subtask execution module is used to execute the base station calculation subtask in response to the base station subtask information sent by the terminal according to the target cooperation mode, obtain the base station calculation result and transmit it to the terminal;

[0078] The base station calculation result is used to instruct the terminal to perform a display operation based on the terminal calculation result and the base station calculation result.

[0079] This application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the multi-device collaborative data processing method described in any of the preceding claims.

[0080] This application also provides a computer device, including a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein the processor executes the computer program to implement the steps of the multi-device collaborative data processing method described in any of the preceding claims.

[0081] This application also provides a computer program product, including computer instructions that, when executed by a processor, implement the steps of the multi-device collaborative data processing method described in any of the preceding claims.

[0082] In summary, this application has at least the following beneficial effects:

[0083] The technical solution of this application can adapt to the current situation of the terminal and the base station and configure a suitable cooperation mode for the terminal and the base station, thereby improving the computing efficiency when the terminal and the base station perform collaborative computing. Attached Figure Description

[0084] Figure 1 This is a flowchart illustrating a multi-device collaborative data processing method provided in an embodiment of this application;

[0085] Figure 2 This is a flowchart illustrating a multi-device collaborative data processing method provided in an embodiment of this application;

[0086] Figure 3 This is a schematic diagram of the structure of a terminal provided in an embodiment of this application;

[0087] Figure 4 This is a schematic diagram of the structure of a base station provided in an embodiment of this application;

[0088] Figure 5 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application;

[0089] Figure 6 This is a schematic diagram of multi-device collaborative data processing provided in an embodiment of this application;

[0090] Figure 7 This is a schematic diagram of multi-device collaborative data processing provided in an embodiment of this application. Detailed Implementation

[0091] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.

[0092] In the description of this application, the terms "first," "second," "third," etc., are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, a feature defined with "first," "second," "third," etc., may explicitly or implicitly include one or more of that feature. In the description of this application, unless otherwise stated, "a plurality of" means two or more. In the description of this application, the term "comprising" and its variations are open-ended, meaning "including but not limited to." The term "based on" means "at least partially based on." The term "according to" means "at least partially according to." The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments."

[0093] In the description of this application, it should be noted that, unless otherwise expressly specified and limited, the terms "installation," "connection," and "linking" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal connection between two components. Those skilled in the art can understand the specific meaning of the above terms in this application based on the specific circumstances.

[0094] In the description of this application, it should be noted that, unless otherwise defined, all technical and scientific terms used in this application have the same meaning as commonly understood by one of ordinary skill in the art. The terminology used in this application is for the purpose of describing specific embodiments only and is not intended to limit the application. Those skilled in the art can understand the specific meaning of the above terms in this application based on the specific circumstances.

[0095] See Figure 1 and Figure 6 The diagram illustrates a flowchart of a multi-device collaborative data processing method provided in an embodiment of this application. The method is applied to a terminal and includes steps S11-S14, as follows:

[0096] S11, A computing cooperation request carrying multiple cooperation modes is sent to the base station so that the base station can return the target cooperation mode, wherein the target cooperation mode corresponds to the terminal computing subtask and the base station computing subtask.

[0097] Specifically, the multiple collaboration modes in this embodiment can be generated by the terminal according to the computing power tasks to be executed. Each collaboration mode represents a specific allocation scheme for the computing power tasks, dividing the computing power tasks into different sub-tasks and allocating them to the terminal and the base station respectively. The base station can select a target collaboration mode from the multiple collaboration modes based on the current status of the base station and / or the terminal and feed it back to the terminal. The current status of the base station and / or the terminal may include the computing power that the base station can call upon, relevant information of the terminal, and / or the quality of the communication network between the base station and the terminal.

[0098] S12, Execute the terminal computing subtask to obtain the terminal computing result;

[0099] Specifically, in this embodiment, after receiving the target cooperation mode fed back by the base station, the terminal can execute the terminal computing sub-task corresponding to the target cooperation mode to obtain the terminal computing result.

[0100] S13, according to the target cooperation mode, send base station subtask information to the base station, wherein the base station subtask information is used to instruct the base station to execute the base station calculation subtask, obtain the base station calculation result and transmit it to the terminal;

[0101] Specifically, after receiving the target cooperation mode from the base station, the terminal in this embodiment can send base station subtask information to the base station to instruct the base station to execute the base station calculation subtask corresponding to the target cooperation mode and thus obtain the base station calculation result.

[0102] S14, Perform a display operation based on the terminal calculation result and the base station calculation result.

[0103] It should be noted that the display operation in step S14 can be understood as the terminal fusing the terminal calculation results and the base station calculation results, and presenting the fused result to the user. The display operation here is not limited to displaying the actual information determined by the calculation results, but can also refer to displaying some prompt information to indicate whether the fusion is successful.

[0104] In this embodiment, the terminal and base station can negotiate and determine the most suitable collaborative mode based on the current situation. This allows the terminal and base station to execute their respective computational subtasks and obtain their respective results. Finally, the terminal merges the results and displays them, enabling the terminal to efficiently utilize the base station's computing power to obtain the required results, thereby improving the efficiency of collaborative computation between the terminal and base station. It should be understood that the terminal and base station can execute their respective computational subtasks simultaneously, or different execution times can be set for each subtask depending on factors such as the execution time required for each subtask.

[0105] In one optional implementation, the computing collaboration request includes computing task collaboration requirement information and terminal information, wherein the computing task collaboration requirement information indicates the plurality of collaboration modes;

[0106] The target collaboration mode is selected by the base station from multiple collaboration modes based on the base station's current available computing power, the computing task collaboration requirements, and the terminal information.

[0107] For example, the terminal information may include at least one of the following: the terminal's currently available computing power, the terminal's remaining memory, the terminal's remaining storage, and the terminal's remaining battery power, wherein:

[0108] The currently available computing power of a terminal refers to the computing power that the terminal device can provide in its current state. It is used to evaluate the performance of the terminal device when processing various tasks, such as the data output speed when the terminal device calculates a hash function. It is generally measured by FLOPS (floating-point operations per second). The higher the FLOPS, the more floating-point operations the device can complete per unit of time, thus processing data faster. The computing power of a terminal device is related to factors such as the performance of its hardware configuration and the smoothness of its operating system.

[0109] Remaining terminal memory can be understood as the amount of memory a terminal device needs to consume to indicate or assess the computing tasks it can undertake; for example, it can be expressed in GB or MB.

[0110] Remaining storage on the terminal can be understood as the capacity of a terminal device to indicate or assess the amount of storage space it can handle for computing tasks; for example, it can be expressed in GB or MB.

[0111] The remaining battery power of a terminal device can be understood as an indication or assessment of the remaining battery life that the terminal device can currently support calculation. Specifically, it can be expressed as a percentage or in milliampere-hours (mAh).

[0112] In this embodiment, the terminal can send a computing cooperation request carrying terminal information to the base station to assist the base station in comprehensively considering the actual situation of both the base station and the terminal, thereby selecting the most suitable target cooperation mode from multiple cooperation modes, so that when the computing task corresponding to the target cooperation mode is executed, the computing results can be obtained quickly and summarized at the terminal.

[0113] In an optional implementation, the computing task collaboration requirement information is further used to indicate filtering conditions with different priorities;

[0114] The filtering criteria include at least one of the following:

[0115] The terminal computing power requirements and base station computing power requirements corresponding to each collaboration mode;

[0116] The communication requirements for each collaboration mode;

[0117] The terminal battery life requirements for each collaboration mode.

[0118] It should be noted that the priority of each filtering condition can be set according to the actual situation, and no specific restrictions are imposed here. Among them, it can be determined whether the terminal's remaining battery life meets the measurement threshold T minutes by judging whether the remaining battery life is greater than or equal to the measurement threshold T minutes. The remaining battery life can be determined based on the terminal's remaining battery power and terminal power consumption. The terminal power consumption can be estimated by the terminal and added to the computing task coordination requirement information, or it can be estimated by the base station based on historical data.

[0119] Optionally, computing power requirements can be represented by input / output data types, computing power size and / or storage space, while communication requirements can be represented by end-to-end latency of result return, latency jitter, uplink transmission rate, and downlink transmission rate.

[0120] Optionally, the computing task collaboration requirement information may also include one or more of the following: terminal subtask computing time (unit: ms), terminal subtask result fusion computing time (unit: ms), and terminal subtask computing power consumption (unit: mW).

[0121] Optionally, the base station may pre-store the base station subtask calculation duration (in ms) and the base station subtask calculation result transmission duration (in ms).

[0122] Specifically, in this embodiment, the base station can respond to the computing task collaboration requirement information, and according to the base station's current available computing power, the computing task collaboration requirement information, and the terminal information, filter multiple collaboration modes in descending order of priority of the filtering conditions, using each filtering condition as the filtering basis, until only one collaboration mode remains or no collaboration mode meets the next filtering condition, and then stop filtering, and select the most suitable target collaboration mode from the remaining collaboration modes after stopping filtering.

[0123] In one optional implementation, the computing cooperation request is further used to trigger the base station to report configuration information.

[0124] The reporting configuration information is used to indicate the reporting rules, and the reporting content reported by the terminal to the base station is determined by the terminal's current measurement information and the reporting rules.

[0125] It should be noted that the reporting rules may indicate the parameters to be reported, the reporting period for determining the periodic reporting method, and / or the measurement indicators and their corresponding thresholds for triggering reporting. In this embodiment, the base station can configure reporting rules to the terminal so that the base station can understand the actual situation of the terminal in a timely manner.

[0126] In one optional implementation, the reported content is used to instruct the base station to adjust at least one of the computing resource allocation scheme, communication resource allocation scheme, and target cooperation mode according to the reported content and then feed it back to the terminal.

[0127] It should be noted that the computing resource allocation scheme refers to the computing resources allocated by the base station to the base station's computing sub-tasks. This includes, for example, the size of the container hardware resources used to execute the base station's computing sub-tasks, including but not limited to the number of CPU cores, virtual GPU capabilities, and / or memory size. Furthermore, the computing resource allocation scheme can also refer to the computing resources allocated by the terminal to the terminal's computing sub-tasks. The communication resource allocation scheme can be represented by the QoS Flow 5QI metric used for transmitting computing results.

[0128] In this embodiment, after the terminal sends the reported content to the base station, the base station can understand the actual situation of the terminal, determine whether corresponding adjustments are needed based on the actual situation of the terminal, and feed back the adjusted content to the terminal. This allows the terminal and the base station to dynamically adjust the content, including the target cooperation mode, according to the actual situation.

[0129] In one optional implementation, the terminal's current measurement information includes at least one of the following:

[0130] The end-to-end latency of the computing task measured by the terminal;

[0131] The computation latency measured by the terminal when the terminal computation subtask is executed;

[0132] The terminal measures the computational latency when the display operation is executed;

[0133] The transmission delay achievement rate measured by the terminal based on the base station's calculation results.

[0134] Among them, the unit of calculation task end-to-end latency and calculation latency can be ms, and the unit of transmission latency achievement rate can be percentage.

[0135] It's important to note that transmission delay achievement rate in computing networks is a crucial performance indicator, representing the degree of agreement between actual and expected or theoretical transmission delays. In other words, the transmission delay achievement rate reflects how close the actual network transmission performance is to the expected performance. In computing networks, transmission delay is influenced by various factors, including network bandwidth, transmission distance, device performance, and routing. Theoretically, transmission delay can be reduced by optimizing these factors; however, in practical applications, due to differences in network environment and device performance, actual transmission delay may differ from the theoretical value. The calculation of transmission delay achievement rate is typically based on actual measurement data. First, an expected or theoretical transmission delay value needs to be determined, which can be estimated based on factors such as the performance specifications of network devices, the characteristics of transmission protocols, and network topology. Then, by actually measuring the network transmission delay, the ratio or percentage of the actual delay to the expected delay is calculated, thus obtaining the transmission delay achievement rate. A higher transmission delay achievement rate indicates that the actual network transmission performance is closer to the expected performance, and the better the network performance.

[0136] In one optional implementation, the base station subtask information carries the execution program of the base station computing subtask, or the address of the execution program of the base station computing subtask.

[0137] The address of the execution program for the base station computing subtask refers to the address at which the base station can download and execute the program.

[0138] Alternatively, the address of the executable program can be represented by a Uniform Resource Locator (URL).

[0139] In this embodiment, depending on different actual situations (such as the characteristics of the cooperation mode, the situation between the base station and the terminal, etc.), it is possible to choose to add an executable program or the address of the executable program to the base station subtask information. For example, for cooperation modes where the base station requires a long calculation time, an executable program can be added to the base station subtask information to avoid the base station having to download the executable program separately after receiving the base station subtask information, thus delaying the time for the base station to calculate the subtask. Alternatively, for situations where the communication quality between the base station and the terminal is poor, the address of the executable program can be added to the base station subtask information to avoid the amount of information in the base station subtask information being too large.

[0140] In an optional implementation, before sending a computational cooperation request carrying multiple cooperation modes to the base station, the method further includes:

[0141] A computing power task bearer is constructed between the base station and the computing power task bearer, wherein the computing power task bearer includes at least one of the following: bearer identifier, bearer length, drop time, and header compression information.

[0142] It should be noted that the computing power task bearer in this embodiment can be used to transmit data between the terminal and the base station. For example, the terminal can send the base station subtask information carrying the execution program of the base station computing subtask or the address of the execution program of the base station computing subtask through the computing power task bearer.

[0143] In one alternative implementation, the terminal computing subtask is used to instruct the terminal to acquire user input information and send it to the base station.

[0144] Specifically, when this embodiment is applied to cloud XR services, taking an XR head-mounted display terminal as an example, the XR head-mounted display terminal can be used to extract the user's motion information and add it to the user input information (the user input information may also include other input information such as controller information), wherein:

[0145] Motion information can be represented as 6-DOF information (6 degrees of freedom), namely forward / backward, left / right, up / down, row, yaw, and pitch, where:

[0146] Forward / Backward: Describes the movement of an object in the forward and backward directions.

[0147] Left / Right: Describes the movement of an object in the left-right direction.

[0148] Up / Down: Describes the movement of an object in the vertical direction.

[0149] Row: Typically used to describe rotation about the Z-axis. For example, in a robot or drone, row can describe the rotation of its fuselage.

[0150] Yaw: Rotation about the Y-axis. Often used to describe changes in direction, such as the turning of a vehicle or aircraft on a horizontal plane.

[0151] Pitch: Rotation about the X-axis. Describes the left-right rotation of the front end of an object relative to its rear end, often used to describe the left-right tilt of the nose of an aircraft or robot.

[0152] In one optional implementation, when the target collaboration mode is the base station full rendering mode, the base station calculation subtask is used to instruct the base station to render the entire screen based on the user input information, and the terminal calculation result is used to instruct the terminal to display the entire screen.

[0153] In this embodiment, the terminal sends user input information to the base station. The base station has pre-deployed an application for rendering XR services. After receiving the user input information, the base station calculates the area of ​​the new image to be rendered based on the user input, executes the rendering task, and feeds back the rendering results (i.e., the rendered image) to the terminal. The terminal then displays the received image on the screen in real time. In the base station's full rendering mode, the terminal's subtask is to obtain user input information and send it to the base station, and then display the image received from the base station. The base station's subtask is to complete the calculation and rendering of the entire image based on the user input information.

[0154] In an optional implementation, when the target collaboration mode is a saturation rendering collaboration mode, the base station computing subtask is used to instruct the base station to render a saturated image based on the user input information, and the terminal computing subtask is also used to instruct the terminal to determine the range of the image to be displayed for the display operation based on the user input information.

[0155] In this embodiment, the terminal sends user input information to the base station. The base station is pre-deployed with an application for rendering XR services. After receiving the user input information, the base station renders a screen that exceeds the terminal's display area and transmits the rendered screen to the terminal. The terminal determines the area of ​​the screen to be displayed based on the user input information (e.g., instructions from the user to move on the display screen), and then crops the corresponding screen from the received screen for display. This utilizes the powerful computing capabilities of the base station to render a larger screen for the user to choose from, avoiding the base station rendering the corresponding screen only after the user has selected the area to be displayed, effectively reducing the perceived delay caused by the base station rendering the display screen.

[0156] In one optional implementation, when the target collaboration mode is a picture enhancement collaboration mode, the base station computing subtask is used to instruct the base station to render a low-resolution picture based on the user input information, and the terminal computing subtask is also used to instruct the terminal to perform picture enhancement on the low-resolution picture.

[0157] For example, the image enhancement is performed through a super-resolution algorithm, thereby enabling the terminal to effectively improve the resolution of low-resolution images. In this embodiment, the rendering computing power requirements of the base station and the communication requirements for data transmission between the terminal and the base station can be reduced.

[0158] In one optional implementation, when the target collaboration mode is a layer overlay collaboration mode,

[0159] The terminal computing subtask is also used to instruct: the terminal to determine the first screen to be rendered and the second screen to be rendered based on the user input information, send the second screen to be rendered to the base station, and render the first screen to be rendered;

[0160] The base station computing subtask is used to instruct the base station to render the second image to be rendered based on the user input information;

[0161] The first image to be rendered and the second image to be rendered require different amounts of computing power to be rendered.

[0162] Optionally, the computing power required to render the first image to be rendered is less than the computing power required to render the second image to be rendered. In this embodiment, the terminal can perform only low-computing-power tasks, such as rendering the UI, while the base station renders other high-computing-power tasks to obtain other images. Finally, the terminal overlays the UI with other images and outputs them to the display screen for display.

[0163] In an optional implementation, when the target collaboration mode is a virtual-real overlay collaboration mode, the terminal computing subtask is further used to instruct the terminal to collect the actual image according to the user input information and transmit it to the base station, and the base station computing subtask is used to instruct the base station to render the corresponding rendering entity according to the actual image.

[0164] In this embodiment, the terminal can ultimately overlay the rendered entity onto the actual image and output it to the display screen for display.

[0165] The following table 1 summarizes the descriptions of the embodiments of the above five target collaboration modes.

[0166]

[0167] Table 1

[0168] In one specific embodiment, see Figure 7 The embodiments of this application can be applied to wireless networks composed of O-RAN architecture, wherein:

[0169] O-RAN (Open Radio Access Network) is a concept based on the interoperability and standardization of RAN elements. Its goal is to build an open, intelligent, virtualized radio access network architecture that allows interoperability between products from different vendors.

[0170] In the O-RAN architecture, an E2 Node is a logical node defined by O-RAN and connected via an E2 interface. The E2 interface is a standardized interface used in the O-RAN architecture to connect the RAN (Radio Access Network) intelligent controller (such as the RIC, Radio Intelligent Controller) and RAN functions (such as the O-DU, Open Distributed Unit; O-RU, Open Radio Unit). The E2 Node is the logical representation of the RAN function and is responsible for handling signaling and data transmission related to the E2 interface. Through the E2 interface, the E2 Node can collect real-time data from the RAN, including the performance, configuration, and status information of the wireless network. This data is crucial for the RAN intelligent controller to manage and optimize radio resources. In the O-RAN architecture, the role of the E2 Node can be played by different network elements, such as the O-CUCP (O-RAN Central Unit Control Plane), O-CUUP (O-RAN Central Unit User Plane), and O-DU (Open Distributed Unit). These network elements, by implementing the functions of the E2 interface, can communicate with the RAN intelligent controller, thereby achieving intelligent control and optimization of the wireless network. In addition, the E2 Node interacts with both the Non-Real-Time Intelligent Controller (Non-RT RI C) and the Near-Real-Time Intelligent Controller (Near-RT RI C). The Near-RT RI C primarily provides near-real-time radio resource control and optimization to the base station based on data collected by the E2 Node. The Non-RT RI C, on the other hand, communicates with the Near-RT RI C via the A1 interface and is responsible for functions such as training, inference, and updating AI / ML models.

[0171] Near-RT RI C (Near Real-Time Radio Intelligent Controller) is a key component in the O-RAN architecture. Based on data collected by E2 Nodes, it provides near real-time radio resource control and optimization to the base station. Its functions can be all or part of the traditional RRM (Radio Resource Management) functions, such as user-level carrier load balancing, radio bearer management, interference monitoring, and mobility management.

[0172] Service Management and Orchestration (SMO) is a core component of the O-RAN architecture, responsible for managing network functions and NFVI (Network Functions Virtualization Infrastructure) resources. The role of SMO is similar to that of MANO (Management and Orchestration) in NFV (Network Functions Virtualization).

[0173] In this embodiment, in the O-RAN architecture, the E2 node acts as a cloud-based base station, capable of providing communication and computing services and communicating directly with the terminal UE. The Near-RT RI C can collect communication and computing data during the execution of computing tasks through the E2 interface connected to the E2 node, thereby internally generating control information for adjusting communication and computing resources and transmitting it to the E2 node. The SMO can collect network configuration information through the O1 interface and cloud computing resource information of the E2 node through the O2 interface. Based on the network configuration information and cloud computing resource information, it selects the most suitable target cooperation mode and sends it to the E2 node, and generates a guarantee policy for the target cooperation mode during cooperative execution and sends it to the Near-RT RI C.

[0174] See Figure 2 and Figure 6 The diagram illustrates a flowchart of a multi-device collaborative data processing method provided in an embodiment of this application. The method is applied to a base station and includes steps S21-S22, as follows:

[0175] S21, in response to a computing cooperation request carrying multiple cooperation modes sent by the terminal, a target cooperation mode is fed back to the terminal, wherein the target cooperation mode corresponds to the terminal computing sub-task and the base station computing sub-task, and the target cooperation mode is used to instruct the terminal to execute the terminal computing sub-task to obtain the terminal computing result;

[0176] S22, in response to the base station subtask information sent by the terminal according to the target cooperation mode, the base station calculation subtask is executed to obtain the base station calculation result and transmit it to the terminal;

[0177] The base station calculation result is used to instruct the terminal to perform a display operation based on the terminal calculation result and the base station calculation result.

[0178] For example, in this embodiment, the steps performed by the base station can be specifically performed by the computing power scheduling orchestrator.

[0179] In one optional implementation, the computing collaboration request includes computing task collaboration requirement information and terminal information, wherein the computing task collaboration requirement information indicates the plurality of collaboration modes;

[0180] The target collaboration mode is selected by the base station from multiple collaboration modes based on the base station's current available computing power, the computing task collaboration requirements, and the terminal information.

[0181] In an optional implementation, the computing task collaboration requirement information is further used to indicate filtering conditions with different priorities;

[0182] The filtering criteria include at least one of the following:

[0183] The terminal computing power requirements and base station computing power requirements corresponding to each collaboration mode;

[0184] The communication requirements for each collaboration mode;

[0185] The terminal battery life requirements for each collaboration mode.

[0186] In an optional implementation, the method further includes:

[0187] In response to the computing collaboration request, the system reports configuration information.

[0188] The reporting configuration information is used to indicate the reporting rules, and the reporting content reported by the terminal to the base station is determined by the terminal's current measurement information and the reporting rules.

[0189] In an optional implementation, the method further includes:

[0190] In response to the reported content, at least one of the computing power resource allocation scheme, communication resource allocation scheme, and target cooperation mode is adjusted according to the reported content and fed back to the terminal.

[0191] In one optional implementation, the terminal's current measurement information includes at least one of the following:

[0192] The end-to-end latency of the computing task measured by the terminal;

[0193] The computation latency measured by the terminal when the terminal computation subtask is executed;

[0194] The terminal measures the computational latency when the display operation is executed;

[0195] The transmission delay achievement rate measured by the terminal based on the base station's calculation results.

[0196] In one optional implementation, the base station subtask information carries the execution program of the base station computing subtask, or the address of the execution program of the base station computing subtask.

[0197] In an optional implementation, before receiving the computing collaboration request, the method further includes:

[0198] A computing power task bearer is constructed between the terminal and the terminal, wherein the computing power task bearer includes at least one of the following: bearer identifier, bearer length, drop time, and header compression information.

[0199] In one alternative implementation, the terminal computing subtask is used to instruct the terminal to acquire user input information and send it to the base station.

[0200] In one optional implementation, when the target collaboration mode is the base station full rendering mode, the base station calculation subtask is used to instruct the base station to render the entire screen based on the user input information, and the terminal calculation result is used to instruct the terminal to display the entire screen.

[0201] In an optional implementation, when the target collaboration mode is a saturation rendering collaboration mode, the base station computing subtask is used to instruct the base station to render a saturated image based on the user input information, and the terminal computing subtask is also used to instruct the terminal to determine the range of the image to be displayed for the display operation based on the user input information.

[0202] In one optional implementation, when the target collaboration mode is a picture enhancement collaboration mode, the base station computing subtask is used to instruct the base station to render a low-resolution picture based on the user input information, and the terminal computing subtask is also used to instruct the terminal to perform picture enhancement on the low-resolution picture.

[0203] In one optional implementation, when the target collaboration mode is a layer overlay collaboration mode,

[0204] The terminal computing subtask is also used to instruct: the terminal to determine the first screen to be rendered and the second screen to be rendered based on the user input information, send the second screen to be rendered to the base station, and render the first screen to be rendered;

[0205] The base station computing subtask is used to instruct the base station to render the second image to be rendered based on the user input information;

[0206] The first image to be rendered and the second image to be rendered require different amounts of computing power to be rendered.

[0207] In an optional implementation, when the target collaboration mode is a virtual-real overlay collaboration mode, the terminal computing subtask is further used to instruct the terminal to collect the actual image according to the user input information and transmit it to the base station, and the base station computing subtask is used to instruct the base station to render the corresponding rendering entity according to the actual image.

[0208] Accordingly, this application also provides a terminal capable of implementing all processes of the multi-device collaborative data processing method for terminals provided in the above embodiments.

[0209] See Figure 3The diagram shows a structural schematic of a terminal provided in an embodiment of this application. The terminal includes:

[0210] The computational cooperation request sending module 301 is used to send a computational cooperation request carrying multiple cooperation modes to the base station so that the base station can respond with a target cooperation mode, wherein the target cooperation mode corresponds to the terminal computational subtask and the base station computational subtask.

[0211] The terminal computing subtask execution module 302 is used to execute the terminal computing subtask and obtain the terminal computing result;

[0212] The base station subtask information sending module 303 is used to send base station subtask information to the base station according to the target cooperation mode, wherein the base station subtask information is used to instruct the base station to perform the base station calculation subtask, obtain the base station calculation result and transmit it to the terminal;

[0213] The display operation execution module 304 is used to perform display operations based on the terminal calculation results and the base station calculation results.

[0214] In one optional implementation, the computing collaboration request includes computing task collaboration requirement information and terminal information, wherein the computing task collaboration requirement information indicates the plurality of collaboration modes;

[0215] The target collaboration mode is selected by the base station from multiple collaboration modes based on the base station's current available computing power, the computing task collaboration requirements, and the terminal information.

[0216] In an optional implementation, the computing task collaboration requirement information is further used to indicate filtering conditions with different priorities;

[0217] The filtering criteria include at least one of the following:

[0218] The terminal computing power requirements and base station computing power requirements corresponding to each collaboration mode;

[0219] The communication requirements for each collaboration mode;

[0220] The terminal battery life requirements for each collaboration mode.

[0221] In one optional implementation, the computing cooperation request is further used to trigger the base station to report configuration information.

[0222] The reporting configuration information is used to indicate the reporting rules, and the reporting content reported by the terminal to the base station is determined by the terminal's current measurement information and the reporting rules.

[0223] In one optional implementation, the reported content is used to instruct the base station to adjust at least one of the computing resource allocation scheme, communication resource allocation scheme, and target cooperation mode according to the reported content and then feed it back to the terminal.

[0224] In one optional implementation, the terminal's current measurement information includes at least one of the following:

[0225] The end-to-end latency of the computing task measured by the terminal;

[0226] The computation latency measured by the terminal when the terminal computation subtask is executed;

[0227] The terminal measures the computational latency when the display operation is executed;

[0228] The transmission delay achievement rate measured by the terminal based on the base station's calculation results.

[0229] In one optional implementation, the base station subtask information carries the execution program of the base station computing subtask, or the address of the execution program of the base station computing subtask.

[0230] In one optional implementation, the terminal further includes:

[0231] The computing power task bearer construction module is used to construct a computing power task bearer with the base station before sending a computing collaboration request carrying multiple collaboration modes to the base station, wherein the computing power task bearer includes at least one of the following: bearer identifier, bearer length, drop time, and header compression information.

[0232] In one alternative implementation, the terminal computing subtask is used to instruct the terminal to acquire user input information and send it to the base station.

[0233] In one optional implementation, when the target collaboration mode is the base station full rendering mode, the base station calculation subtask is used to instruct the base station to render the entire screen based on the user input information, and the terminal calculation result is used to instruct the terminal to display the entire screen.

[0234] In an optional implementation, when the target collaboration mode is a saturation rendering collaboration mode, the base station computing subtask is used to instruct the base station to render a saturated image based on the user input information, and the terminal computing subtask is also used to instruct the terminal to determine the range of the image to be displayed for the display operation based on the user input information.

[0235] In one optional implementation, when the target collaboration mode is a picture enhancement collaboration mode, the base station computing subtask is used to instruct the base station to render a low-resolution picture based on the user input information, and the terminal computing subtask is also used to instruct the terminal to perform picture enhancement on the low-resolution picture.

[0236] In one optional implementation, when the target collaboration mode is a layer overlay collaboration mode,

[0237] The terminal computing subtask is also used to instruct: the terminal to determine the first screen to be rendered and the second screen to be rendered based on the user input information, send the second screen to be rendered to the base station, and render the first screen to be rendered;

[0238] The base station computing subtask is used to instruct the base station to render the second image to be rendered based on the user input information;

[0239] The first image to be rendered and the second image to be rendered require different amounts of computing power to be rendered.

[0240] In an optional implementation, when the target collaboration mode is a virtual-real overlay collaboration mode, the terminal computing subtask is further used to instruct the terminal to collect the actual image according to the user input information and transmit it to the base station, and the base station computing subtask is used to instruct the base station to render the corresponding rendering entity according to the actual image.

[0241] Accordingly, this application also provides a base station capable of implementing all processes of the multi-device collaborative data processing method for base stations provided in the above embodiments.

[0242] See Figure 4 The diagram shows a structural schematic of a base station provided in an embodiment of this application. The base station includes:

[0243] The computational collaboration request receiving module 401 is used to respond to a computational collaboration request carrying multiple collaboration modes sent by a terminal, and to feed back a target collaboration mode to the terminal. The target collaboration mode corresponds to a terminal computational subtask and a base station computational subtask. The target collaboration mode is used to instruct the terminal to execute the terminal computational subtask to obtain the terminal computational result.

[0244] The base station calculation subtask execution module 402 is used to execute the base station calculation subtask in response to the base station subtask information sent by the terminal according to the target cooperation mode, obtain the base station calculation result and transmit it to the terminal;

[0245] The base station calculation result is used to instruct the terminal to perform a display operation based on the terminal calculation result and the base station calculation result.

[0246] In one optional implementation, the computing collaboration request includes computing task collaboration requirement information and terminal information, wherein the computing task collaboration requirement information indicates the plurality of collaboration modes;

[0247] The target collaboration mode is selected by the base station from multiple collaboration modes based on the base station's current available computing power, the computing task collaboration requirements, and the terminal information.

[0248] In an optional implementation, the computing task collaboration requirement information is further used to indicate filtering conditions with different priorities;

[0249] The filtering criteria include at least one of the following:

[0250] The terminal computing power requirements and base station computing power requirements corresponding to each collaboration mode;

[0251] The communication requirements for each collaboration mode;

[0252] The terminal battery life requirements for each collaboration mode.

[0253] In one optional implementation, the base station further includes:

[0254] The configuration information reporting feedback module is used to respond to the computing collaboration request and report configuration information.

[0255] The reporting configuration information is used to indicate the reporting rules, and the reporting content reported by the terminal to the base station is determined by the terminal's current measurement information and the reporting rules.

[0256] In one optional implementation, the base station further includes:

[0257] An adjustment module is used to respond to the reported content, adjust at least one of the computing power resource allocation scheme, communication resource allocation scheme, and target cooperation mode according to the reported content, and feed it back to the terminal.

[0258] In one optional implementation, the terminal's current measurement information includes at least one of the following:

[0259] The end-to-end latency of the computing task measured by the terminal;

[0260] The computation latency measured by the terminal when the terminal computation subtask is executed;

[0261] The terminal measures the computational latency when the display operation is executed;

[0262] The transmission delay achievement rate measured by the terminal based on the base station's calculation results.

[0263] In one optional implementation, the base station subtask information carries the execution program of the base station computing subtask, or the address of the execution program of the base station computing subtask.

[0264] In one optional implementation, the base station further includes:

[0265] The computing power task bearer construction module is used to construct a computing power task bearer with the terminal before receiving the computing collaboration request, wherein the computing power task bearer includes at least one of the following: bearer identifier, bearer length, discard time, and header compression information.

[0266] In one alternative implementation, the terminal computing subtask is used to instruct the terminal to acquire user input information and send it to the base station.

[0267] In one optional implementation, when the target collaboration mode is the base station full rendering mode, the base station calculation subtask is used to instruct the base station to render the entire screen based on the user input information, and the terminal calculation result is used to instruct the terminal to display the entire screen.

[0268] In an optional implementation, when the target collaboration mode is a saturation rendering collaboration mode, the base station computing subtask is used to instruct the base station to render a saturated image based on the user input information, and the terminal computing subtask is also used to instruct the terminal to determine the range of the image to be displayed for the display operation based on the user input information.

[0269] In one optional implementation, when the target collaboration mode is a picture enhancement collaboration mode, the base station computing subtask is used to instruct the base station to render a low-resolution picture based on the user input information, and the terminal computing subtask is also used to instruct the terminal to perform picture enhancement on the low-resolution picture.

[0270] In one optional implementation, when the target collaboration mode is a layer overlay collaboration mode,

[0271] The terminal computing subtask is also used to instruct: the terminal to determine the first screen to be rendered and the second screen to be rendered based on the user input information, send the second screen to be rendered to the base station, and render the first screen to be rendered;

[0272] The base station computing subtask is used to instruct the base station to render the second image to be rendered based on the user input information;

[0273] The first image to be rendered and the second image to be rendered require different amounts of computing power to be rendered.

[0274] In an optional implementation, when the target collaboration mode is a virtual-real overlay collaboration mode, the terminal computing subtask is further used to instruct the terminal to collect the actual image according to the user input information and transmit it to the base station, and the base station computing subtask is used to instruct the base station to render the corresponding rendering entity according to the actual image.

[0275] This application also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the steps of the multi-device collaborative data processing method described in any of the above claims.

[0276] This application also provides a computer device, including a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein the processor executes the computer program to implement the steps of the multi-device collaborative data processing method described in any of the above claims.

[0277] See Figure 5 The computer device in this embodiment includes a processor 501, a memory 502, and a computer program stored in the memory 502 and executable on the processor 501, such as a multi-device collaborative data processing program. When the processor 501 executes the computer program, it implements the steps in the various multi-device collaborative data processing method embodiments described above, for example... Figure 1 Steps S11-S14 shown or Figure 2 Steps S21-S22 are shown.

[0278] For example, the computer program may be divided into one or more modules / units, which are stored in the memory 502 and executed by the processor 501 to complete this application. The one or more modules / units may be a series of computer program instruction segments capable of performing a specific function, which describe the execution process of the computer program in the computer device.

[0279] The computer device may be a desktop computer, laptop, handheld computer, or cloud server, etc. The computer device may include, but is not limited to, a processor 501 and a memory 502. Those skilled in the art will understand that the schematic diagram is merely an example of a computer device and does not constitute a limitation on the computer device. It may include more or fewer components than shown, or combine certain components, or different components. For example, the computer device may also include input / output devices, network access devices, buses, etc.

[0280] The processor 501 can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor, or the processor 501 can be any conventional processor. The processor 501 is the control center of the computer device, connecting various parts of the entire computer device through various interfaces and lines.

[0281] The memory 502 can be used to store the computer programs and / or modules. The processor 501 implements various functions of the computer device by running or executing the computer programs and / or modules stored in the memory 502 and calling the data stored in the memory 502. The memory 502 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created according to the use of the mobile phone (such as audio data, phonebook, etc.). In addition, the memory 502 may include high-speed random access memory, and may also include non-volatile memory, such as hard disk, memory, plug-in hard disk, smart memory card (SMC), secure digital card (SD) card, flash card, at least one disk storage device, flash memory device, or other volatile solid-state storage device.

[0282] Wherein, if the modules / units integrated into the computer device are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by the processor 501, it can implement the steps of the various method embodiments described above. Wherein, the computer program includes computer program code, which can be in the form of source code, object code, executable file, or some intermediate form, etc. The computer-readable medium can include: any entity or device capable of carrying the computer program code, recording medium, USB flash drive, portable hard drive, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal, and software distribution medium, etc.

[0283] This application also provides a computer program product, including computer instructions that, when executed by a processor, implement the steps of the multi-device collaborative data processing method described in any of the above claims.

[0284] In summary, the embodiments of this application have at least the following beneficial effects:

[0285] First, it can expand the range of services that computing networks can provide. For example, it can provide a collaborative mode with more tolerant latency requirements for computing tasks that require extremely low latency.

[0286] Secondly, it can increase the flexibility of computing power orchestration and scheduling. For example, when a base station receives multiple implementation methods of cooperation modes, it can choose to offload subtasks to more computing power nodes during computing power resource orchestration, thereby increasing the system capacity of the computing power network.

[0287] Third, it can increase adaptability to changes in network status. For example, when a user terminal providing services moves or the air interface status fluctuates, the base station may select another cooperation mode as the target cooperation mode and notify the user terminal to adapt to dynamic changes and better ensure the user experience.

[0288] Through the above description of the embodiments, those skilled in the art can clearly understand that this application can be implemented by means of software plus necessary hardware platforms, or it can be implemented entirely by hardware. Based on this understanding, all or part of the technical solutions of this application that contribute to the background technology can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in various embodiments or some parts of the embodiments of this application.

[0289] The above description is the preferred embodiment of this application. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of this application, and these improvements and modifications are also considered to be within the scope of protection of this application.

Claims

1. A data processing method for multi-device collaboration, characterized in that, Applied to a terminal, the method includes: A computing cooperation request carrying multiple cooperation modes is sent to the base station so that the base station can respond with a target cooperation mode, wherein the target cooperation mode corresponds to the terminal computing subtask and the base station computing subtask; Execute the terminal computing subtask to obtain the terminal computing result; According to the target cooperation mode, base station subtask information is sent to the base station, wherein the base station subtask information is used to instruct the base station to execute the base station calculation subtask, obtain the base station calculation result, and transmit it to the terminal; The display operation is performed based on the calculation results of the terminal and the calculation results of the base station.

2. The multi-device collaborative data processing method as described in claim 1, characterized in that, The computing collaboration request includes computing task collaboration requirement information and terminal information, and the computing task collaboration requirement information indicates the multiple collaboration modes; The target collaboration mode is selected by the base station from multiple collaboration modes based on the base station's current available computing power, the computing task collaboration requirements, and the terminal information.

3. The multi-device collaborative data processing method as described in claim 2, characterized in that, The computational task collaboration requirement information is also used to indicate filtering conditions with different priorities; The filtering criteria include at least one of the following: The terminal computing power requirements and base station computing power requirements corresponding to each collaboration mode; The communication requirements for each collaboration mode; The terminal battery life requirements for each collaboration mode.

4. The multi-device collaborative data processing method as described in claim 1, characterized in that, The computing collaboration request is also used to trigger the base station to report configuration information. The reporting configuration information is used to indicate the reporting rules, and the reporting content reported by the terminal to the base station is determined by the terminal's current measurement information and the reporting rules.

5. The multi-device collaborative data processing method as described in claim 4, characterized in that, The reported content is used to instruct the base station to adjust at least one of the computing power resource allocation scheme, communication resource allocation scheme, and target cooperation mode according to the reported content and then feed it back to the terminal.

6. The multi-device collaborative data processing method as described in claim 4, characterized in that, The current measurement information of the terminal includes at least one of the following: The end-to-end latency of the computing task measured by the terminal; The computation latency measured by the terminal when the terminal computation subtask is executed; The terminal measures the computational latency when the display operation is executed; The transmission delay achievement rate measured by the terminal based on the base station's calculation results.

7. The multi-device collaborative data processing method as described in claim 1, characterized in that, The base station subtask information carries the execution program of the base station computing subtask, or the address of the execution program of the base station computing subtask.

8. The multi-device collaborative data processing method as described in any one of claims 1-7, characterized in that, Before sending a computational cooperation request carrying multiple cooperation modes to the base station, the method further includes: A computing power task bearer is constructed between the base station and the computing power task bearer, wherein the computing power task bearer includes at least one of the following: bearer identifier, bearer length, drop time, and header compression information.

9. The multi-device collaborative data processing method as described in any one of claims 1-7, characterized in that, The terminal computing subtask is used to instruct the terminal to obtain user input information and send it to the base station.

10. The multi-device collaborative data processing method as described in claim 9, characterized in that, When the target collaboration mode is the base station full rendering mode, the base station calculation subtask is used to instruct the base station to render the entire screen based on the user input information, and the terminal calculation result is used to instruct the terminal to display the entire screen.

11. The multi-device collaborative data processing method as described in claim 9, characterized in that, When the target collaboration mode is the saturation rendering collaboration mode, the base station computing subtask is used to instruct the base station to render a saturated image based on the user input information, and the terminal computing subtask is also used to instruct the terminal to determine the range of the image to be displayed for the display operation based on the user input information.

12. The multi-device collaborative data processing method as described in claim 9, characterized in that, When the target collaboration mode is the image enhancement collaboration mode, the base station computing subtask is used to instruct the base station to render a low-resolution image based on the user input information, and the terminal computing subtask is also used to instruct the terminal to enhance the low-resolution image.

13. The multi-device collaborative data processing method as described in claim 9, characterized in that, When the target collaboration mode is layer overlay collaboration mode The terminal computing subtask is also used to instruct: the terminal to determine the first screen to be rendered and the second screen to be rendered based on the user input information, send the second screen to be rendered to the base station, and render the first screen to be rendered; The base station computing subtask is used to instruct the base station to render the second image to be rendered based on the user input information; The first image to be rendered and the second image to be rendered require different amounts of computing power to be rendered.

14. The multi-device collaborative data processing method as described in claim 9, characterized in that, When the target collaboration mode is a virtual-real overlay collaboration mode, the terminal computing subtask is also used to instruct the terminal to collect the actual image according to the user input information and transmit it to the base station, and the base station computing subtask is used to instruct the base station to render the corresponding rendering entity according to the actual image.

15. A data processing method for multi-device collaboration, characterized in that, Applied to a base station, the method includes: In response to a computing cooperation request sent by a terminal carrying multiple cooperation modes, a target cooperation mode is fed back to the terminal. The target cooperation mode corresponds to the terminal computing subtask and the base station computing subtask. The target cooperation mode is used to instruct the terminal to execute the terminal computing subtask to obtain the terminal computing result. In response to the base station subtask information sent by the terminal according to the target cooperation mode, the base station calculation subtask is executed to obtain the base station calculation result and transmit it to the terminal; The base station calculation result is used to instruct the terminal to perform a display operation based on the terminal calculation result and the base station calculation result.

16. The multi-device collaborative data processing method as described in claim 15, characterized in that, The computing collaboration request includes computing task collaboration requirement information and terminal information, and the computing task collaboration requirement information indicates the multiple collaboration modes; The target collaboration mode is selected by the base station from multiple collaboration modes based on the base station's current available computing power, the computing task collaboration requirements, and the terminal information.

17. The multi-device collaborative data processing method as described in claim 16, characterized in that, The computational task collaboration requirement information is also used to indicate filtering conditions with different priorities; The filtering criteria include at least one of the following: The terminal computing power requirements and base station computing power requirements corresponding to each collaboration mode; The communication requirements for each collaboration mode; The terminal battery life requirements for each collaboration mode.

18. The multi-device collaborative data processing method as described in claim 15, characterized in that, The method further includes: In response to the computing collaboration request, the system reports configuration information. The reporting configuration information is used to indicate the reporting rules, and the reporting content reported by the terminal to the base station is determined by the terminal's current measurement information and the reporting rules.

19. The multi-device collaborative data processing method as described in claim 18, characterized in that, The method further includes: In response to the reported content, at least one of the computing power resource allocation scheme, communication resource allocation scheme, and target cooperation mode is adjusted according to the reported content and fed back to the terminal.

20. The multi-device collaborative data processing method as described in claim 18, characterized in that, The current measurement information of the terminal includes at least one of the following: The end-to-end latency of the computing task measured by the terminal; The computation latency measured by the terminal when the terminal computation subtask is executed; The terminal measures the computational latency when the display operation is executed; The transmission delay achievement rate measured by the terminal based on the base station's calculation results.

21. The multi-device collaborative data processing method as described in claim 15, characterized in that, The base station subtask information carries the execution program of the base station computing subtask, or the address of the execution program of the base station computing subtask.

22. The multi-device collaborative data processing method as described in any one of claims 15-21, characterized in that, Before receiving the computing collaboration request, the method further includes: A computing power task bearer is constructed between the terminal and the terminal, wherein the computing power task bearer includes at least one of the following: bearer identifier, bearer length, drop time, and header compression information.

23. The multi-device collaborative data processing method as described in any one of claims 15-21, characterized in that, The terminal computing subtask is used to instruct the terminal to obtain user input information and send it to the base station.

24. The multi-device collaborative data processing method as described in claim 23, characterized in that, When the target collaboration mode is the base station full rendering mode, the base station calculation subtask is used to instruct the base station to render the entire screen based on the user input information, and the terminal calculation result is used to instruct the terminal to display the entire screen.

25. The multi-device collaborative data processing method as described in claim 23, characterized in that, When the target collaboration mode is the saturation rendering collaboration mode, the base station computing subtask is used to instruct the base station to render a saturated image based on the user input information, and the terminal computing subtask is also used to instruct the terminal to determine the range of the image to be displayed for the display operation based on the user input information.

26. The multi-device collaborative data processing method as described in claim 23, characterized in that, When the target collaboration mode is the image enhancement collaboration mode, the base station computing subtask is used to instruct the base station to render a low-resolution image based on the user input information, and the terminal computing subtask is also used to instruct the terminal to enhance the low-resolution image.

27. The multi-device collaborative data processing method as described in claim 23, characterized in that, When the target collaboration mode is layer overlay collaboration mode The terminal computing subtask is also used to instruct: the terminal to determine the first screen to be rendered and the second screen to be rendered based on the user input information, send the second screen to be rendered to the base station, and render the first screen to be rendered; The base station computing subtask is used to instruct the base station to render the second image to be rendered based on the user input information; The first image to be rendered and the second image to be rendered require different amounts of computing power to be rendered.

28. The multi-device collaborative data processing method as described in claim 23, characterized in that, When the target collaboration mode is a virtual-real overlay collaboration mode, the terminal computing subtask is also used to instruct the terminal to collect the actual image according to the user input information and transmit it to the base station, and the base station computing subtask is used to instruct the base station to render the corresponding rendering entity according to the actual image.

29. A terminal, characterized in that, include: The computational cooperation request sending module is used to send a computational cooperation request carrying multiple cooperation modes to the base station, so that the base station can respond with a target cooperation mode, wherein the target cooperation mode corresponds to the terminal computational subtask and the base station computational subtask. The terminal computing subtask execution module is used to execute the terminal computing subtask and obtain the terminal computing result; The base station subtask information sending module is used to send base station subtask information to the base station according to the target cooperation mode, wherein the base station subtask information is used to instruct the base station to perform the base station calculation subtask, obtain the base station calculation result, and transmit it to the terminal; The display operation execution module is used to perform display operations based on the terminal calculation results and the base station calculation results.

30. A base station, characterized in that, include: The computational collaboration request receiving module is used to respond to a computational collaboration request carrying multiple collaboration modes sent by a terminal, and to feed back a target collaboration mode to the terminal. The target collaboration mode corresponds to a terminal computational subtask and a base station computational subtask. The target collaboration mode is used to instruct the terminal to execute the terminal computational subtask to obtain the terminal computational result. The base station calculation subtask execution module is used to execute the base station calculation subtask in response to the base station subtask information sent by the terminal according to the target cooperation mode, obtain the base station calculation result and transmit it to the terminal; The base station calculation result is used to instruct the terminal to perform a display operation based on the terminal calculation result and the base station calculation result.

31. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the multi-device collaborative data processing method according to any one of claims 1-14, or the multi-device collaborative data processing method according to any one of claims 15-28.

32. A computer program product comprising computer instructions, characterized in that, When the computer instructions are executed by the processor, they implement the multi-device collaborative data processing method according to any one of claims 1-14, or the multi-device collaborative data processing method according to any one of claims 15-28.

33. A computer device, characterized in that, The method includes a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor. When the processor executes the computer program, it implements the multi-device collaborative data processing method according to any one of claims 1-14, or implements the multi-device collaborative data processing method according to any one of claims 15-28.

Images