Information transmission methods, devices, terminals, and network-side equipment

Abstract

The present application discloses an information transmission method, an apparatus, a terminal and a network side equipment, and belongs to the field of communications technology. An information transmission method in an embodiment of the present application includes: a terminal obtains arrival time advance information, the arrival time advance information including an arrival time advance amount of a target image frame, the arrival time advance amount being an advance amount of an actual arrival time of the target image frame relative to a target arrival time; and the terminal transmits the arrival time advance information to a network side equipment.

Description

Technical Field

[0001] (Cross-reference to Related Applications) This application claims the priority of Chinese Patent Application No. 202111467958.8 filed in China on December 03, 2021, and all the contents of the said application are incorporated herein by reference.

[0002] This application belongs to the field of communication technologies, and specifically relates to an information transmission method, apparatus, terminal, and network-side device.

Background Art

[0003] For services with delay requirements, such as Extended Reality (XR) services, the XR services have arriving periodic image frames. For the image frame data transmission model based on a group of pictures (GoP), there are I-frames, P-frames, and B-frames. Here, the data volume of the I-frame is the largest, the data volume of the P-frame is the second largest, and the data volume of the B-frame is the smallest. The I-frame appears periodically, and there are some P-frames and B-frames between two I-frames.

[0004] If there are multiple users transmitting XR services in one cell and the XR services are based on the GoP model, if the time when the I-frames of the XR services of multiple users appear is very close, a very large air interface capacity is required to transmit these I-frames, which may lead to the occurrence of air interface congestion. However, at other times, since there are relatively few I-frames, there may be a situation where the air interface capacity is not fully utilized.

[0005] That is, the utilization of the air interface capacity is not fully effective, and the transmission performance is relatively low.

Summary of the Invention

Problems to be Solved by the Invention

[0006] The embodiments of this application provide an information transmission method, apparatus, terminal, and network-side equipment that can solve the problem in related technologies where the utilization of air interface capacity is not sufficiently effective and transmission performance is relatively low. [Means for solving the problem]

[0007] According to the first aspect, an information transmission method is provided, and this method is, The terminal acquires arrival time advance information, wherein the arrival time advance information includes the arrival time advance amount of the target image frame, and the arrival time advance amount is the advance amount of the actual arrival time of the target image frame relative to the target arrival time. This includes the terminal transmitting arrival time advance information to the network-side device.

[0008] According to the second aspect, an information transmission method is provided, and this method is, The first network-side device receives arrival time advance information transmitted by the terminal, wherein the arrival time advance information includes the arrival time advance amount of the target image frame, and the arrival time advance amount is the advance amount of the actual arrival time of the target image frame relative to the target arrival time. The first network-side device determines the air interface transmission delay budget between the first network-side device and the terminal based on the arrival time advance information, This includes the first network-side device performing image frame transmission based on the air interface transmission delay budget.

[0009] According to a third aspect, an information transmission method is provided, and this method is, The second network-side device receives arrival time advance information transmitted by the terminal, wherein the arrival time advance information includes the arrival time advance amount of the target image frame, and the arrival time advance amount is the advance amount of the actual arrival time of the target image frame relative to the target arrival time. The second network-side device, based on the arrival time advance information, Determine the air interface transmission delay budget between the first network-side device and the terminal, and transmit the air interface transmission delay budget to the first network-side device. This includes performing at least one of the following operations: transmitting the arrival time advance information to the first network-side device.

[0010] According to the fourth aspect, an information transmission device is provided, and this device is An acquisition module for obtaining arrival time advance information, wherein the arrival time advance information includes the arrival time advance amount of the target image frame, and the arrival time advance amount is the advance amount of the actual arrival time of the target image frame relative to the target arrival time. It includes a transmission module for sending arrival time advance information to network-side devices.

[0011] According to the fifth aspect, an information transmission device is provided, and this device is A transmission module for receiving arrival time advance information transmitted by a terminal, wherein the arrival time advance information includes an arrival time advance amount for a target image frame, and the arrival time advance amount is an advance amount of the actual arrival time of the target image frame relative to the target arrival time; The system includes a determination module for determining the air interface transmission delay budget between the first network-side equipment and the terminal based on the aforementioned arrival time advance information, The transmission module is further used to perform image frame transmission based on the air interface transmission delay budget.

[0012] According to the sixth aspect, an information transmission device is provided, and this device is A receiving module for receiving arrival time advance information transmitted by a terminal, wherein the arrival time advance information includes an arrival time advance amount for a target image frame, and the arrival time advance amount is an advance amount of the actual arrival time of the target image frame relative to the target arrival time; Based on the aforementioned arrival time advance information, Determine the air interface transmission delay budget between the first network-side device and the terminal, and transmit the air interface transmission delay budget to the first network-side device. The system includes an executable module for performing at least one of the following operations: transmitting the aforementioned arrival time advance information to the first network-side device.

[0013] According to the seventh aspect, a terminal is provided, which includes a processor and memory, the memory storing a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the method according to the first aspect are realized.

[0014] According to the eighth aspect, a terminal is provided, which includes a processor and a communication interface, wherein the processor is used to acquire arrival time advance information, the arrival time advance information includes an arrival time advance amount of a target image frame, the arrival time advance amount is an advance amount of the actual arrival time of the target image frame relative to the target arrival time, and the communication interface is used to transmit the arrival time advance information to network-side equipment.

[0015] According to the ninth aspect, a network-side device is provided, which includes a processor and memory, the memory storing a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, a step of the method according to the second or third aspect is realized.

[0016] According to the tenth aspect, a network-side device is provided, which includes a processor and a communication interface, wherein the communication interface is used to receive arrival time advance information transmitted by a terminal, the arrival time advance information includes an arrival time advance amount of a target image frame, the arrival time advance amount is an advance amount of the actual arrival time of the target image frame relative to the target arrival time, and to perform image frame transmission based on the air interface transmission delay budget. The processor is used to determine the air interface transmission delay budget between the first network-side device and the terminal based on the arrival time advance information.

[0017] According to the eleventh aspect, a network-side device is provided, which includes a processor and a communication interface, wherein the communication interface is used to receive arrival time advance information transmitted by a terminal, the arrival time advance information includes an arrival time advance amount for a target image frame, the arrival time advance amount is an advance amount of the actual arrival time of the target image frame relative to the target arrival time. Based on the arrival time advance information, the processor Determine the air interface transmission delay budget between the first network-side device and the terminal, and transmit the air interface transmission delay budget to the first network-side device. It is used to perform at least one of the operations of transmitting the arrival time advance information to the first network-side device.

[0018] According to a twelfth aspect, a communication system is provided. The communication system includes a terminal and a network-side device. The terminal may be used to execute the steps of the information transmission method described in the first aspect, and the network-side device may be used to execute the steps of the information transmission method described in the second or third aspect.

[0019] According to a thirteenth aspect, a readable storage medium is provided. The readable storage medium stores a program or instructions. When the program or instructions are executed by a processor, the steps of the method described in the first, second, or third aspect are realized.

[0020] According to a fourteenth aspect, a chip is provided. The chip includes a processor and a communication interface. The communication interface is coupled to the processor. The processor runs a program or instructions and is used to realize the steps of the method described in the first, second, or third aspect.

[0021] According to a fifteenth aspect, a computer program product is provided. The computer program product is stored in a storage medium. When the computer program product is executed by at least one processor, the steps of the information transmission method described in the first, second, or third aspect are realized.

Advantages of the Invention

[0022] In the embodiments of this application, the terminal acquires arrival time advance information, which includes an arrival time advance amount for a target image frame, where the arrival time advance amount is an advance amount of the actual arrival time of the target image frame relative to the target arrival time, and the terminal transmits the arrival time advance information to the network-side equipment. Since the network-side equipment can determine the air interface transmission delay budget based on the arrival time advance information transmitted by the terminal, the network-side equipment can flexibly adjust the transmission time of the image frame within the air interface transmission delay budget. For example, the network-side equipment can flexibly adjust the transmission time of the image frame for different users within the air interface transmission delay budget by comprehensively considering the actual transmission delay requirements of the image frame for different users on the air interface and the actual load on the air interface, thereby smoothing the air interface transmission rate demand and improving the efficiency of link self-adaptation, thereby improving transmission performance. [Brief explanation of the drawing]

[0023] [Figure 1] This is a structural diagram of a network system according to an embodiment of this application. [Figure 2a] This is a schematic diagram of the network structure for transmitting XR service data between the terminal and the content server. [Figure 2b] This is a schematic diagram of the network structure for XR service data transmission between two terminals. [Figure 3] This is one of the flowcharts for the information transmission method according to the embodiment of this application. [Figure 4] This is a probability density distribution function diagram according to an embodiment of this application. [Figure 5] This is a structural diagram of the modem, application layer, and adaptation layer of a terminal according to an embodiment of this application. [Figure 6] This is the second flowchart of the information transmission method according to the embodiment of this application. [Figure 7a]This is the third flowchart of the information transmission method according to the embodiment of this application. [Figure 7b] This is a schematic diagram showing the arrival times of XR service I-frames for multiple terminals. [Figure 7c] This is a schematic diagram showing the arrival times of XR service I frames for multiple terminals after adjusting the air interface transmission delay budget according to an embodiment of this application. [Figure 8] This is the fourth flowchart of the information transmission method according to the embodiment of this application. [Figure 9] This is a structural diagram of the first information transmission device according to an embodiment of the present application. [Figure 10] This is a structural diagram of a second information transmission device according to an embodiment of the present application. [Figure 11] This is a structural diagram of a third information transmission device according to an embodiment of the present application. [Figure 12] This is a structural diagram of a communication device according to an embodiment of this application. [Figure 13] This is a structural diagram of a terminal according to an embodiment of this application. [Figure 14] This is one of the structural diagrams of the network-side equipment according to the embodiment of this application. [Figure 15] This is the second structural diagram of the network-side equipment according to the embodiment of this application. [Modes for carrying out the invention]

[0024] The following clearly describes the technical concepts in the embodiments of this application, linking them to the drawings of the embodiments. Clearly, the embodiments described are only some, not all, embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are all within the scope of protection of this application.

[0025] The terms "first," "second," etc., used in the specification and claims of this application are intended to distinguish similar subjects and not to describe a specific order or sequence. It should be understood that these terms are interchangeable where appropriate, so that the embodiments of this application may be carried out in an order other than those illustrated or described herein, and that the subjects distinguished by "first" and "second" are generally of the same kind and do not limit the number of subjects; for example, the first subject may be one or more. Furthermore, "and / or" in the specification and claims indicates at least one of the connected subjects, and the letter " / " generally indicates that the preceding and succeeding related subjects are in an "or" relationship.

[0026] It should be noted that the technologies described in the embodiments of this application are not limited to Long Term Evolution (LTE) / LTE-Advanced (LTE-A) systems, but are also applicable to other wireless communication systems, such as Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Frequency Division Multiple Access (FDMA), Orthogonal Frequency Division Multiple Access (OFDMA), Single-carrier Frequency Division Multiple Access (SC-FDMA), and other systems. The terms "system" and "network" in the embodiments of this application are always used interchangeably, and the technologies described may be applied to the systems and radio technologies mentioned above, or to other systems and radio technologies. The following description illustrates a New Radio (NR) system and uses NR terminology in most of the following descriptions; however, these technologies may also be applied to applications other than NR systems, such as 6th Generation (6G) communication systems.

[0027] Figure 1 shows a block diagram of a wireless communication system to which an embodiment of this application can be applied. The wireless communication system includes a terminal 11 and a network-side device 12. Here, the terminal 11 is a mobile phone, tablet personal computer, laptop computer (or notebook computer), personal digital assistant (PDA), palmtop computer, netbook, ultra-mobile personal computer (UMPC), mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, vehicle user equipment (VUE), pedestrian user equipment (PUE), smart home (home appliances with wireless communication capabilities, such as refrigerators, televisions, washing machines or furniture), game console, personal computer (personal The terminal-side equipment may be a computer (PC), a teller machine or self-service machine, and the wearable device includes smartwatches, smart bracelets, smart earphones, smart glasses, smart accessories (smart bracelets, smart hand chains, smart rings, smart necklaces, smart ankle bracelets, smart anklets, etc.), smart bands, smart clothing, etc. It should be noted that the embodiments of this application do not limit the specific type of terminal 11. The network-side equipment 12 may include access network equipment or core network equipment, where access network equipment 12 may be called radio access network equipment, radio access network (RAN), radio access network function or radio access network unit.The access network equipment 12 may include base stations, Wireless Local Area Networks (WLAN) access points, or WiFi nodes, and base stations may also be called node B, evolving node B (eNB), access point, base transceiver station (BTS), radio base station, radio transceiver, basic service set (BSS), extended service set (ESS), home B node, home evolving B node, transmission receiving point (TRP), or any other appropriate term in the art, and as long as the same technical effect is achieved, the base station is not limited to any particular technical term. For the purposes of this explanation, only base stations in NR systems are given as examples in the embodiments of this application, and the specific types of base stations are not limited.

[0028] To better understand the embodiments described in this application, the following is a brief introduction to the content related to the augmented reality (eXtended Reality, XR) service.

[0029] XR services include Augmented Reality (AR) services, Virtual Reality (VR) services, and Mixed AR and VR (MR) services. XR services employ H.264 encoding technology to achieve image data compression, thereby saving traffic and ensuring image quality. H.264 technology can encode image data into three types of image frames.

[0030] An intra-coded picture (I) frame is a complete image frame that can generate and present an image independently of other frames. A predicted picture (P) frame contains only image change information relative to the previous frame. The receiving end must generate the current frame by associating it with the previous frame and complete the display at the receiving terminal. Bidirectional predicted picture (B) frames are used to indicate changes in the current frame relative to the previous and subsequent frames, and the receiver needs to generate the current frame by associating it with the previous and subsequent frames.

[0031] The preceding and succeeding frames mentioned above are ordered by the frame presentation time or the image acquisition time at the source end. Actual transmission and reception times may be adjusted according to the image decoding time at the receiving end. For example, the sender can transmit according to the image frame decoding time order at the receiving end.

[0032] Different frame types correspond to different frame encoding methods, resulting in different degrees of image compression. Here, I-frames have a relatively low degree of compression (i.e., the largest amount of frame data), P-frames have a moderate degree of compression (i.e., a moderate amount of frame data), and B-frames have the highest degree of compression (i.e., the smallest amount of frame data).

[0033] There are two transmission methods for XR images: one based on frame slice combinations and another based on group of pictures (GoP).

[0034] A transmission method based on frame slice combination: This method cuts a single image frame into multiple data blocks, distributes these cut blocks from multiple image frames, and combines them as multiple data blocks for transmission, achieving the goal of smoothing XR service data stream traffic. This method significantly reduces traffic fluctuations due to differences in data volume between I-frames, P-frames, and B-frames, but increases the transmission delay of image frames due to cross-transmission between image frames. Frame set-based transmission method: Based on the periodic characteristics of the video stream, the video is divided into video frame combinations according to the period of the I-frames. All P-frames and B-frames between one I-frame and the next adjacent I-frame constitute one frame combination. Image frames are transmitted and played back at the receiving end in frame period, and the time interval between the arrival times of adjacent image frames is one frame period. The frame set-based transmission method avoids mixed transmission between image frames and transmits generated image frames in a timely manner. However, because the degree of compression differs between I-frames, P-frames, and B-frames, it can lead to fluctuations in the frame data rate.

[0035] Regarding the data transmission of XR service data over an NR network, Figures 2a and 2b illustrate the data transmission of XR service data over a wireless network. Here, Figure 2a shows that the UE obtains XR service data from the content server via the wireless network through the UE's modem. Figure 2b shows the transmission of XR service data between two terminals. The UE's modem and the base station execute the wireless transmission protocol to complete the XR service data transmission.

[0036] In the following sections, the information transmission method according to the embodiments of this application will be described in detail with reference to several embodiments and their application scenarios, accompanied by drawings.

[0037] Referring to Figure 3, Figure 3 is a flowchart of an information transmission method according to an embodiment of this application, and this information transmission method includes the following steps.

[0038] Step 301, the terminal acquires arrival time advance information, which includes an arrival time advance amount for the target image frame, where the arrival time advance amount is the advance amount of the actual arrival time of the target image frame relative to the target arrival time.

[0039] Step 302, the terminal transmits arrival time advance information to the network-side device.

[0040] After receiving arrival time advance information, the network-side equipment determines the air interface transmission delay budget based on the arrival time advance information, schedules the transmission of image frames based on the air interface transmission delay budget, and transmits the image frames. The air interface transmission delay budget includes the transmission delay budget for the uplink and / or downlink.

[0041] In this embodiment, the terminal acquires arrival time advance information, which includes an arrival time advance amount for the target image frame, where the arrival time advance amount is an advance amount of the actual arrival time of the target image frame relative to the target arrival time, and the terminal transmits the arrival time advance information to the network-side equipment. Since the network-side equipment can determine the air interface transmission delay budget based on the arrival time advance information transmitted by the terminal, when the time advance amount indicated by the arrival time advance information is a positive value, the network-side equipment can increase the delay budget for air interface transmission, that is, the network-side equipment can flexibly adjust the transmission time of the image frame within a longer air interface transmission delay budget. For example, the network-side equipment can flexibly adjust the transmission time of the image frame for different users within a longer air interface transmission delay budget by comprehensively considering the actual transmission delay requirements on the air interface for different users' image frames and the actual load on the air interface, thereby smoothing the air interface transmission rate demand and improving the efficiency of link self-adaptation, thereby improving transmission performance.

[0042] In the above, the network-side equipment may be a base station or a core network. If the network-side equipment is a base station, the base station may determine the air interface transmission delay budget between the base station and the terminal. If the network-side equipment is a core network, the core network may determine the air interface transmission delay budget between the base station and the terminal. For example, the core network may configure the base station's air interface uplink or downlink transmission delay budget.

[0043] In the network structure shown in Figure 2a, the transmitted information may pass through only one air interface network, and the core network may configure the base station's air interface uplink and downlink delay budget based on the received arrival time advance information. In the network structure shown in Figure 2b, the transmitted information may pass through one air interface network transmission at each end of the core network, and the core network may configure either one base station or both base stations to update the air interface transmission delay budget based on the received arrival time advance information. This method can help reinforce the core network's end-to-end delay management function.

[0044] In the above, the actual arrival time is The time of the last data packet received when the terminal receives the data packet included in the target image frame, This includes one of the following: the time the terminal analyzes the data packets contained in the target image frame to obtain the target image frame (for example, the time the application layer of the terminal analyzes (which may be understood as recovered) to obtain the target image frame).

[0045] In the above, the target arrival time is The target playback time of the target image frame is the time during which the target image frame is actually played or is scheduled to be played, and The latest arrival time that does not affect the playback of the aforementioned target image frame, The time at which the latest arrival time that does not affect the playback of the target image frame is offset by the first offset time, This includes one of the following: a time that is offset by a second offset time earlier with respect to the target playback time of the target image frame.

[0046] The first offset time and the second offset time may be set according to the actual circumstances.

[0047] In the above, the arrival time advance amount includes the arrival time advance amounts for the I frame, the P frame, and the B frame, respectively, or the arrival time advance amount of the target image frame obtained when the I frame, P frame, and B frame are not distinguished, where the target image frame includes the I frame, the P frame, and the B frame.

[0048] The aforementioned arrival time advance information further includes at least one of the following:

[0049] (1) First determination method information and first instruction information, wherein the first determination method information includes a first determination method and / or an identifier for the first determination method, the first instruction information is used to indicate the parameters of the first determination method, and the first determination method is used to determine the actual arrival time of the target image frame.

[0050] The first determination method may be a method for determining the actual arrival time of a target image frame, the identifier of the first determination method may be the name or identifier (ID) of the first determination method, and the arrival time advance information includes first determination method information that can inform network-side equipment of how the terminal determines the actual arrival time of the target image frame.

[0051] For example, if one or more first determination methods are preconfigured, and each of these one or more first determination methods is associated with an identifier, the identifier may be a method name, an ID, etc., then the first determination method information may include the first determination method and may include the identifier corresponding to the first determination method. Furthermore, the arrival time advance information may further include first instruction information, and the first instruction information is used to indicate the parameters or parameter values ​​of the first determination method.

[0052] (2) Second determination method information including a second determination method and / or an identifier for the second determination method, wherein the second determination method is used to determine the arrival time advance amount of the target image frame.

[0053] The second determination method may be a method for determining the amount of arrival time advance for the target image frame, the identifier of the second determination method may be the name or ID of the second determination method, and the arrival time advance information includes second determination method information that can inform network-side equipment of how the terminal determines the amount of arrival time advance for the target image frame.

[0054] For example, if one or more second determination methods are pre-configured, and each of these one or more second determination methods is associated with an identifier, and the identifier may be a method name, an ID, etc., then the second determination method information may include the second determination method and may also include the identifier corresponding to the second determination method.

[0055] In one embodiment of the present application, the target image frame comprises at least one image frame, and the arrival time advance amount of the target image frame is determined based on the arrival time advance amount of each image frame among the at least one image frame.

[0056] Specifically, the arrival time advance amount is obtained by reserving a first preset time in the first advance amount, and the first advance amount is obtained by calculating based on the arrival time advance amount of each image frame among the at least one image frame. Reserving a first preset time in the first advance amount may be understood as adding a first preset time to the first advance amount, and the first preset time may be set according to the actual circumstances, but is not limited herein. The first preset time may be determined autonomously by the terminal or configured by network-side equipment.

[0057] For the sake of clarity, any one of the at least one image frame is referred to as the first image frame, and the arrival time advance amount for the first image frame is obtained by subtracting the actual arrival time of the first image frame from the target arrival time of the first image frame. Based on the above method, the arrival time advance amount for each of the at least one image frame is obtained. For example, if there are 20 image frames, 20 arrival time advance amounts can be obtained based on these 20 image frames, and these arrival time advance amounts may be the same or different. Furthermore, a cumulative distribution function (CDF) of these arrival time advance amounts is obtained based on the arrival time advance amount of each image frame, that is, the cumulative distribution function is determined based on the arrival time advance amount of each image frame. Figure 4 shows the cumulative distribution function obtained based on the arrival time advance amount of each image frame, where the arrival time advance amount of the target image frame is the arrival time advance amount corresponding to the percentile X predetermined in the cumulative distribution function, where X may be determined autonomously by the terminal or configured by the network-side equipment.

[0058] Furthermore, in addition to determining the arrival time advance amount of the target image frame based on the cumulative distribution function of the arrival time advance amount described above, the terminal may obtain the advance amount by other means, and is not limited thereto.

[0059] In the above, the method for transmitting the arrival time advance information is: The transmission method includes at least one of periodic transmission, trigger condition-based transmission, and request-based transmission. The transmission method may be configured by network-side equipment. The transmission method may be reported using Uplink Control Information (UCI), Media Access Control Element (MAC CE), or RRC signaling.

[0060] Periodic transmission may also be called a periodic trigger scheme, in which the transmission period and offset are configured by network-side equipment and may consist of one of the following: RRC, MAC CE, and Physical Downlink Control Channel (PDCCH), or a combination of multiple signaling methods. Transmission based on trigger conditions may also be called event-triggered reporting, and may be configured by network-side equipment based on RRC signaling, and the trigger conditions are (1) The arrival time advance amount of the target image frame exceeds a first preset threshold, (2) The arrival time advance amount of the target image frame falls below a second preset threshold, (3) The increase exceeds a third preset threshold, wherein the increase is the increase in the arrival time advance amount of the target image frame relative to the arrival time advance amount previously transmitted to the network-side device. (4) The amount of reduction exceeds a fourth preset threshold, wherein the amount of reduction is the amount of the arrival time advance of the target image frame compared to the arrival time advance previously transmitted to the network-side device. (5) The arrival time advance amount of the target image frame is a negative value, (6) The terminal has switched to another cell, (7) The terminal has experienced a wireless link failure and has successfully restored the wireless link, which includes at least one of these.

[0061] If at least one of the trigger conditions is met, the terminal transmits the arrival time advance information to the network-side device.

[0062] In the above, a request-based transmission may be understood as a transmission based on a query from a network-side device, where the network-side device issues query information (carried by RRC or MAC CE), and the terminal, after receiving the query information, obtains arrival time advance information and transmits it to the network-side device.

[0063] Specifically, before the terminal transmits arrival time advance information to the network-side device, the method: The terminal receives request information transmitted by the network-side equipment via the terminal's modem, requesting the terminal to transmit the arrival time advance information. The terminal further includes obtaining the arrival time advance information via the application layer of the terminal.

[0064] In the above, the terminal includes a modem and an application layer, the terminal receives request information (i.e., query information) via the modem (e.g., the modem's wireless protocol layer), the terminal obtains arrival time advance information for the target image frame from the application layer (which may also be called the XR application layer), the terminal transmits the arrival time advance information to the network-side equipment via the modem, specifically, the terminal transmits the arrival time advance information to the network-side equipment via the terminal's modem.

[0065] The terminal further includes an adaptation layer located between the application layer and the modem, the adaptation layer being used to rewrite information from the modem into a format parseable by the application layer, and / or to rewrite information from the application layer into a format parseable by the modem.

[0066] The adaptation layer is located in the terminal's operating system or between the terminal's modem and the terminal's application layer. The terminal may further include an application control layer, which is used to rewrite request information from the terminal's modem into a format parseable by the terminal's application layer, and / or to rewrite arrival time advance information from the terminal's application layer into a format parseable by the terminal's modem. Furthermore, the terminal's modem includes an RRC layer, and the application control layer is located between the RRC layer and the adaptation layer.

[0067] Figure 5 shows the structural relationship between the terminal modem, the application layer, and the adaptation layer. As shown in Figure 5, the Radio Resource Control (RRC) layer (hereinafter referred to as the radio protocol layer) of the terminal modem and the upper layer application layer cannot interact with each other using existing protocols. An adaptation layer may be added between them, and the adaptation layer may be located in the terminal's operating system or may be a sublayer of the application layer or radio protocol layer. The function of the adaptation layer is to rewrite request information or configuration messages sent from the RRC layer to the application layer for requesting arrival time advance information into a format that can be parsed by the application layer, and to interpret the arrival time advance information sent from the application layer to the RRC layer in a format that can be parsed by the RRC layer. Selectively, the adaptation layer provides several functions for access by the application layer and the RRC layer, the application layer calls these functions to obtain request information or configuration messages from the RRC layer, or to send image frame arrival time advance information to the RRC layer, and the RRC layer calls several functions to send request information or configuration messages to the application layer, or to obtain image frame arrival time advance information from the application layer.

[0068] Figure 5 shows an example of a protocol layer structure of a terminal including the adaptation layer, where the RRC layer is used to handle interactions with the application layer. Furthermore, an additional application control (APP Control) layer can be introduced on top of the RRC layer, and this application control layer is used as a sub-layer of layer 3 to handle interactions with the application layer.

[0069] In Figure 5, Layer 1 includes the Physical Layer (PHY), Layer 2 includes Radio Link Control (RLC), Packet Data Convergence Protocol (PDCP), and Service Data Adaptation Protocol (SDAP), and Layer 3 includes RRC1, RRC2, Non-Access Stratum (NAS), and Adaptation Layer.

[0070] In one embodiment of this application, the arrival time advance information is The processing delay budget of the application layer of the aforementioned terminal, The processing delay budget of the modem of the aforementioned terminal, This further includes at least one of the following: an end-to-end processing delay budget determined based on the application layer of the terminal meeting quality of service requirements.

[0071] Referring to Figure 6, Figure 6 is a flowchart of an information transmission method according to an embodiment of the present application, which includes the following steps.

[0072] Step 601, the first network-side device receives arrival time advance information transmitted by the terminal, the arrival time advance information includes an arrival time advance amount for the target image frame, the arrival time advance amount is the advance amount of the actual arrival time of the target image frame relative to the target arrival time.

[0073] Step 602, the first network-side device determines an air interface transmission delay budget between the first network-side device and the terminal based on the arrival time advance information. For example, the new air interface transmission delay budget is a function of the current air interface transmission delay budget and the arrival time advance amount. When the arrival time advance amount is positive, the network-side device may extend the air interface transmission delay budget. Conversely, when the arrival time advance amount is negative, the network-side device may decrease its own delay budget.

[0074] Step 603, the first network-side device transmits image frames based on the air interface transmission delay budget.

[0075] After receiving arrival time advance information, the network-side equipment determines the air interface transmission delay budget based on the arrival time advance information, schedules the transmission of image frames based on the air interface transmission delay budget, and transmits the image frames. The air interface transmission delay budget includes the transmission delay budgets for the uplink and downlink.

[0076] In this embodiment, the first network-side device receives arrival time advance information transmitted by the terminal, the arrival time advance information includes an arrival time advance amount for the target image frame, the arrival time advance amount is an advance amount of the actual arrival time of the target image frame relative to the target arrival time, the first network-side device determines an air interface transmission delay budget between the first network-side device and the terminal based on the arrival time advance information, and the first network-side device transmits the image frame based on the air interface transmission delay budget. Since network-side equipment can determine the air interface transmission delay budget based on arrival time advance information transmitted by the terminal, when the time advance amount indicated by the arrival time advance information is a positive value, network-side equipment can increase the air interface transmission delay budget, and can flexibly adjust the transmission time of image frames within a longer air interface transmission delay budget. For example, network-side equipment can flexibly adjust the transmission time of image frames for different users within the air interface transmission delay budget by comprehensively considering the actual transmission delay requests of image frames for different users on the air interface and the actual load on the air interface at different times, thereby smoothing the air interface transmission rate demand and improving the efficiency of link self-adaptation, and thus improving transmission performance.

[0077] In the above, the actual arrival time is The time of the last data packet received when the terminal receives the data packet included in the target image frame, This includes one of the following times: the time during which the terminal analyzes the data packets contained in the target image frame to obtain the target image frame.

[0078] In the above, the target arrival time is The target playback time of the target image frame is the time during which the target image frame is actually played or is scheduled to be played, and The latest arrival time that does not affect the playback of the aforementioned target image frame, The time at which the latest arrival time that does not affect the playback of the target image frame is offset by the first offset time, This includes one of the following: a time that is offset by a second offset time earlier with respect to the target playback time of the target image frame.

[0079] In the above, the arrival time advance amount includes the arrival time advance amounts of the intra-encoded I frame, the forward prediction P frame and the bidirectional prediction B frame, respectively, or the arrival time advance amount of the target image frame obtained when the I frame, P frame and B frame are not distinguished, where the target image frame includes the I frame, the P frame and the B frame.

[0080] In the above, the arrival time advance information is, First determination method information and first instruction information, wherein the first determination method information includes a first determination method and / or an identifier for the first determination method, the first instruction information is used to indicate the parameters of the first determination method, and the first determination method is used to determine the actual arrival time of the target image frame, The system further includes at least one of a second determination method and / or second determination method information including an identifier for the second determination method, wherein the second determination method is used to determine the arrival time advance amount of the target image frame.

[0081] The method by which the terminal transmits the arrival time advance information may be based on at least one of periodic transmission, trigger condition-based transmission, and request-based transmission. Request-based transmission may be understood as transmission based on request information transmitted by a first network-side device. That is, before the first network-side device receives the arrival time advance information transmitted by the terminal, the method The first network-side device further includes transmitting request information to the terminal for requesting the arrival time advance information.

[0082] In the above, the arrival time advance information is, The processing delay budget of the application layer of the aforementioned terminal, The processing delay budget of the modem of the aforementioned terminal, This further includes at least one of the following: an end-to-end processing delay budget determined based on the application layer of the terminal meeting quality of service requirements.

[0083] In the following, we will explain the information transmission method according to this application using an XR image frame as an example. Figure 7a shows an information interaction flowchart between a terminal and a base station, where, Step 701, the base station requests the terminal to report the amount of arrival time advance relative to the target arrival time for the actual arrival time of the XR image frame. Step 702, the wireless protocol layer of the terminal's modem obtains the arrival time advance amount of the XR image frame from the terminal's XR application layer after receiving the request. Step 703, the terminal reports the arrival time advance amount of the XR image frame to the base station via the modem's radio protocol layer. Step 704, the base station adjusts the air interface transmission delay budget at the air interface of the XR image frame based on the arrival time advance amount of the received XR image frame. Step 705, the base station and terminal transmit XR image frames over the air interface based on the new air interface transmission delay budget.

[0084] Figure 7b shows a schematic diagram of I-frame arrival times for a multi-user XR service, and Figure 7c shows a schematic diagram of I-frame arrival times after adjusting the air interface transmission delay budget by employing the method according to the present invention. UE1, UE2, and UE3 are three terminals in one cell, and each GoP contains 12 frames, each containing one I-frame and 11 P-frames or B-frames. In Figure 7b, due to the randomness of service occurrence, the appearance times of the I-frames of the three UEs are close together, resulting in a high density of I-frames within a small time window in this cell. For example, in the time window shown as number A, an extremely high rate is required to meet the transmission delay requirement, and the cell may not be able to provide a rate sufficient to meet the transmission quality (e.g., delay requirement) of these I-frames. In the time window shown as number B, the proportion of I-frames is relatively low, but the proportion of P-frames or B-frames is relatively high, resulting in a relatively low total rate in demand, and the rate that the system can provide is clearly higher than this total rate demand, resulting in insufficient cell capacity utilization.

[0085] As can be seen from Figures 7b and 7c, the transmission delay budget for image frames of the XR service can be increased, with the time window shown as C being larger than the time window shown as A, and the time window shown as D being smaller than the time window shown as B. By adjusting the transmission delay budget for image frames of the XR service, the base station can flexibly adjust the transmission time of image frames for different users by comprehensively considering the actual transmission delay requirements of the XR image frames on the air interface and the actual load on the air interface, thereby smoothing the XR service data rate. The method according to this application can satisfy the XR service data transmission delay while simultaneously improving the capacity of the network's XR service.

[0086] Referring to Figure 8, Figure 8 is a flowchart of an information transmission method according to an embodiment of this application, and this information transmission method includes the following steps.

[0087] Step 801, the second network-side device receives arrival time advance information transmitted by the terminal, the arrival time advance information includes an arrival time advance amount for the target image frame, the arrival time advance amount is the advance amount of the actual arrival time of the target image frame relative to the target arrival time.

[0088] The second network-side device may also be part of the core network.

[0089] Step 802, The second network-side device, based on the arrival time advance information, (1) Determine the air interface transmission delay budget between the first network-side device and the terminal, and transmit the air interface transmission delay budget to the first network-side device, (2) Perform at least one of the following operations: transmit the arrival time advance information to the first network-side device.

[0090] The first network-side device may be a base station, the second network-side device may determine the air interface transmission delay budget between the first network-side device and the terminal based on arrival time advance information, and the second network-side device may transmit the arrival time advance information to the first network-side device, and the first network-side device may determine the air interface transmission delay budget between the first network-side device and the terminal.

[0091] In this embodiment, the second network-side device receives arrival time advance information transmitted by the terminal, the arrival time advance information includes an arrival time advance amount for the target image frame, the arrival time advance amount is an advance amount of the actual arrival time of the target image frame relative to the target arrival time, and the second network-side device determines the air interface transmission delay budget between the first network-side device and the terminal based on the arrival time advance information and performs at least one of the following operations: transmitting the air interface transmission delay budget to the first network-side device, or transmitting the arrival time advance information to the first network-side device. Because the second network-side device can determine the air interface transmission delay budget between the first network-side device and the terminal based on the arrival time advance information transmitted by the terminal, the first network-side device can improve transmission performance by flexibly adjusting the information transmission time within the air interface transmission delay budget, smoothing the air interface transmission rate demand, and improving the efficiency of link self-adaptation.

[0092] In the above, the actual arrival time is The time of the last data packet received when the terminal receives the data packet included in the target image frame, This includes one of the following times: the time during which the terminal analyzes the data packets contained in the target image frame to obtain the target image frame.

[0093] In the above, the target arrival time is The target playback time of the target image frame is the time during which the target image frame is actually played or is scheduled to be played, and The latest arrival time that does not affect the playback of the aforementioned target image frame, The time at which the latest arrival time that does not affect the playback of the target image frame is offset by the first offset time, This includes one of the following: a time that is offset by a second offset time earlier with respect to the target playback time of the target image frame.

[0094] In the above, the arrival time advance amount includes the arrival time advance amounts of the intra-encoded I frame, the forward prediction P frame and the bidirectional prediction B frame, respectively, or the arrival time advance amount of the target image frame obtained when the I frame, P frame and B frame are not distinguished, where the target image frame includes the I frame, the P frame and the B frame.

[0095] In the above, the arrival time advance information is, First determination method information and first instruction information, wherein the first determination method information includes a first determination method and / or an identifier for the first determination method, the first instruction information is used to indicate the parameters of the first determination method, and the first determination method is used to determine the actual arrival time of the target image frame, The system further includes at least one of a second determination method and / or second determination method information including an identifier for the second determination method, wherein the second determination method is used to determine the arrival time advance amount of the target image frame.

[0096] In the above, the arrival time advance information is, The processing delay budget of the application layer of the aforementioned terminal, The processing delay budget of the modem of the aforementioned terminal, This further includes at least one of the following: an end-to-end processing delay budget determined based on the application layer of the terminal meeting quality of service requirements.

[0097] In the above configuration, the core network or base station may configure the terminal to transmit the arrival time advance information to the core network via the NAS, and after receiving the arrival time advance information, the core network adjusts the delay budget of the air interface through which the XR image frame data has passed (which may be constant, increasing, or decreasing) based on the arrival time advance information.

[0098] In the network structure shown in Figure 2a, the transmitted information may pass through only one air interface network, and the core network may configure the base station's air interface uplink and downlink delay budget based on the received arrival time advance information. In the network structure shown in Figure 2b, the transmitted information may pass through one air interface network transmission at each end of the core network, and the core network may configure either one base station or both base stations to update the air interface transmission delay budget based on the received arrival time advance information. This method can help reinforce the core network's end-to-end delay management function.

[0099] In the information transmission method shown in Figure 3 of this application, the execution unit may be the first information transmission device 900. In the embodiment of this application, the apparatus of the information transmission method according to the embodiment of Figure 3 of this application will be described using the execution of the information transmission method by the first information transmission device as an example.

[0100] As shown in Figure 9, the embodiment of this application provides a first information transmission device 900, A first acquisition module 901 for acquiring arrival time advance information, wherein the arrival time advance information includes an arrival time advance amount of a target image frame, and the arrival time advance amount is the advance amount of the actual arrival time of the target image frame relative to the target arrival time. It includes a transmission module 902 for sending arrival time advance information to network-side devices.

[0101] Furthermore, the actual arrival time was The time of the last data packet received when the terminal receives the data packet included in the target image frame, This includes one of the following times: the time during which the terminal analyzes the data packets contained in the target image frame to obtain the target image frame.

[0102] Furthermore, the target arrival time is The target playback time of the target image frame is the time during which the target image frame is actually played or is scheduled to be played, and The latest arrival time that does not affect the playback of the aforementioned target image frame, The time at which the latest arrival time that does not affect the playback of the target image frame is offset by the first offset time, This includes one of the following: a time that is offset by a second offset time earlier with respect to the target playback time of the target image frame.

[0103] Furthermore, the arrival time advance amount includes the arrival time advance amounts for the intra-encoded I-frame, the forward-predicted P-frame and the bidirectional-predicted B-frame, respectively, or the arrival time advance amount for the target image frame obtained when the I-frame, P-frame and B-frame are not distinguished, where the target image frame includes the I-frame, the P-frame and the B-frame.

[0104] Furthermore, the aforementioned arrival time advance information is, First determination method information and first instruction information, wherein the first determination method information includes a first determination method and / or an identifier for the first determination method, the first instruction information is used to indicate the parameters of the first determination method, and the first determination method is used to determine the actual arrival time of the target image frame, The system further includes at least one of a second determination method and / or second determination method information including an identifier for the second determination method, wherein the second determination method is used to determine the arrival time advance amount of the target image frame.

[0105] Furthermore, the target image frame includes at least one image frame, and the arrival time advance amount is determined based on the arrival time advance amount of each image frame among the at least one image frame.

[0106] Furthermore, the arrival time advance amount is obtained by reserving a first preset time in the first advance amount, and the first advance amount is obtained by calculating based on the arrival time advance amount of each image frame among the at least one image frame.

[0107] Furthermore, the arrival time advance amount is the arrival time advance amount corresponding to a predetermined percentile in the cumulative distribution function curve, where the cumulative distribution function curve represents the cumulative probability distribution of the arrival time advance amount for each image frame among the plurality of image frames.

[0108] Furthermore, the device 900 is A receiving module for receiving request information transmitted by the network-side equipment via the terminal's modem, which requests the terminal to transmit the arrival time advance information, The system further includes a second acquisition module for obtaining the arrival time advance information via the application layer of the terminal.

[0109] Furthermore, the terminal further includes an adaptation layer located between the application layer and the modem, the adaptation layer being used to rewrite the request information from the modem into a format parseable by the application layer, and / or to rewrite the arrival time advance information from the application layer into a format parseable by the modem.

[0110] Furthermore, the transmitting module 902 is used to transmit the arrival time advance information to network-side equipment via the terminal's modem.

[0111] Furthermore, the method for transmitting the aforementioned arrival time advance information is: It includes at least one of the following: periodic transmission, transmission based on trigger conditions, and transmission based on requests.

[0112] Furthermore, the trigger condition is, The aforementioned arrival time advance amount exceeds a first predetermined threshold, The aforementioned arrival time advance amount falls below a second preset threshold, The increase is that the amount of increase exceeds a third preset threshold, wherein the amount of increase is the increase in the arrival time advance amount relative to the arrival time advance amount previously transmitted to the network-side equipment. The amount of reduction exceeds a fourth preset threshold, wherein the amount of reduction is the amount of the arrival time advance amount reduced from the arrival time advance amount previously transmitted to the network-side equipment. The arrival time advance amount is a negative value, The aforementioned terminal switched to a different cell, This includes at least one of the following: a wireless link failure occurred at the terminal, followed by successful recovery of the wireless link.

[0113] Furthermore, the aforementioned arrival time advance information is, The processing delay budget of the application layer of the aforementioned terminal, The processing delay budget of the modem of the aforementioned terminal, This further includes at least one of the following: an end-to-end processing delay budget determined based on the application layer of the terminal meeting quality of service requirements.

[0114] The first information transmission device 900 in the embodiments of this application may be an electronic device, such as an electronic device having an operating system, or a component of an electronic device, such as an integrated circuit or a chip. This electronic device may be a terminal, or it may be other devices other than terminals. Exemplarily, a terminal may include, but is not limited to, the types of terminals 11 listed above, and other devices may be servers, network-attached storage (NAS), etc., and the embodiments of this application are not specifically limited.

[0115] The first information transmission device 900 according to the embodiment of this application can realize each process realized by the embodiment of the method shown in Figure 3 and achieve the same technical effects, and to avoid repetition of the explanation, it will not be explained further here.

[0116] In the information transmission method shown in Figure 6 of this application, the execution unit may be a second information transmission device 1000. In the embodiment of this application, the apparatus of the information transmission method according to the embodiment of this application will be described using the execution of the information transmission method by the second information transmission device 1000 as an example.

[0117] As shown in Figure 10, the embodiment of this application provides a second information transmission device 1000. A transmission module 1001 for receiving arrival time advance information transmitted by a terminal, wherein the arrival time advance information includes an arrival time advance amount of a target image frame, and the arrival time advance amount is an advance amount of the actual arrival time of the target image frame relative to the target arrival time. Based on the arrival time advance information, the system includes a determination module 1002 for determining the air interface transmission delay budget between the first network-side equipment and the terminal, The transmission module 1001 is further used to perform image frame transmission based on the air interface transmission delay budget.

[0118] Furthermore, the actual arrival time was The time of the last data packet received when the terminal receives the data packet included in the target image frame, This includes one of the following times: the time during which the terminal analyzes the data packets contained in the target image frame to obtain the target image frame.

[0119] Furthermore, the target arrival time is The target playback time of the target image frame is the time during which the target image frame is actually played or is scheduled to be played, and The latest arrival time that does not affect the playback of the aforementioned target image frame, The time at which the latest arrival time that does not affect the playback of the target image frame is offset by the first offset time, This includes one of the following: a time that is offset by a second offset time earlier with respect to the target playback time of the target image frame.

[0120] Furthermore, the arrival time advance amount includes the arrival time advance amounts for the intra-encoded I-frame, the forward-predicted P-frame and the bidirectional-predicted B-frame, respectively, or the arrival time advance amount for the target image frame obtained when the I-frame, P-frame and B-frame are not distinguished, where the target image frame includes the I-frame, the P-frame and the B-frame.

[0121] Furthermore, the aforementioned arrival time advance information is, First determination method information and first instruction information, wherein the first determination method information includes a first determination method and / or an identifier for the first determination method, the first instruction information is used to indicate the parameters of the first determination method, and the first determination method is used to determine the actual arrival time of the target image frame, The system further includes at least one of a second determination method and / or second determination method information including an identifier for the second determination method, wherein the second determination method is used to determine the arrival time advance amount of the target image frame.

[0122] Furthermore, the transmission module 1001 is used to transmit request information to the terminal for requesting the arrival time advance information.

[0123] Furthermore, the aforementioned arrival time advance information is, The processing delay budget of the application layer of the aforementioned terminal, The processing delay budget of the modem of the aforementioned terminal, This further includes at least one of the following: an end-to-end processing delay budget determined based on the application layer of the terminal meeting quality of service requirements.

[0124] The second information transmission device 1000 according to the embodiment of this application can realize each process realized by the embodiment of the method in Figure 6 and achieve the same technical effects, and will not be described further here in order to avoid repetition of the explanation.

[0125] In the information transmission method shown in Figure 8 of this application, the execution unit may be a third information transmission device 1100. In the embodiment of this application, the apparatus of the information transmission method according to the embodiment of this application will be described using the execution of the information transmission method by the third information transmission device 1100 as an example. As shown in Figure 11, the embodiment of this application provides a third information transmission device 1100, A receiving module 1101 for receiving arrival time advance information transmitted by a terminal, wherein the arrival time advance information includes an arrival time advance amount of a target image frame, and the arrival time advance amount is the advance amount of the actual arrival time of the target image frame relative to the target arrival time. Based on the aforementioned arrival time advance information, Determine the air interface transmission delay budget between the first network-side device and the terminal, and transmit the air interface transmission delay budget to the first network-side device. The system includes an execution module 1102 for performing at least one of the following operations: transmitting the arrival time advance information to the first network-side device.

[0126] Furthermore, the actual arrival time was The time of the last data packet received when the terminal receives the data packet included in the target image frame, This includes one of the following times: the time during which the terminal analyzes the data packets contained in the target image frame to obtain the target image frame.

[0127] Furthermore, the target arrival time is The target playback time of the target image frame is the time during which the target image frame is actually played or is scheduled to be played, and The latest arrival time that does not affect the playback of the aforementioned target image frame, The time at which the latest arrival time that does not affect the playback of the target image frame is offset by the first offset time, This includes one of the following: a time that is offset by a second offset time earlier with respect to the target playback time of the target image frame.

[0128] Furthermore, the arrival time advance amount includes the arrival time advance amounts for the intra-encoded I-frame, the forward-predicted P-frame and the bidirectional-predicted B-frame, respectively, or the arrival time advance amount for the target image frame obtained when the I-frame, P-frame and B-frame are not distinguished, where the target image frame includes the I-frame, the P-frame and the B-frame.

[0129] Furthermore, the aforementioned arrival time advance information is, First determination method information and first instruction information, wherein the first determination method information includes a first determination method and / or an identifier for the first determination method, the first instruction information is used to indicate the parameters of the first determination method, and the first determination method is used to determine the actual arrival time of the target image frame, The system further includes at least one of a second determination method and / or second determination method information including an identifier for the second determination method, wherein the second determination method is used to determine the arrival time advance amount of the target image frame.

[0130] Furthermore, the aforementioned arrival time advance information is, The processing delay budget of the application layer of the aforementioned terminal, The processing delay budget of the modem of the aforementioned terminal, This further includes at least one of the following: an end-to-end processing delay budget determined based on the application layer of the terminal meeting quality of service requirements.

[0131] The third information transmission device 1100 according to the embodiment of this application can realize each process realized by the embodiment of the method shown in Figure 8 and achieve the same technical effects, and will not be described further here in order to avoid repetition of the explanation.

[0132] Selectively, as shown in Figure 12, an embodiment of the present application further provides a communication device 1200 which includes a processor 1201 and a memory 1202, the memory 1202 storing a program or instruction that can be executed on the processor 1201, for example, if the communication device 1200 is a terminal, when this program or instruction is executed by the processor 1201, each step of the embodiment of the information transmission method shown in Figure 3 can be realized and the same technical effect can be achieved. If the communication device 1200 is a network-side device, when this program or instruction is executed by the processor 1201, each step of the embodiment of the information transmission method shown in Figure 6 or Figure 8 can be realized and the same technical effect can be achieved, and to avoid repetition of the explanation, it will not be explained further here.

[0133] An embodiment of this application further provides a terminal comprising a processor and a communication interface, wherein the processor is used to acquire arrival time advance information, and the communication interface is used to transmit arrival time advance information to network-side equipment. This embodiment of the terminal corresponds to the embodiment of the terminal-side method described above, and each implementation process and implementation method of the embodiment of the method described above can be applied to this embodiment of the terminal and achieve the same technical effects. Specifically, Figure 13 is a schematic diagram of the hardware structure realizing the terminal of the embodiment of this application.

[0134] The terminal 1300 includes, but is not limited to, some of the following components: a radio frequency unit 1301, a network module 1302, an audio output unit 1303, an input unit 1304, a sensor 1305, a display unit 1306, a user input unit 1307, an interface unit 1308, a memory 1309, and a processor 1310.

[0135] As those skilled in the art will understand, the terminal 1300 may further include a power supply (e.g., a battery) to power each component, and the power supply may be logically connected to the processor 1310 by a power management system, thereby enabling functions such as charge / discharge management and power consumption management by the power management system. The terminal structure shown in Figure 13 does not constitute a limitation on the terminal, and the terminal may include more or fewer components than those shown, or combinations of some components, or different arrangements of components, which will not be described further here.

[0136] It should be understood that in the embodiments of this application, the input unit 1304 may include a graphics processing unit (GPU) 13041 and a microphone 13042, the graphics processor 13041 processing still images or video image data obtained by an image capture device (e.g., a camera) in video capture mode or image capture mode. The display unit 1306 may include a display panel 13061, which may be configured in the form of a liquid crystal display, organic light-emitting diodes, etc. The user input unit 1307 includes at least one of a touch panel 13071 and other input devices 13072. The touch panel 13071 is also called a touchscreen. The touch panel 13071 may include two parts: a touch detection device and a touch controller. The other input devices 13072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control buttons, switch buttons, etc.), a trackball, a mouse, or an operating lever, and will not be described further here.

[0137] In the embodiments of this application, the radio frequency unit 1301 can receive downlink data from network-side equipment and transmit it to the processor 1310 for processing, and the radio frequency unit 1301 can also transmit uplink data to network-side equipment. Generally, the radio frequency unit 1301 includes, but is not limited to, an antenna, amplifier, transceiver, coupler, low-noise amplifier, duplexer, etc.

[0138] Memory 1309 may be used to store software programs or instructions and various data. Memory 1309 may include a first storage area mainly for storing programs or instructions and a second storage area for storing data, where the first storage area can store an operating system, an application program or instructions necessary for at least one function (e.g., audio playback function, image playback function, etc.). Memory 1309 may include volatile memory or non-volatile memory, or memory 1309 may include both volatile and non-volatile memory. Here, non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (Erasable PROM, EPROM), electrically erasable programmable read-only memory (Electrically EPROM, EEPROM), or flash memory. The volatile memory may be random access memory (RAM), and may include static random access memory (Static RAM, SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (Synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (Double Data Rate SDRAM, DDRSDRAM), enhanced synchronous dynamic random access memory (Enhanced SDRAM, ESDRAM), synchronous link dynamic random access memory (Synch link DRAM, SLDRAM), and direct Rambus random access memory (Direct Rambus RAM, DRRAM). The memory 1309 in the embodiments of this application includes, but is not limited to, these and any other suitable types of memory.

[0139] The processor 1310 may include one or more processing units. Selectively, the processor 1310 integrates an application processor and a modem processor, where the application processor primarily handles operations related to the operating system, user interface, and application programs, and the modem processor primarily handles wireless communication signals, such as a baseband processor. To be clear, the above-mentioned modem processor does not have to be integrated into the processor 1310.

[0140] Here, the processor 1310 is used to acquire arrival time advance information, the arrival time advance information includes the arrival time advance amount of the target image frame, the arrival time advance amount is the advance amount of the actual arrival time of the target image frame relative to the target arrival time. The radio frequency unit 1301 is used to transmit arrival time advance information to network-side equipment.

[0141] Furthermore, the actual arrival time was The time of the last data packet received when the terminal receives the data packet included in the target image frame, This includes one of the following times: the time during which the terminal analyzes the data packets contained in the target image frame to obtain the target image frame.

[0142] Furthermore, the target arrival time is The target playback time of the target image frame is the time during which the target image frame is actually played or is scheduled to be played, and The latest arrival time that does not affect the playback of the aforementioned target image frame, The time at which the latest arrival time that does not affect the playback of the target image frame is offset by the first offset time, This includes one of the following: a time that is offset by a second offset time earlier with respect to the target playback time of the target image frame.

[0143] Furthermore, the arrival time advance amount includes the arrival time advance amounts for the intra-encoded I-frame, the forward-predicted P-frame and the bidirectional-predicted B-frame, respectively, or the arrival time advance amount for the target image frame obtained when the I-frame, P-frame and B-frame are not distinguished, where the target image frame includes the I-frame, the P-frame and the B-frame.

[0144] Furthermore, the aforementioned arrival time advance information is, First determination method information and first instruction information, wherein the first determination method information includes a first determination method and / or an identifier for the first determination method, the first instruction information is used to indicate the parameters of the first determination method, and the first determination method is used to determine the actual arrival time of the target image frame, The system further includes at least one of a second determination method and / or second determination method information including an identifier for the second determination method, wherein the second determination method is used to determine the arrival time advance amount of the target image frame.

[0145] Furthermore, the target image frame includes at least one image frame, and the arrival time advance amount is determined based on the arrival time advance amount of each image frame among the at least one image frame.

[0146] Furthermore, the arrival time advance amount is obtained by reserving a first preset time in the first advance amount, and the first advance amount is obtained by calculating based on the arrival time advance amount of each image frame among the at least one image frame.

[0147] Furthermore, the arrival time advance amount is the arrival time advance amount corresponding to a predetermined percentile in the cumulative distribution function curve, where the cumulative distribution function curve represents the cumulative probability distribution of the arrival time advance amount for each image frame among the plurality of image frames.

[0148] Furthermore, the radio frequency unit 1301 is used to receive request information via the modem for requesting the terminal to transmit the arrival time advance information transmitted by the network-side equipment, and the processor 1310 is used to control the application layer of the terminal to acquire the arrival time advance information.

[0149] Furthermore, the terminal further includes an adaptation layer located between the application layer and the modem, the adaptation layer being used to rewrite the request information from the modem into a format parseable by the application layer, and / or to rewrite the arrival time advance information from the application layer into a format parseable by the modem.

[0150] Furthermore, the radio frequency unit 1301 is used to transmit the arrival time advance information to network-side equipment via the modem of the terminal.

[0151] Furthermore, the method for transmitting the aforementioned arrival time advance information is: It includes at least one of the following: periodic transmission, transmission based on trigger conditions, and transmission based on requests.

[0152] Furthermore, the trigger condition is, The aforementioned arrival time advance amount exceeds a first predetermined threshold, The aforementioned arrival time advance amount falls below a second preset threshold, The increase is that the amount of increase exceeds a third preset threshold, wherein the amount of increase is the increase in the arrival time advance amount relative to the arrival time advance amount previously transmitted to the network-side equipment. The amount of reduction exceeds a fourth preset threshold, wherein the amount of reduction is the amount of the arrival time advance amount reduced from the arrival time advance amount previously transmitted to the network-side equipment. The arrival time advance amount is a negative value, The aforementioned terminal switched to a different cell, This includes at least one of the following: a wireless link failure occurred at the terminal, followed by successful recovery of the wireless link.

[0153] Furthermore, the aforementioned arrival time advance information is, The processing delay budget of the application layer of the aforementioned terminal, The processing delay budget of the modem of the aforementioned terminal, This further includes at least one of the following: an end-to-end processing delay budget determined based on the application layer of the terminal meeting quality of service requirements.

[0154] The terminal according to the embodiment of this application can implement each process realized by the embodiment of the method shown in Figure 3 and achieve the same technical effects, and to avoid repetition of the explanation, it will not be explained further here.

[0155] Embodiments of this application further provide a network-side device comprising a processor and a communication interface, wherein the communication interface receives arrival time advance information transmitted by a terminal, the arrival time advance information comprising an arrival time advance amount of a target image frame, the arrival time advance amount being an advance amount of the actual arrival time of the target image frame relative to the target arrival time, and is used to transmit image frames based on the air interface transmission delay budget. The processor determines the air interface transmission delay budget with the terminal based on the arrival time advance information.

[0156] This embodiment of the network-side device corresponds to the embodiment of the network-side device method shown in Figure 6. Each implementation process and implementation method of the embodiment of the method shown in Figure 6 can be applied to this embodiment of the network-side device and achieve the same technical effects.

[0157] Embodiments of this application further provide a network-side device comprising a processor and a communication interface, the communication interface being used to receive arrival time advance information transmitted by a terminal, the arrival time advance information comprising an arrival time advance amount of a target image frame, the arrival time advance amount being an advance amount of the actual arrival time of the target image frame relative to the target arrival time, and the processor is Determine the air interface transmission delay budget between the first network-side device and the terminal, and transmit the air interface transmission delay budget to the first network-side device. It is used to perform at least one of the following operations: transmitting the aforementioned arrival time advance information to the first network-side device.

[0158] This embodiment of the network-side device corresponds to the embodiment of the network-side device method shown in Figure 8. Each implementation process and implementation method of the embodiment of the method shown in Figure 8 can be applied to this embodiment of the network-side device and achieve the same technical effects.

[0159] Specifically, embodiments of this application further provide network-side equipment. As shown in Figure 14, this network-side equipment 1400 includes an antenna 1401, a radio frequency device 1402, a baseband device 1403, a processor 1404, and a memory 1405. The antenna 1401 and the radio frequency device 1402 are connected. In the uplink direction, the radio frequency device 1402 receives information via the antenna 1401 and transmits the received information to the baseband device 1403 for processing. In the downlink direction, the baseband device 1403 processes the information to be transmitted and transmits it to the radio frequency device 1402, which processes the received information and then transmits it via the antenna 1401.

[0160] The method performed by the network-side equipment in the above embodiment may also be implemented in the baseband device 1403, which includes a baseband processor.

[0161] The baseband device 1403 may include, for example, at least one baseband board on which multiple chips are installed, as shown in Figure 14. One of these chips may be, for example, a baseband processor, which is connected to memory 1405 via a bus interface, calls a program in memory 1405, and performs the operation of the network-side equipment as shown in the embodiment of the above method.

[0162] This network-side device may further include a network interface 1406, which is, for example, a common public radio interface (CPRI).

[0163] Specifically, the network-side device 1400 of the embodiment of the present invention further includes instructions or programs stored in memory 1405 and operable on processor 1404, the processor 1404 can call instructions or programs in memory 1405 and perform the same technical effects as those shown in Figure 10, and will not be described further here to avoid repetition.

[0164] Embodiments of this application further provide network-side equipment. As shown in Figure 15, this network-side equipment 1500 includes a processor 1501, a network interface 1502, and memory 1503. Here, the network interface 1502 is, for example, a common public radio interface (CPRI).

[0165] Specifically, the network-side device 1500 of the embodiment of the present invention further includes instructions or programs stored in memory 1503 and operable on processor 1501, the processor 1501 can call instructions or programs in memory 1503 and perform the same actions as those performed by each module shown in Figure 11, and achieve the same technical effects, which will not be described further here to avoid repetition.

[0166] Embodiments of this application further provide a readable storage medium in which a program or instruction is stored, and when this program or instruction is executed by a processor, each process of the above-described embodiment of the information transmission method can be realized and the same technical effects can be achieved. To avoid repetition of the description, no further explanation is provided here.

[0167] Here, the processor is the processor in the terminal described in the above embodiment. The readable storage medium includes a computer-readable storage medium, such as a computer read-only memory ROM, random access memory RAM, magnetic disk, or optical disk.

[0168] Embodiments of this application further provide a chip comprising a processor and a communication interface, the communication interface being coupled with the processor, the processor running a program or instructions and used to implement each process of the embodiment of the information transmission method described above, and achieving the same technical effects, which are not described further here in order to avoid repetition of the description.

[0169] It should be understood that the chips referred to in the embodiments of this application may also be called system-level chips, system chips, chip systems, or system-on-a-chip, etc.

[0170] Embodiments of this application further provide a computer program product in which the computer program product is stored in a storage medium and executed by at least one processor to realize each process of the embodiment of the information transmission method described above and to achieve the same technical effects, and to avoid repetition of the description, no further explanation is provided here.

[0171] Embodiments of this application further provide a communication system comprising a terminal and network-side equipment, wherein the terminal is used to perform the steps of the embodiment of the method shown in Figure 3 described above, and the network-side equipment is used to perform the steps of the embodiment of the method shown in Figure 6 or Figure 8.

[0172] It should be noted that, in this specification, the terms “include,” “incorporate,” or any other variation thereof are intended to cover the non-exclusive “include,” thereby including not only those elements but also other elements not explicitly listed, or elements specific to such process, method, article, or apparatus. Unless otherwise specified, an element limited by the phrase “includes one of…” is not excluded from the existence of other identical elements in a process, method, article, or apparatus containing that element. It should also be noted that the scope of methods and apparatus in embodiments of this application is not limited to performing functions in the order illustrated or discussed, but may include performing functions in a manner that is essentially simultaneous or in reverse order based on the functions involved, and methods described in a different procedure than those described, for example, may be performed, and various steps may be added, omitted, or combined. Furthermore, features described by reference to some examples may be combined with other examples.

[0173] As will be clearly evident to those skilled in the art from the above description of the embodiments, the methods of the above embodiments can be implemented in the form of software and a necessary general-purpose hardware platform. Of course, they may also be implemented in hardware, but in many cases the former is a more preferred embodiment. With this understanding in mind, the parts of the invention that substantially contribute to or to the prior art may be embodied in the form of a computer software product, which is stored on a single storage medium (e.g., ROM / RAM, magnetic disk, optical disk) and contains some instructions for causing a terminal (which may be a mobile phone, computer, server, air conditioner, or network-side device, etc.) to perform the methods of each embodiment of this invention.

[0174] The above describes embodiments of this application, accompanied by drawings; however, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can, by the suggestion of this application, make many forms, as long as they do not deviate from the spirit and claims of this application, and all of these fall within the scope of protection of this application.

Claims

1. A method of transmitting information, The terminal acquires arrival time advance information, wherein the arrival time advance information includes the arrival time advance amount of the target image frame, and the arrival time advance amount is the advance amount of the actual arrival time of the target image frame relative to the target arrival time. This includes the terminal transmitting arrival time advance information to the network-side device. The target image frame includes at least one image frame, and the arrival time advance amount is determined based on the arrival time advance amount of each image frame among the at least one image frame. The arrival time advance amount includes the arrival time advance amounts of the intra-encoded I-frame, the forward-predicted P-frame and the bidirectional-predicted B-frame, respectively, or the arrival time advance amount of the target image frame obtained when the I-frame, P-frame and B-frame are not distinguished, wherein the target image frame includes an I-frame, a P-frame and a B-frame, in an information transmission method.

2. The actual arrival time mentioned above was, The time of the last data packet received when the terminal receives the data packet included in the target image frame, The method according to claim 1, wherein the terminal includes one of the following: the time spent analyzing data packets contained in the target image frame to obtain the target image frame.

3. The aforementioned target arrival time is The target playback time of the target image frame is the time during which the target image frame is actually played or is scheduled to be played, and The latest arrival time that does not affect the playback of the aforementioned target image frame, The time at which the latest arrival time that does not affect the playback of the target image frame is offset by the first offset time, The method according to claim 1, comprising one of the following: a time that is offset by a second offset time with respect to the target playback time of the target image frame.

4. The aforementioned arrival time advance information is, A first determination method information and a first instruction information, wherein the first determination method information includes a first determination method and / or an identifier for the first determination method, the first instruction information is used to indicate the parameters of the first determination method, and the first determination method is used to determine the actual arrival time of the target image frame, The method according to claim 1, further comprising at least one of a second determination method and / or second determination method information including an identifier for the second determination method, wherein the second determination method is used to determine the arrival time advance amount of the target image frame.

5. The arrival time advance amount is obtained by reserving a first preset time in the first advance amount, and the first advance amount is obtained by calculating based on the arrival time advance amount of each image frame among the at least one image frame. Or, The method according to claim 1, wherein the arrival time advance amount is an arrival time advance amount corresponding to a predetermined percentile in a cumulative distribution function curve, where the cumulative distribution function curve represents the cumulative probability distribution of the arrival time advance amount for each image frame among the at least one image frame.

6. The method for transmitting the aforementioned arrival time advance information is: It includes at least one of the following: periodic transmission, trigger condition-based transmission, and request-based transmission. The aforementioned trigger conditions are: The aforementioned arrival time advance amount exceeds a first predetermined threshold, The aforementioned arrival time advance amount falls below a second preset threshold, The increase is that the amount of increase exceeds a third preset threshold, wherein the amount of increase is the increase in the arrival time advance amount relative to the arrival time advance amount previously transmitted to the network-side equipment. The amount of decrease exceeds a fourth preset threshold, wherein the amount of decrease is the amount of decrease of the arrival time advance amount relative to the arrival time advance amount previously transmitted to the network-side equipment. The arrival time advance amount is a negative value, The aforementioned terminal switched to a different cell, The method according to claim 1, further comprising at least one of the following: a wireless link failure occurring in the terminal, followed by successful recovery of the wireless link.

7. The aforementioned arrival time advance information is, The processing delay budget of the application layer of the aforementioned terminal, The processing delay budget of the modem of the aforementioned terminal, The method according to claim 1, further comprising at least one of the following: an end-to-end processing delay budget determined on the basis that the application layer of the terminal satisfies quality of service requirements.

8. A method of transmitting information, The first network-side device receives arrival time advance information transmitted by the terminal, wherein the arrival time advance information includes the arrival time advance amount of the target image frame, and the arrival time advance amount is the advance amount of the actual arrival time of the target image frame relative to the target arrival time. The first network-side device determines the air interface transmission delay budget between the first network-side device and the terminal based on the arrival time advance information, The first network-side device performs image frame transmission based on the air interface transmission delay budget, The target image frame includes at least one image frame, and the arrival time advance amount is determined based on the arrival time advance amount of each image frame among the at least one image frame. The aforementioned arrival time advance amount includes the arrival time advance amounts for the intra-encoded I-frame, the forward-predicted P-frame, and the bidirectional-predicted B-frame, respectively, or the arrival time advance amount for the target image frame obtained when the I-frame, P-frame, and B-frame are not distinguished, where the target image frame includes the I-frame, the P-frame, and the B-frame. Information transmission method.

9. Before the first network-side device receives the arrival time advance information transmitted by the terminal, the method The method according to claim 8, further comprising the first network-side device transmitting request information to the terminal for requesting the arrival time advance information.

10. A method of transmitting information, The second network-side device receives arrival time advance information transmitted by the terminal, wherein the arrival time advance information includes the arrival time advance amount of the target image frame, and the arrival time advance amount is the advance amount of the actual arrival time of the target image frame relative to the target arrival time. The second network-side device, based on the arrival time advance information, Determine the air interface transmission delay budget between the first network-side device and the terminal, and transmit the air interface transmission delay budget to the first network-side device. This includes performing at least one of the following operations: transmitting the aforementioned arrival time advance information to the first network-side device; The target image frame includes at least one image frame, and the arrival time advance amount is determined based on the arrival time advance amount of each image frame among the at least one image frame. The arrival time advance amount includes the arrival time advance amounts of the intra-encoded I-frame, the forward-predicted P-frame and the bidirectional-predicted B-frame, respectively, or the arrival time advance amount of the target image frame obtained when the I-frame, P-frame and B-frame are not distinguished, wherein the target image frame includes an I-frame, a P-frame and a B-frame, in an information transmission method.

11. A terminal comprising a processor and memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the terminal realizes the steps of the information transmission method described in any one of claims 1 to 7.

12. Network-side device comprising a processor and memory, wherein the memory stores a program or instruction that can be executed on the processor, and when the program or instruction is executed by the processor, the network-side device realizes the steps of the information transmission method described in claim 8 or 9.

13. Network-side device comprising a processor and memory, wherein the memory stores a program or instruction that can be executed on the processor, and when the program or instruction is executed by the processor, the network-side device realizes the steps of the information transmission method described in claim 10.

14. A readable storage medium, the readable storage medium storing a program or instruction, and when the program or instruction is executed by a processor, the readable storage medium realizes the steps of the information transmission method described in any one of claims 1 to 7.

15. A readable storage medium, the readable storage medium storing a program or instruction, and when the program or instruction is executed by a processor, the readable storage medium realizes the steps of the information transmission method described in claim 8 or 9.

16. A readable storage medium, the readable storage medium storing a program or instruction, and when the program or instruction is executed by a processor, the steps of the information transmission method described in claim 10 are realized.

Images