Method, device and storage medium for adjusting communication wave time slot ratio
The terminal data is obtained through the server and the time slot ratio of synesthesia integrated base station is adjusted using the DQN algorithm, which solves the problem of poor flexibility of synesthesia integrated base station, realizes dynamic balance between perception functions and communication functions, and improves the system's adaptability and anti-interference ability.
Patent Information
- Application Number
- CN202310744613.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-06-21
- Publication Date
- 2025-08-29
- Estimated Expiration
- 2043-06-21
AI Technical Summary
In the frame structure of synesthesia integrated base station, the time slot ratio between perception function and communication function is fixed, resulting in poor flexibility and susceptibility to interference, limiting its application and promotion in synesthesia integrated technology.
The XDR data of the target terminal is obtained through the server, and the DQN algorithm is used to adjust the time slot ratio of the communication wave based on the Markov chain decision process, and the dynamic equalization perception function and communication function to achieve flexible time slot ratio adjustment.
It improves the flexibility and anti-interference ability of synesthesia integrated base stations, can better adapt to actual needs, and improves the balance of communication and perception functions.
Smart Images

Figure CN116614779B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of communication and radar technology, and in particular to a method, device and storage medium for adjusting the time slot ratio of communication waves. Background Art
[0002] A base station is the interface device for mobile devices to access the internet. It is also a form of radio station, a radio transceiver that transmits information to and from mobile terminals via a mobile communications exchange center within a specific radio coverage area. Currently, base station frequency bands are evolving toward higher frequencies such as millimeter waves, terahertz, and visible light. This increasingly overlaps with frequency bands used for traditional sensing (e.g., target location, imaging, and recognition), opening up the possibility of integrating communication and perception. This integration of communication and perception, known as synaesthesia, primarily utilizes a single base station device to simultaneously perform both perception and communication functions. This synaesthesia reduces the need for separate sensing equipment deployment, saving hardware costs and improving base station efficiency.
[0003] In traditional technology, the telepathy integrated base station mainly realizes the perception function by multiplexing the communication waveform of orthogonal frequency division multiplexing (OFDM) technology. During operation, the telepathy integrated base station usually adopts the time division duplexing (TDD) working mode. In the TDD frame structure, each subframe of the frame structure has multiple time slots, and each time slot corresponds to a perception function or a communication function. By adjusting the time slot ratio of the perception function and the communication function of each subframe, the adjustment of the perception and communication functions is achieved. In this traditional technology, the frame structure used by the telepathy integrated base station is a fixed frame structure. Once the time slot ratio of the perception function and the communication function of the subframe in the fixed frame structure is determined, the time slot ratio is fixedly used. The use of a fixed structure has defects such as poor flexibility and susceptibility to interference, which restricts its application and promotion in telepathy integrated technology. Summary of the Invention
[0004] The present application provides a method, device and storage medium for adjusting the time slot ratio of communication waves. The method has good flexibility and is not easily interfered with.
[0005] To achieve the above technical objectives, this application adopts the following technical solutions:
[0006] In the first aspect, an embodiment of the present application provides a method for adjusting the time slot ratio of a communication wave, the method comprising: obtaining XDR data of a target terminal of a target base station; wherein the target base station is a base station within a target road section, and the target terminal is a terminal connected to the target base station within the target road section; based on the XDR data of the target terminal, obtaining a communication wave time slot ratio adjustment strategy; sending a control signal to the target base station; wherein the control signal is used to control the target base station to adjust the time slot ratio of the communication wave based on the communication wave time slot ratio adjustment strategy; the time slot of the communication wave includes the time slot of the perception function and the time slot of the communication function.
[0007] It is understood that in this method, the time slot ratio of the perception function and the communication function in the frame structure of the communication wave is flexibly adjusted based on the XDR data of the target terminal. This method can balance the perception function and the communication function based on the actual XDR data of the target terminal. Therefore, the method of the embodiment of the present application is highly flexible and not susceptible to external interference. It can be applied and promoted in the field of telepathy integration technology. In addition, the execution subject of the embodiment of the present application is a server, which does not need to occupy the computing resources of the base station, thereby improving computing efficiency.
[0008] In one possible implementation, the XDR data includes the location information of the terminal; obtaining the XDR data of the target terminal of the target section includes: obtaining the XDR data of multiple terminals of the target base station; wherein the multiple terminals of the target base station are terminals connected to the target base station; comparing the location information of the multiple terminals of the target base station with the location information of the target section, and selecting the target terminal from the multiple terminals; and obtaining the XDR data of the target terminal.
[0009] It is understandable that since the base station transmits wireless signals, some terminals are not within the target section but are connected to the base station of the target section. Therefore, this step is to ensure that the selected terminal is the terminal in the target section, so as to improve the accuracy of the communication wave time slot ratio adjustment method of the embodiment of the present application.
[0010] In another possible implementation, before obtaining XDR data of multiple terminals of the target base station, the method further includes: obtaining location information of the target road section; wherein the location information of the target road section is stored in a preset location information library.
[0011] It is understood that before the server executes the method of the embodiment of the present application on the base station of the specified road section in real time, it needs to first obtain the location information of the specified road section, that is, the location information of the target road section. Storing the location information of the target road section in a preset location information library facilitates subsequent direct reading of the location information of the target road section from the preset location information library, thereby improving the efficiency of the implementation of the method.
[0012] In another possible implementation, the network quality indicator of the target terminal is determined based on the call service data of the target terminal and the traffic service data of the target terminal.
[0013] It is understandable that the call service data of the target terminal and the traffic service data of the target terminal are both communication data of the terminal and can be obtained from the operator database.
[0014] In another possible implementation, the target terminal's network quality indicator UE_KQI, the target terminal's call service data K V and the traffic service data K of the target terminal D The following formula is satisfied: UE_KQI=W1 K V +W2 K D ; W1 is used to characterize the importance of call service data in network quality indicators, and W2 is used to characterize the importance of traffic service data in network quality indicators.
[0015] It is understandable that call service data and traffic service data can represent network quality, and setting different weights for them will result in different network quality index values.
[0016] In another possible implementation, the XDR data of the target terminal also includes: the identifier of the target terminal, the number of identifiers of the target terminal and the network quality indicator of the target terminal. Based on the XDR data of the target terminal, a communication wave time slot ratio adjustment strategy is obtained, including: using the identifier of the target terminal UE, the number of identifiers of the target terminal UN and the network quality indicator UE_KQI of the target terminal included in the XDR data of the target terminal as the state value s[UE, UN, UE_KQI]; inputting the action set a, the state value s and the reward return r as parameters of the Markov chain decision process into the target algorithm to obtain the communication wave time slot ratio adjustment strategy; wherein, the action set a is a collection of multiple flags, each flag represents a communication wave time slot ratio adjustment strategy; the reward return r is related to the network satisfaction index and the radar performance index.
[0017] It can be understood that the DQN algorithm is a mature neural network reinforcement learning algorithm, which can be used to quickly obtain the communication wave time slot ratio adjustment strategy.
[0018] In another possible implementation, the target algorithm includes a DQN algorithm.
[0019] It can be understood that the DQN algorithm can quickly solve the communication wave time slot ratio adjustment strategy of the embodiment of the present application, thereby improving the solution efficiency.
[0020] In another possible implementation, the action set a={0, 1, 2, 3, 4, 5, 6, 7, 8}, 0 indicates that the time slot ratio of the perception function and the time slot ratio of the communication function is 1:9, 1 indicates that the time slot ratio of the perception function and the time slot ratio of the communication function is 2:8, 2 indicates that the time slot ratio of the perception function and the time slot ratio of the communication function is 3:7, 3 indicates that the time slot ratio of the perception function and the time slot ratio of the communication function is 4:6, 4 indicates that the time slot ratio of the perception function and the time slot ratio of the communication function is 5:5, 5 indicates that the time slot ratio of the perception function and the time slot ratio of the communication function is 6:4, 6 indicates that the time slot ratio of the perception function and the time slot ratio of the communication function is 7:3, 7 indicates that the time slot ratio of the perception function and the time slot ratio of the communication function is 8:2, and 8 indicates that the time slot ratio of the perception function and the time slot ratio of the communication function is 9:1; network satisfaction index Radar performance indicators RQI represents the signal-to-noise ratio, and the reward is r=10[αsa+(1-α)ra].
[0021] In another possible implementation, the communication wave includes an OFDM communication wave.
[0022] It can be understood that the OFDM communication wave is a communication wave commonly used in traditional technologies, and the use of this wave can quickly implement the communication wave time slot ratio adjustment method of the present application.
[0023] In another possible implementation, the XDR data of the target terminal also includes time information of the target terminal, and obtaining the XDR data of the target terminal of the target base station includes: periodically obtaining the XDR data of the target terminal of the target base station based on the time information of the target terminal.
[0024] It can be understood that the server periodically obtains the XDR data of the target terminal of the target base station, indicating that the server generates a communication wave time slot ratio adjustment strategy based on real-time XDR data. It can be seen that the communication wave time slot ratio of the base station is adjusted based on real-time road conditions, which is practical and flexible.
[0025] In a second aspect, an embodiment of the present application provides a communication wave time slot ratio adjustment device, wherein the communication wave time slot ratio adjustment device is applied to each module of the communication wave time slot ratio adjustment method of the first aspect or any possible implementation method of the first aspect.
[0026] In a third aspect, embodiments of the present application provide a device for adjusting the time slot ratio of communication waves, comprising a memory and a processor. The memory and the processor are coupled; the memory is configured to store computer program code, which includes computer instructions. When the processor executes the computer instructions, the device for adjusting the time slot ratio of communication waves performs the method for adjusting the time slot ratio of communication waves according to the first aspect and any possible implementation thereof.
[0027] In a fourth aspect, the present application provides a computer-readable storage medium comprising computer instructions. When the computer instructions are executed on a communication wave time slot ratio adjustment device, the communication wave time slot ratio adjustment device executes the communication wave time slot ratio adjustment method according to the first aspect and any possible implementation thereof.
[0028] In a fifth aspect, the present application provides a computer program product comprising computer instructions. When the computer instructions are executed on a communication wave time slot ratio adjustment device, the communication wave time slot ratio adjustment device executes the communication wave time slot ratio adjustment method according to the first aspect and any possible implementation thereof.
[0029] For the specific descriptions of the second to fifth aspects and their various implementations in this application, reference can be made to the detailed descriptions in the first aspect and its various implementations; and for the beneficial effects of the second to fifth aspects and their various implementations, reference can be made to the analysis of the beneficial effects in the first aspect and its various implementations, which will not be repeated here.
[0030] These and other aspects of the present application will become more readily apparent from the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0031] Figure 1 A schematic diagram of a time slot of a wireless frame proposed in an embodiment of the present application;
[0032] Figure 2 A schematic diagram of an implementation environment involved in the communication wave time slot ratio adjustment method provided in an embodiment of the present application;
[0033] Figure 3 A schematic diagram of an application scenario proposed in an embodiment of the present application;
[0034] Figure 4 A flowchart of a method for adjusting the time slot ratio of communication waves provided in an embodiment of the present application;
[0035] Figure 5 A flowchart of a method for obtaining XDR data of a target terminal provided in an embodiment of the present application;
[0036] Figure 6 A schematic diagram of the structure of a communication wave time slot ratio adjustment device provided in an embodiment of the present application;
[0037] Figure 7 A schematic structural diagram of another communication wave time slot ratio adjustment device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0038] In the following, the terms "first," "second," and "third," etc., are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the quantity of the technical features indicated. Thus, a feature designated as "first," "second," or "third," etc., may explicitly or implicitly include one or more of the features.
[0039] The telepathic base station primarily uses OFDM communication waveforms to achieve its sensing function. During operation, the telepathic base station typically employs a time division duplex (TDD) operating mode. Within the TDD frame structure, each subframe has multiple time slots, each corresponding to either a sensing function or a communication function. The sensing and communication functions are adjusted by adjusting the time slot ratio of each subframe for sensing and communication functions. In this conventional technology, the frame structure used by the telepathic base station is a fixed frame structure. Once the time slot ratio of the sensing and communication functions of the subframes in the fixed frame structure is determined, this time slot ratio is fixed. However, within a fixed frame structure, if the proportion of subframes with sensing functions is too low in the total subframes, small targets may not be sensed, or false detection targets may be generated, resulting in reduced recognition accuracy. Reducing the proportion of subframes with communication functions in the total subframes to accommodate sensing functions will reduce the communication data rate, impacting communication functions. Therefore, the use of a fixed structure suffers from drawbacks such as poor flexibility and susceptibility to interference, which restricts its application and promotion in telepathic integration technology.
[0040] In one example, if Figure 1 As shown, Figure 1 A schematic diagram of a time slot of a TDD radio frame is shown. The radio frame has a duration of 10 ms and consists of 10 subframes, each subframe is 1 ms, and a subframe has 10 time slots.
[0041] Based on this, an embodiment of the present application proposes a method for adjusting the time slot ratio of a communication wave. In this method, after the server obtains the XDR data (X data record) of the target terminal on the target road section, the XDR data is data representing the call detail record (CDR), transaction detail record (TDR), and service detail record (SDR). The server analyzes the XDR data to obtain a communication wave time slot ratio adjustment strategy, and controls the target base station to adjust the communication wave time slot. It can be understood that in this method, the XDR data of the target terminal can be obtained in real time, and the time slot ratio of the perception function and the communication function in the frame structure of the communication wave is flexibly adjusted based on the XDR data of the target terminal, which can balance the perception function and the communication function. Therefore, the method of the embodiment of the present application is highly flexible, not easily affected by external interference, and can be applied and promoted in the integrated communication technology.
[0042] The implementation of the embodiments of the present application will be described in detail below with reference to the accompanying drawings.
[0043] Please refer to Figure 2 , which shows a schematic diagram of an implementation environment involved in the communication wave time slot ratio adjustment method provided in the embodiment of the present application. Figure 2 As shown, the implementation environment may include: a server 110 , a base station 120 and a terminal 130 .
[0044] Server 110 is a computing device with high-speed CPU computing power, long-term reliable operation, strong input / output (I / O) external data throughput capabilities, and improved scalability. In the embodiment of the present application, after server 110 obtains XDR data from terminal 130 from base station 120, it analyzes the XDR data to obtain a communication wave time slot ratio adjustment strategy and sends a control signal to base station 110, so that base station 110 adjusts the communication wave time slot ratio based on the communication wave time slot ratio adjustment strategy.
[0045] Base station 120, also known as a public mobile communication base station, is an interface device for mobile devices to access the Internet and is also a form of radio station. The main function of a base station is to provide wireless coverage, that is, to realize wireless signal transmission between a wired communication network and a wireless terminal. In the embodiment of the present application, base station 120 is a device with integrated communication and perception functions. This device integrates the two functions of communication and perception, so that the communication system has both communication and perception functions. While transmitting information through the wireless channel, it actively recognizes and analyzes the characteristics of the channel to perceive the physical characteristics of the surrounding environment, thereby enhancing the communication and perception functions. For example, by using base station signals to perceive information about the surrounding environment and designing communication links, some obstacles can be avoided and communication performance can be improved.
[0046] In the embodiment of the present application, the base station 120 obtains XDR data of the connected terminal 130 and sends it to the server 110. Under the control of the server 110, the time slot ratio of the communication wave is adjusted.
[0047] The terminal 130 is a mobile intelligent terminal device that has the ability to access the Internet and is usually equipped with various operating systems. In the embodiment of the present application, the terminal 130 accesses the base station 120 in a wireless manner and uses the wireless signal transmitted by the base station 120.
[0048] Exemplarily, the terminal 130 includes: a mobile phone, a tablet computer, a vehicle-mounted smart terminal, a smart TV or a wearable device, etc.
[0049] In the embodiment of the present application, the number of terminals 130 can be one or more, and the embodiment of the present application does not limit this.
[0050] Optionally, the embodiment of the present application further includes a gateway 140 .
[0051] Gateway 140 is a computer system or device that performs conversion tasks. It enables network interconnection above the network layer and is used between two systems with different communication protocols, data formats or languages, or completely different architectures. In this embodiment of the present application, gateway 140 is used for network data transmission between server 110 and base station 120.
[0052] In the embodiment of the present application, the server 110, base station 120, and gateway 140 are independently provided and connected via a network, or the server 110, base station 120, and gateway 140 are integrated together. The embodiment of the present application does not limit the number of servers 110, base stations 120, and gateways 140.
[0053] In an application scenario, such as Figure 3 As shown, the base station 120 obtains the terminal 130 (the terminal 130 is Figure 3 Server 110 obtains terminal data (e.g., XDR data) from base stations 120 on the target road segment via gateway 140. After processing the acquired terminal data, server 110 obtains a communication wave time slot ratio adjustment strategy. Server 110 sends a control signal to base station 120 via gateway 140, causing base station 120 to adjust the communication wave time slot ratio based on the communication wave time slot ratio adjustment strategy.
[0054] The following describes the method for adjusting the communication wave time slot ratio provided in the embodiment of the present application:
[0055] Please refer to Figure 4 , is a flow chart of a communication wave time slot ratio adjustment method provided by an embodiment of the present application, which is applied to a server. Figure 4 As shown, the method may include S101-S103.
[0056] S101: The server obtains XDR data of a target terminal of a target base station.
[0057] The target base station is any base station in the target section, and the target terminal is a terminal connected to the target base station in the target section. The number of target terminals can be one or more.
[0058] The target road section is the road section where the communication wave time slot ratio adjustment method of the embodiment of the present application needs to be implemented. For example, the target road section is the "Beijing-Shanghai Expressway".
[0059] In one example, the target road section is the "Beijing-Shanghai Expressway", and the target terminals include mobile phones used by people in vehicles traveling on the "Beijing-Shanghai Expressway".
[0060] The XDR data of the target terminal includes: the identifier of the target terminal, the number of identifiers of the target terminal and the network quality indicator of the target terminal. Optionally, the XDR data also includes the location information and time information of the target terminal.
[0061] The identification of the target terminal includes the International Mobile Subscriber Identity (IMSI) of the Subscriber Identity Module (SIM) card used by the target terminal. For example, if the target terminal is a mobile phone, the SIM card of the target terminal is the mobile phone card in the mobile phone, and the IMSI number of the mobile phone card is the unique identification code of the mobile phone.
[0062] The time information of the target terminal is the time when the target terminal appears in the target road section. The time information can be a continuous time period or some discrete time points.
[0063] In one example, as shown in Table 1, Table 1 shows XDR data of a target terminal acquired by a server. Table 1 includes "identification of the target terminal," "location information of the target terminal," "time information of the target terminal," "network quality indicator of the target terminal," and "number of identifications of the target terminals."
[0064] Table 1
[0065]
[0066] Optionally, the server periodically obtains the XDR data of the target terminal of the target base station based on the time information of the target terminal.
[0067] For example, the server acquires XDR data from a target terminal at a target base station every hour. The acquired XDR data for the target terminal is data within that hour. Because XDR data includes the target terminal's time information, the server can only acquire XDR data for the target terminal within that period each time. It is understood that in this case, the data acquired by the server does not include data outside of that hour.
[0068] The server may obtain the XDR data of the target terminal of the target base station only once, or obtain the XDR data of the target terminal of the target base station at different time points, or obtain the XDR data of the target terminal of the target base station periodically. The embodiment of the present application does not limit the time and frequency of when the server obtains the XDR data of the target terminal of the target base station.
[0069] It can be understood that the server periodically obtains the XDR data of the target terminal of the target base station, indicating that the subsequent server generates a communication wave time slot ratio adjustment strategy based on real-time XDR data. It can be seen that the communication wave time slot ratio of the target base station is adjusted based on real-time road conditions, which is practical and flexible.
[0070] The above-mentioned communication waves include OFDM communication waves.
[0071] A possible specific implementation of S101 is proposed below, such as Figure 5 As shown, including: S101a-S101d.
[0072] S101a: The server obtains the location information of the target road segment.
[0073] The location information of the target road section includes the latitude and longitude of the target road section and the identifier of the target road section.
[0074] In one example, the server acquiring the location information of the target road segment includes: the server receiving input longitude and latitude information of the target road segment.
[0075] In another example, the server obtaining the location information of the target road segment includes: inputting an identifier of the target road segment into the server, and the server obtaining the latitude and longitude of the target road segment from an electronic map containing latitude and longitude information based on the identifier of the target road segment. For example, if "Beijing-Shanghai Expressway" is input into the server, the server will find the latitude and longitude information of "Beijing-Shanghai Expressway" in the electronic map containing latitude and longitude information.
[0076] The server saves the target road section location information in a preset location information library. When the target road section location information is needed later, it can be directly read from the preset location information library without repeatedly entering or repeatedly searching for the target road section location information from the electronic map, thereby improving subsequent processing efficiency.
[0077] S101b: The server obtains XDR data of multiple terminals of the target base station according to the obtained target road section location information.
[0078] The multiple terminals of the target base station refer to terminals connected to the target base station.
[0079] A base station is a device built by an operator. The information of the base station can be stored in the operator's database. The information of the base station includes but is not limited to: the base station identification, the latitude and longitude of the base station, the identification of the terminal connected to the base station, and the XDR data of the terminal.
[0080] Since the location information of the target road section has been obtained in S101a, based on the location information of the target road section and the base station information in the operator database, the information of any target base station within the target road section and the XDR data of the terminal connected to the target base station can be obtained.
[0081] In an example, the operator database includes base stations 1-20, wherein the longitude and latitude of base stations 1-5 are within the location range of the target road section. Therefore, the target base station is any one of base stations 1-5.
[0082] In a possible implementation, the server periodically sends an instruction to the target base station to obtain XDR data of multiple terminals within the period.
[0083] In an example, base station 1-5 is a target base station, the cycle is set to 1 hour, and the server sends XDR data of multiple terminals connected to base station 1-5 every hour to base station 1-5.
[0084] In another possible implementation manner, the target base station periodically reports XDR data of multiple terminals of the target base station within the period to the server.
[0085] In an example, base station 1-5 is a target base station, and the period is set to 1 hour. Base station 1-5 reports XDR data of multiple terminals that have connected to the target base station within the hour to the server every 1 hour.
[0086] S101c: The server compares the location information of multiple terminals of the target base station with the location information of the target road section, and selects the target terminal from the multiple terminals.
[0087] The server determines whether the multiple terminals are within the target section range by comparing the terminal location information contained in the XDR data of the multiple terminals of the target base station obtained in S101b, and the location information of the target section queried from the preset location information library, and confirms the terminals within the target section range as the target terminals.
[0088] In one example, the target road section is the "Beijing-Shanghai Expressway", and the terminals of the target base station connected to the "Beijing-Shanghai Expressway" include terminal 1-terminal 30, among which the locations of terminal 1-terminal 20 are within the scope of the "Beijing-Shanghai Expressway", and terminal 21-terminal 30 are next to the "Beijing-Shanghai Expressway", so the target terminals are terminal 1-terminal 20.
[0089] In another example, the server obtains the running trajectories of the multiple terminals based on the location information of the multiple terminals, and confirms whether the multiple terminals are traveling on the target road section based on the running trajectories of the multiple terminals, thereby determining the target terminal.
[0090] S101d: The server obtains the XDR data of the target terminal.
[0091] Since the target terminal is determined in S101c, the server can determine the XDR data of the target terminal from the acquired XDR data of multiple terminals.
[0092] In the method shown in S101a-S101d, since the base station transmits wireless signals, some terminals are not within the target section but are connected to the base station of the target section. The XDR data of the terminals outside the target section will affect the accuracy of the method of the embodiment of the present application. Therefore, this step is to ensure that the XDR data of the selected terminal is the XDR data of the terminal within the target section, so as to improve the accuracy of the communication wave time slot ratio adjustment method of the embodiment of the present application.
[0093] The target terminal's network quality indicator in the target terminal's XDR data is determined based on the target terminal's call service data and the target terminal's traffic service data. Both the target terminal's call service data and the target terminal's traffic service data are data that can be directly obtained when the base station communicates with the terminal.
[0094] Specifically, the target terminal's network quality indicator UE_KQI in the XDR data, the target terminal's call service data K V and the traffic service data K of the target terminal D The following formula (1) is satisfied:
[0095] UE_KQI=W1 K V +W2 K D (1).
[0096] The above W1 and W2 are weight values, which can be set based on experience; the weight values are used to characterize the importance of call service data and traffic service data in network quality indicators.
[0097] In one example, the operator's database contains information about base stations on multiple road sections, and the information about each base station contains XDR data of multiple terminals in multiple time periods. The XDR data includes information such as: event type, time begin time for the terminal to connect to the base station, terminal number uid, cellular information cell of the connected base station, and network type net type of the connection. The server will obtain key time domain location information from the XDR data in the operator's database, such as: the identifier of the target terminal, the number of identifiers of the target terminal, the network quality indicator of the target terminal, the location information and time information of the target terminal, to form a five-tuple of information, and thus obtain the XDR data of the target terminal of the target base station of the target road section within the period, including the measurement data report (MR) (i.e., the network quality indicator of the target terminal).
[0098] The MR report is a report that can reflect the actual situation of the terminal's current wireless environment. The MR measurement results can truly evaluate the quality of the network environment.
[0099] S102: The server obtains a communication wave time slot ratio adjustment strategy based on the XDR data of the target terminal.
[0100] The communication wave time slot ratio adjustment strategy includes the communication wave time slot ratio, and the strategy is used to guide the target base station on how to adjust the communication wave time slot ratio.
[0101] Specifically, S102 includes S102a-S102b:
[0102] S102a: The server uses the target terminal identifier UE, the number of target terminal identifiers UN, and the target terminal network quality indicator UE_KQI included in the XDR data of the target terminal as the state value s[UE, UN, UE_KQI].
[0103] S102b: The server inputs the action set a, state value s, and reward return r as parameters of the Markov chain decision process into the deep reinforcement learning (deep Q-network, DQN) algorithm to obtain the communication wave time slot ratio adjustment strategy.
[0104] The action set a is a set of multiple flags, and each flag represents a communication wave time slot ratio adjustment strategy.
[0105] The Markov chain decision process consists of five elements, M =<s,a,p,r,γ> , s is the set of base station states, a is the set of actions, p is the transition probability function, r is the reward, and γ is the decay coefficient, where γ∈[0,1] is used to penalize future rewards. The transition probability function p records the probability of executing action a in state s and entering the next state s to obtain reward r.
[0106] In an example, the action set a = {0, 1, 2, 3, 4, 5, 6, 7, 8}, 0 means that the time slot ratio of the perception function and the time slot of the communication function is 1:9, 1 means that the time slot ratio of the perception function and the time slot of the communication function is 2:8, 2 means that the time slot ratio of the perception function and the time slot of the communication function is 3:7, 3 means that the time slot ratio of the perception function and the time slot of the communication function is 4:6, 4 means that the time slot ratio of the perception function and the time slot of the communication function is 5:5, 5 means that the time slot ratio of the perception function and the time slot of the communication function is 6:4, 6 means that the time slot ratio of the perception function and the time slot of the communication function is 7:3, 7 means that the time slot ratio of the perception function and the time slot of the communication function is 8:2, and 8 means that the time slot ratio of the perception function and the time slot of the communication function is 9:1.
[0107] The reward return r is related to the network satisfaction index and radar performance index.
[0108] Specifically, the network satisfaction index sa satisfies formula (2), the radar performance index ra satisfies formula (3) and formula (5), and the reward return r satisfies formula (4).
[0109]
[0110]
[0111] r=10[αsa+(1-α)ra] (4),
[0112]
[0113] In formula (3) and formula (4), α is a coefficient set based on experience. A larger coefficient indicates that the communication function accounts for a higher proportion than the perception function, and the base station is primarily used for communication. In formula (5), RQI is a measure of the radar performance parameter - signal-to-noise ratio.
[0114] The DQN algorithm is a Q-Learning algorithm based on deep learning.
[0115] In one example, the synaesthesia base station selects and executes an action a based on the current state of the terminal, and then the environment moves to the next state s and feeds back a reward r to the synaesthesia base station. t is the current state, A t After obtaining the five elements of the Markov chain decision process for the action to be performed in the current state, they can be input into the Q-learning algorithm. In each iteration, the workflow of Q-learning is as follows:
[0116] Step 1: Initialize t=0.
[0117] Step 2: Start from the initial state S0.
[0118] Step 3: At time t, select an action based on the Q value: A t =argmax a∈A Q(s t ,a).
[0119] Step 4: Execute A t Then enter the next state S t+1 , and get R t+1 .
[0120] Step 5: Update the Q value function:
[0121] Q(S t ,A t )←Q(St ,A t )+β(R t+1 +γmax a∈AQ(S t+1 ,a)-Q(S t ,A t )).
[0122] Step 6: Set t=t+1 and return to step 3.
[0123] where β is the learning rate parameter.
[0124] The Q value is obtained by the Bellman equation, which can decompose the value function into the direct reward plus the decayed future reward:
[0125]
[0126] In one example, after using the above-mentioned S102a-S102b method, the server outputs an action in the action set a, for example, the server outputs 4, indicating that the communication wave time slot ratio adjustment strategy is: the time slot ratio of the perception function and the communication function is 5:5.
[0127] The data input into the DQN algorithm includes the number of target terminal identifiers and the network quality indicators of the target terminals. It can be seen from the input data that since the target base station has communication and perception functions, by analyzing the number of target terminal identifiers and the network quality indicators of the target terminals, it can be learned that when the number of target terminals is small, the communication demand is small, the network quality can be reduced, and the perception function can be improved. At this time, the time slot ratio of the perception function of the target base station can be increased; when the number of target terminals is large, the communication demand is large, the network quality can be improved, the perception function can be reduced, and the time slot ratio of the communication function of the target base station can be increased.
[0128] S103: The server sends a control signal to the target base station.
[0129] Among them, the control signal is used to control the target base station to adjust the time slot ratio of the communication wave based on the communication wave time slot ratio adjustment strategy; the time slot of the communication wave includes the time slot of the perception function and the time slot of the communication function.
[0130] In a possible implementation manner, the server sending a control signal to the target base station includes: the server first sends a control signal to the target base station. Figure 1The gateway shown sends a radio resource control protocol (RRC) signaling, which includes a communication wave time slot ratio adjustment strategy. After receiving the RRC signaling, the gateway obtains the communication wave time slot ratio adjustment strategy and sends an address resolution protocol (ARP) message including the communication wave time slot ratio adjustment strategy to the target base station. After receiving the ARP message, the target base station sends the time slot ratio to the physical downlink shared channel (PDSCH) to complete the time slot ratio adjustment of the communication wave perception function and the communication function.
[0131] It is understood that in S102, when the target road segment includes multiple target base stations, if the server obtains the XDR data of the target terminal of each target base station, it will obtain the corresponding communication wave time slot ratio adjustment strategy for each target base station. Therefore, in S103, the server sends a control signal containing the communication wave time slot ratio adjustment strategy to each target base station, thereby adjusting the time slot ratio of the sensing function and the communication function of each base station.
[0132] In a method for adjusting the time slot ratio of communication waves proposed in an embodiment of the present application, after a server obtains XDR data from a target terminal of a target base station, it analyzes the XDR data to obtain a communication wave time slot ratio adjustment strategy, and controls the target base station to adjust the communication wave time slots. It is understood that in this method, the server can obtain the XDR data of the target terminal in real time, and the time slot ratio of the perception function and the communication function in the frame structure of the communication wave is flexibly adjusted based on the XDR data of the target terminal, thereby balancing the perception function and the communication function of the target base station. Therefore, the method of the embodiment of the present application is highly flexible, not easily affected by external interference, and can be applied and promoted in the field of telepathy integration technology.
[0133] The above mainly introduces the solution provided by the embodiment of the present application from the perspective of the method. In order to realize the above functions, it includes hardware structures and / or software modules corresponding to the execution of each function. It should be easy to realize that the technical goals in this field are combined with the units and algorithm steps of each example described in the embodiments disclosed herein, and the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional technical goals can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0134] The embodiment of the present application further provides a communication wave time slot ratio adjustment device 200, for example Figure 2 The server shown. Figure 6 , which is a structural diagram of a communication wave time slot ratio adjustment device 200 provided in an embodiment of the present application.
[0135] Among them, the communication wave time slot ratio adjustment device 200 includes: an acquisition unit 201, used to obtain the XDR data of the target terminal of the target base station; wherein, the target base station is any base station within the target section; the target terminal is a terminal connected to the target base station within the target section; a processing unit 202, used to obtain a communication wave time slot ratio adjustment strategy based on the XDR data of the target terminal; a sending unit 203, used to send a control signal to the target base station; wherein the control signal is used to control the target base station to adjust the time slot ratio of the communication wave based on the communication wave time slot ratio adjustment strategy; the time slot of the communication wave includes the time slot of the perception function and the time slot of the communication function.
[0136] Optionally, the XDR data includes the location information of the terminal; the acquisition unit 201 is specifically used to obtain the XDR data of multiple terminals of the target base station; wherein the multiple terminals of the target base station are terminals that have been connected to the target base station; the processing unit 202 is also used to compare the location information of the multiple terminals of the target base station with the location information of the target road section, and select the target terminal from the multiple terminals; and obtain the XDR data of the target terminal.
[0137] Optionally, the acquiring unit 201 is further configured to acquire the location information of the target road section before acquiring the XDR data of the multiple terminals of the target base station; wherein the location information of the target road section is stored in a preset location information database.
[0138] Optionally, the network quality indicator of the target terminal is determined based on the call service data of the target terminal and the traffic service data of the target terminal.
[0139] Optionally, the target terminal's network quality indicator UE_KQI, the target terminal's call service data KV, and the target terminal's traffic service data KD satisfy the following formula: UE_KQI = W1 KV + W2 KD; W1 is used to characterize the importance of call service data in the network quality indicator, and W2 is used to characterize the importance of traffic service data in the network quality indicator.
[0140] Optionally, the XDR data of the target terminal also includes: the identifier of the target terminal, the number of identifiers of the target terminal and the network quality indicator of the target terminal. The processing unit 202 is specifically used to use the identifier of the target terminal UE, the number of identifiers of the target terminal UN and the network quality indicator UE_KQI of the target terminal included in the XDR data of the target terminal as the state value s[UE, UN, UE_KQI]; input the action set a, the state value s and the reward return r as parameters of the Markov chain decision process into the DQN algorithm to obtain the communication wave time slot ratio adjustment strategy; wherein the action set a is a collection of multiple flags, each flag represents a communication wave time slot ratio adjustment strategy; the reward return r is related to the network satisfaction index and the radar performance index.
[0141] Optionally, the target algorithm includes a deep reinforcement learning DQN algorithm.
[0142] Optionally, the action set a = {0, 1, 2, 3, 4, 5, 6, 7, 8}, where 0 indicates that the ratio of the time slot of the perception function to the time slot of the communication function is 1:9, 1 indicates that the ratio of the time slot of the perception function to the time slot of the communication function is 2:8, 2 indicates that the ratio of the time slot of the perception function to the time slot of the communication function is 3:7, 3 indicates that the ratio of the time slot of the perception function to the time slot of the communication function is 4:6, 4 indicates that the ratio of the time slot of the perception function to the time slot of the communication function is 5:5, 5 indicates that the ratio of the time slot of the perception function to the time slot of the communication function is 6:4, 6 indicates that the ratio of the time slot of the perception function to the time slot of the communication function is 7:3, 7 indicates that the ratio of the time slot of the perception function to the time slot of the communication function is 8:2, and 8 indicates that the ratio of the time slot of the perception function to the time slot of the communication function is 9:1; Network satisfaction index Radar performance indicators RQI represents the signal-to-noise ratio, and the reward is r=10[αsa+(1-α)ra].
[0143] Optionally, the communication wave includes an OFDM communication wave.
[0144] Optionally, the XDR data of the target terminal further includes time information of the target terminal. The acquiring unit 201 is specifically configured to periodically acquire the XDR data of the target terminal of the target base station based on the time information of the target terminal.
[0145] Of course, the communication wave time slot ratio adjustment device 200 provided in the embodiment of the present application includes but is not limited to the above modules.
[0146] Figure 7 : is a schematic diagram of the structure of the communication wave time slot ratio adjustment device 300 provided in an embodiment of the present application. The communication wave time slot ratio adjustment device 300 can be a computing device such as a server, a tablet computer, a desktop, a laptop, a notebook computer, and a netbook. Figure 7As shown, the communication wave time slot ratio adjustment device 300 includes a processor 301, a memory 302 and a network interface 303.
[0147] The processor 301 includes one or more CPUs, which may be single-core CPUs or multi-core CPUs.
[0148] The memory 302 includes, but is not limited to, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), flash memory, or optical storage.
[0149] Optionally, the processor 301 implements the communication wave time slot ratio adjustment method provided in the embodiment of the present application by reading instructions stored in the memory 302, or the processor 301 implements the communication wave time slot ratio adjustment method provided in the embodiment of the present application by internally stored instructions. In the case where the processor 301 implements the method in the above embodiment by reading instructions stored in the memory 302, the memory 302 stores instructions for implementing the communication wave time slot ratio adjustment method provided in the embodiment of the present application.
[0150] Network interface 303, a device comprising a transmitter and a receiver, is used to communicate with other devices or a communication network. It can be a wired interface (port), such as a fiber distributed data interface (FDDI) or a gigabit Ethernet (GE) interface. Alternatively, network interface 303 can be a wireless interface. It should be understood that network interface 303 includes multiple physical ports and is used for communication, etc.
[0151] Optionally, the communication wave time slot ratio adjustment device further includes a bus 304 , and the processor 301 , memory 302 , and network interface 303 are usually interconnected via the bus 304 , or are connected to each other in other ways.
[0152] In actual implementation, the acquisition unit 201, the processing unit 202 and the sending unit 203 can be implemented by the processor calling the computer program code in the memory. The specific execution process can be referred to the description of the method part above, which will not be repeated here.
[0153] Another embodiment of the present application provides a device for adjusting the time slot ratio of communication waves, comprising a memory and a processor. The memory and the processor are coupled; the memory is configured to store computer program code, which includes computer instructions. When the processor executes the computer instructions, the device for adjusting the time slot ratio of communication waves performs the steps of the method for adjusting the time slot ratio of communication waves described in the above-described method embodiment.
[0154] Another embodiment of the present application also provides a computer-readable storage medium, which stores computer instructions. When the computer instructions are executed on the communication wave time slot ratio adjustment device, the communication wave time slot ratio adjustment device executes each step executed by the communication wave time slot ratio adjustment device in the communication wave time slot ratio adjustment method process shown in the above method embodiment.
[0155] Another embodiment of the present application provides a chip system for use in a communication wave time slot ratio adjustment device. The chip system includes one or more interface circuits and one or more processors. The interface circuits and processors are interconnected via circuits. The interface circuits are configured to receive signals from a memory of the communication wave time slot ratio adjustment device and send signals to the processors, the signals including computer instructions stored in the memory. When the processors execute the computer instructions, the communication wave time slot ratio adjustment device performs each step of the communication wave time slot ratio adjustment method flow diagram described in the above method embodiment.
[0156] In another embodiment of the present application, a computer program product is also provided, which includes computer instructions. When the computer instructions are run on the communication wave time slot ratio adjustment device, the communication wave time slot ratio adjustment device executes each step executed by the communication wave time slot ratio adjustment device in the communication wave time slot ratio adjustment method process shown in the above method embodiment.
[0157] The above embodiments can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using a software program, the above embodiments can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer-executable instructions are loaded and executed on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, a server, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more media integrated therein. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a DVD), or a semiconductor medium (eg, a solid state disk (SSD)).
[0158] The above is only a specific embodiment of the present application. Those skilled in the art may conceive of changes or substitutions based on the specific embodiment provided in this application, and all such changes or substitutions shall fall within the scope of protection of this application.
Claims
1. A method for adjusting the time slot ratio of communication waves, characterized in that: The method comprises: Acquire XDR data of a target terminal of a target base station; wherein the target base station is any base station in a target road section; and the target terminal is a terminal connected to the target base station in the target road section; Based on the XDR data of the target terminal, a communication wave time slot ratio adjustment strategy is obtained; A control signal is sent to the target base station; wherein the control signal is used to control the target base station to adjust the time slot ratio of the communication wave based on the communication wave time slot ratio adjustment strategy; the time slot of the communication wave includes the time slot of the perception function and the time slot of the communication function.
2. The method according to claim 1, characterized in that The XDR data includes the location information of the terminal; and obtaining the XDR data of the target terminal of the target base station includes: Acquire XDR data of multiple terminals of the target base station; wherein the multiple terminals of the target base station are terminals that have been connected to the target base station; comparing the location information of multiple terminals of the target base station with the location information of the target road section, and selecting the target terminal from the multiple terminals; Acquire XDR data of the target terminal.
3. The method according to claim 2, characterized in that Before acquiring XDR data of multiple terminals of the target base station, the method further includes: Acquire the location information of the target road section; wherein the location information of the target road section is stored in a preset location information library.
4. The method according to claim 1, wherein The network quality indicator of the target terminal is determined based on the call service data of the target terminal and the flow service data of the target terminal.
5. The method according to claim 4, characterized in that The network quality indicator UE_KQI of the target terminal, the call service data K V and the traffic service data K of the target terminal D The following formula is satisfied: UE_KQI=W1 K V +W2 K D ; The W1 is used to characterize the importance of the call service data in the network quality index, and the W2 is used to characterize the importance of the traffic service data in the network quality index.
6. The method according to claim 1, characterized in that The XDR data of the target terminal also includes: the identifier of the target terminal, the number of the identifiers of the target terminal, and the network quality indicator of the target terminal; and obtaining the communication wave time slot ratio adjustment strategy based on the XDR data of the target terminal includes: Using the target terminal identifier UE, the number of target terminal identifiers UN, and the network quality indicator UE_KQI of the target terminal included in the XDR data of the target terminal as the state value s[UE, UN, UE_KQI]; The action set a, the state value s, and the reward return r are input into the target algorithm as parameters of the Markov chain decision process to obtain the communication wave time slot ratio adjustment strategy; wherein the action set a is a collection of multiple flags, each flag represents a communication wave time slot ratio adjustment strategy; the reward return r is related to the network satisfaction index and the radar performance index.
7. The method according to claim 6, characterized in that The target algorithm includes a deep reinforcement learning DQN algorithm.
8. The method according to claim 6, characterized in that The action set a={0, 1, 2, 3, 4, 5, 6, 7, 8}, where 0 indicates that the ratio of the time slot of the perception function to the time slot of the communication function is 1:9, 1 indicates that the ratio of the time slot of the perception function to the time slot of the communication function is 2:8, 2 indicates that the ratio of the time slot of the perception function to the time slot of the communication function is 3:7, 3 indicates that the ratio of the time slot of the perception function to the time slot of the communication function is 4:6, 4 indicates that the ratio of the time slot of the perception function to the time slot of the communication function is 5:5, 5 indicates that the ratio of the time slot of the perception function to the time slot of the communication function is 6:4, 6 indicates that the ratio of the time slot of the perception function to the time slot of the communication function is 7:3, 7 indicates that the ratio of the time slot of the perception function to the time slot of the communication function is 8:2, and 8 indicates that the ratio of the time slot of the perception function to the time slot of the communication function is 9:1; The network satisfaction index The radar performance indicators The RQI represents the signal-to-noise ratio, and the reward return r=10[αsa+(1-α)ra].
9. The method according to claim 1, characterized in that The communication wave includes an Orthogonal Frequency Division Multiplexing (OFDM) communication wave.
10. The method according to claim 1, characterized in that The XDR data of the target terminal also includes time information of the target terminal, and acquiring the XDR data of the target terminal of the target base station includes: Based on the time information of the target terminal, XDR data of the target terminal of the target base station is periodically acquired.
11. A communication wave time slot ratio adjustment device, characterized in that: It includes a memory and a processor; the memory and the processor are coupled; the memory is used to store computer program code, and the computer program code includes computer instructions; wherein, when the processor executes the computer instructions, the communication wave time slot ratio adjustment device executes the communication wave time slot ratio adjustment method as described in any one of claims 1 to 10.
12. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer instructions; wherein, when the computer instructions are executed on the communication wave time slot ratio adjustment device, the communication wave time slot ratio adjustment device executes the communication wave time slot ratio adjustment method according to any one of claims 1 to 10.
Citation Information
Patent Citations
Communication method and device of communication and sensing integrated system, and storage medium
CN115665875A
Safety beam forming method and device based on reinforcement learning, medium and equipment
CN116054896A