Environmental perception method in digital twin Internet of Vehicles based on communication and inductance integration

By adopting synesthesia integrated digital twin vehicle networking method in the Internet of Vehicles, and using the collaborative processing of RSU and SeV, the problems of data transmission delay and resource occupation in the traditional method are solved, efficient environmental perception is achieved, and spectrum is reduced Resource consumption and delay.

CN118984319AActive Publication Date: 2024-11-19CHONGQING UNIV OF POSTS & TELECOMM
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202411091389.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-09
Publication Date
2024-11-19
Estimated Expiration
2044-08-09

AI Technical Summary

Technical Problem

In the Internet of Vehicles, the traditional collaboration process requires passing a large amount of input data between edge servers, resulting in large occupation of communication resources and delays exceeding the tolerance range, which has limitations.

Method used

Adopt the digital twin vehicle networking method based on synesthesia integration, and launch environment-aware tasks through vehicles and forward task instructions to the RSU with the richest communication resources. Combined with the digital twin system to make collaborative decisions, split the tasks and allocate them to good service status. RSU and SeV cooperate to obtain the required resources using ISAC or InsT mode to reduce data transmission.

Benefits of technology

While ensuring perceptual accuracy, spectrum resources and energy consumption are saved, task collaboration delays are significantly reduced, and data transmission bottlenecks are avoided in traditional methods.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118984319A_ABST
    Figure CN118984319A_ABST
Patent Text Reader

Abstract

The invention relates to an environment sensing method in a digital twinning Internet of Vehicles based on communication and sensing integration, belongs to the technical field of communication, and provides a digital twinning communication and sensing integrated environment collaboration sensing method which is characterized in that a digital twinning system can make edge collaboration decisions according to task requirements and available resources; a communication and sensing integrated mode or an environment sensing instruction mode is selected; the mechanism has two cooperation modes, and if the sensing integrated mode ISAC is selected, the RSU can use the sensing integrated wave beam to sense environment data. On the contrary, if the environment sensing instruction mode InsT is selected, after the RSU receives the task instruction from the virtual control unit, since the environment data is cached locally, only the environment data needs to be preprocessed, namely view angle conversion is carried out.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the field of communication technology and relates to an environment perception method in a digital twin vehicle network based on synaesthesia integration. Background Art

[0002] With the development of autonomous driving based on AR or tactile Internet technology, future vehicles will be equipped with many sensors to collect environmental data, such as a sufficient number of cameras and LIDAR. This computationally intensive service demand usually requires 3D reconstruction technologies such as depth map fusion. In fact, similar environmental data can be obtained from neighboring sensor-equipped RSUs. In addition, similar environmental data can also be obtained from various sensor-equipped SeVs within the coverage area of ​​the RSU. Due to the different perspectives of the RSUs, it is necessary to perform coordinate transformation preprocessing using the coordinates of the TaV contained in the calculation instructions to eliminate the differences between the perceived environmental data. The size of the calculation instruction is much smaller than the original sensor input data, and the corresponding transmission delay will also be greatly reduced. Therefore, due to the collaboration of the original sensor data transmission and the instruction transmission, it provides new possibilities for reducing the overall delay. In the traditional collaboration process, a large amount of input data needs to be transmitted between edge servers, which not only occupies a large amount of communication resources, but also exceeds the tolerance range of the delay, and has certain limitations. Summary of the invention

[0003] In view of this, the purpose of the present invention is to provide an environmental perception method in a digital twin vehicle network based on synaesthesia integration. Combining the characteristics of the communication and perception integration system, an environmental perception method suitable for the vehicle network is proposed, which saves a lot of spectrum resources and energy consumption while ensuring the perception accuracy, and reduces the task collaboration delay.

[0004] In order to achieve the above object, the present invention provides the following technical solutions:

[0005] A method for environmental perception in a digital twin vehicle network based on synaesthesia integration includes the following steps:

[0006] S1: The vehicle initiates an environmental perception task, forwards the task instruction to the RSU with the most abundant communication resources when the channel threshold coefficient is met, and calculates the task transmission duration;

[0007] S2: Based on the received task instructions, the digital twin system DT combines some information delivered periodically by the RSU and makes collaborative decisions on the premise of meeting the QoE requirements; the collaborative decisions include task ratio, wireless bandwidth ratio and adaptive transmission strategy;

[0008] S3: The digital twin system checks the real-time status of the edge server RSU, selects the RSU with good service status as the collaboration node, splits the complex task into subtasks and assigns them to the collaboration node. The collaboration node selects the nearby service vehicle SeV through the edge selection strategy for vehicle-road collaborative perception;

[0009] S4: If the data required for the task is not cached locally, RSU j uses the ISAC mode to sense and obtain the resources required for processing the task. Otherwise, it uses the environment perception instruction mode InsT. For the ISAC mode, multi-target sensing and multi-stream communication are performed simultaneously to obtain the environmental data required for processing the task. For the InsT mode, only the locally cached data needs to be preprocessed, that is, the perspective is transformed. The time for data processing depends on the size of the instruction and the coordinate transformation.

[0010] Further, step S1 specifically includes the following steps:

[0011] S11: Use binary numbers v,m To indicate whether the vehicle and RSU m can establish a reliable communication connection, define h v,m is the channel threshold coefficient, then:

[0012]

[0013] h v,m represents the channel threshold coefficient;

[0014] S12: Let the set of RSUs that satisfy the channel threshold coefficient be Φ = {φ1, φ2, ..., φ c}, where c represents the number of RSUs that meet the channel threshold coefficient; when the channel threshold coefficient is met, the digital twin system DT allocates the RSU with the richest communication resources to the vehicle for access, and this RSU is represented by k:

[0015]

[0016] in They respectively represent the real-time communication resources of RSU that meet the channel threshold coefficient.

[0017] S13: The task instruction only contains the input data size, computational intensity, and QoE requirements; the channel rate from the task vehicle to the RSU is as follows:

[0018]

[0019] where zk1(t) is the bandwidth allocated to vehicle by RSU k, pv,k represents the transmission power of the vehicle, and σ 2 represents the noise power, represents the complex channel fading coefficient, is the path loss, α is the path loss exponent, d v,k (t) represents the time-varying distance between the vehicle and RSU k during the mission initiation period;

[0020] S14: The time required for the task instruction to be unloaded from the vehicle to RSU k is expressed as:

[0021]

[0022] D v Represents the data size of the task instruction, R v,k represent.

[0023] Further, the step S3 specifically includes the following steps:

[0024] S31: DT generates corresponding decisions according to the requirements of the task vehicle, adaptively divides the task into subtasks, and distributes the subtasks to the service vehicle SeV and RSU for collaborative processing. The SeVs participating in the collaboration constitute the set Ι={1,2,...,i,...,I}; the RSUs participating in the collaboration constitute the set ={1,2,...,j,...,J};

[0025] S32: The process of allocating tasks is to first deliver them to the relatively idle RSU nodes, and then the RSU delivers them to the nearby computing vehicles SeV i; binary numbers are used represents the edge selection strategy of nearby SeV, which is specifically expressed as It means that SeV i is currently busy with business and has not chosen to participate in the collaborative computing task; It means that SeV i chooses to participate in the collaborative computing task and receives relevant task parameters and data required for processing the task from the nearby RSU; assuming that each RSU can be at most M max SeV delivery mission, thus obtained Each SeV selects at most one RSU for the receiving task, that is

[0026] Further, step S4 specifically includes the following steps:

[0027] S41: Assumption Task D task It is divided into n parts by RSU j, and the ratio coefficient of each subtask to the total task is α j ,satisfy If the data required for the task is not cached locally, RSU j uses the ISAC mode to sense and obtain the resources required to process the task. Otherwise, it uses the InsT mode. Define the binary number x j To indicate whether the indispensable data is cached in the edge server corresponding to RSU j;

[0028] S42: Calculate the task upload delay of two parallel collaboration modes, ISAC and InsT, in turn;

[0029] S43: If the ISAC cooperative mode is selected, it consists of an RSU equipped with N antennas and i mission vehicles, each vehicle has M antennas, where IM≤N; the range of interest ROI includes the target sensing area and the interference area, which are divided into cubes of equal size, each cube represents a pixel point; there are O clutters as interference in the interference range around the target; there are two basic tasks in the vehicle-road cooperative wireless network, namely target perception and information communication, which are completed by multiple mission vehicles and multi-antenna RSUs in collaboration;

[0030] S44: When the RSU obtains similar environmental data and has cached it in the corresponding edge server, the InsT mode is selected, and the matrix operation of the task vehicle coordinates contained in the calculation instruction is used to transform the coordinates of the environmental data perceived by the RSU, and then the RSU uses the environmental data perceived by itself to perform the subtask.

[0031] Further, step S43 specifically includes the following steps:

[0032] Establish the i-th vehicle superimposed coded transmission signal, assuming that the i-th vehicle constructs the sensing signal To perceive p targets in the target area and generate data As a communication signal to transmit information in each time slot, the specific description is as follows:

[0033]

[0034]

[0035] in Indicates perception, means communication, are transmit beamforming vectors for corresponding sensing signals and communication signals, respectively;

[0036] For the receiving signal of RSU, the details are as follows:

[0037]

[0038] in, Indicates perception, Indicates clutter interference, represents communication, n is the additive white Gaussian noise AWGN vector, as well as are the reflection coefficients of the pth target and the Oth clutter respectively; represents the cascade channel, where g i,p and g′ i,p are the channel gains from the i-th service vehicle to the p-th target and from the p-th target to the RSU, respectively; represents the cascade channel, where f i,o and f i ' ,o are the channel gains from the i-th service vehicle to the O-th clutter and from the O-th clutter to the RSU, respectively; is the channel gain from the i-th service vehicle to the RSU; assuming G i,p ,F i,o ,H i Remains constant within a time slot, but fades independently across time slots;

[0039] A linear unbiased estimator is deployed at the RSU to estimate the reflection coefficient of the target; in order to obtain accurate reflection coefficients for target sensing The RSU performs receive beamforming to enhance the desired signal and suppress co-channel interference;

[0040] The mean square error (MSE) is used as the performance indicator of target perception to minimize the difference between the estimated reflection coefficient and the actual reflection coefficient to suppress interference from other signals, where the estimated reflection coefficient of the pth target is It is expressed as:

[0041]

[0042] in is the sensing receiving beamforming vector adopted at the RSU for the pth target; after the relevant parameters are estimated, the mean square error MSE is used as the performance indicator of target perception; the estimated reflection coefficient is minimized and the actual reflection coefficient z j1 to suppress interference from other signals:

[0043]

[0044] in, is the noise power, R m is the reflection coefficient According to the root mean square value RMS of the prior probability of occurrence of each type;

[0045] The RSU performs responsive receive beamforming to mitigate interference. The received signal is given by:

[0046]

[0047] in is the communication receiving beamforming vector of the lth communication signal from the i-th service vehicle, and The associated signal-to-interference-plus-noise ratio SINR is expressed as:

[0048]

[0049] in

[0050]

[0051] So as to obtain the communication delay:

[0052]

[0053] z i1 (t) represents the bandwidth allocated to SeV i channel, and α i represents the task data transmission coefficient of each service vehicle, and The upload delay at this stage is obtained as That is, set the deadline for uploading the data required for the processing task to be t max ,when When , RSU chooses not to wait for the SeV any longer and directly processes the task.

[0054] Further, in step S44, the RSU caches the offloading decision to sense and preprocess the corresponding environmental data; In the case of InsT, the upload time of the service vehicle depends on the coordinate transformation time. Assuming that the service vehicle has been sensing the environmental data, the coordinate transformation is performed immediately after receiving the calculation instruction. The transformation time depends on the amount of sensed data, and the execution time depends on the computing power of the edge server corresponding to RSUj and the CPU cycle required for the subtask:

[0055]

[0056] Among them, M inst represents the computational intensity of coordinate transformation, z j2 (t) represents the calculation rate of RSU;

[0057] In summary, the time required for step S44 is expressed as:

[0058]

[0059] When executing the environmental perception task initiated by the vehicle, according to the established task processing flow, the total time required is expressed as:

[0060]

[0061] The beneficial effect of the present invention is that in the traditional collaboration process, a large amount of input data needs to be transmitted between edge servers, which not only takes up a large amount of communication resources, but also exceeds the tolerance range of delay, and has certain limitations. Therefore, the RSU and service vehicle in this article can be regarded as ISAC nodes. RSUs and service vehicles equipped with sensors have the ability to obtain environmental information. Adjacent RSUs can collect similar sensory environmental data. In this case, adjacent edge nodes do not need to transmit a large amount of input data, but upload computing instructions, which will greatly reduce the transmission time.

[0062] Other advantages, objectives and features of the present invention will be described in the following description to some extent, and to some extent, will be obvious to those skilled in the art based on the following examination and study, or can be taught from the practice of the present invention. The objectives and other advantages of the present invention can be realized and obtained through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] In order to make the purpose, technical solutions and advantages of the present invention more clear, the present invention will be described in detail below in conjunction with the accompanying drawings, wherein:

[0064] Figure 1 A schematic diagram of a digital twin-assisted Internet of Vehicles edge collaboration scenario in the method of the present invention;

[0065] Figure 2 It is a schematic diagram of the edge collaboration process in the method of the present invention;

[0066] Figure 3 It is a schematic diagram of the synaesthesia integrated environment perception mode in the method of the present invention. DETAILED DESCRIPTION

[0067] The following describes the embodiments of the present invention by specific examples, and those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present invention. It should be noted that the illustrations provided in the following embodiments only illustrate the basic concept of the present invention in a schematic manner, and the following embodiments and features in the embodiments can be combined with each other without conflict.

[0068] It should be noted that the illustrations provided in the following embodiments are only schematic illustrations of the basic concept of the present invention, and thus the drawings only show components related to the present invention rather than being drawn according to the number, shape and size of components in actual implementation. In actual implementation, the type, quantity and proportion of each component may be changed arbitrarily, and the component layout may also be more complicated.

[0069] In the following description, numerous details are discussed to provide a more thorough explanation of the embodiments of the present invention. However, it is obvious to those skilled in the art that the embodiments of the present invention can be implemented without these specific details. In other embodiments, well-known structures and devices are shown in the form of block diagrams rather than in detail to avoid making the embodiments of the present invention difficult to understand.

[0070] like Figure 1-3 As shown, the present invention provides an environment perception method in a digital twin vehicle network based on synaesthesia integration, comprising the following steps:

[0071] Step 1: The vehicle initiates a computing task and forwards its instructions to the RSU with the most abundant communication resources, including the size of the input data, the computing intensity (i.e., the total number of CPU cycles of the computing task), and the QoE requirements; the task transmission duration in the collaborative sensing process is solved, including the following steps:

[0072] Step 1: The mission vehicle will upload the mission command to any RSU within the connection range. In order to reduce transmission delay, the vehicle tends to select the RSU with the best communication status with the help of Digital Twin (DT). To ensure this, a binary number con v,m To indicate whether the vehicle and RSU m can establish a reliable communication connection; define h v,m is the channel threshold coefficient, then

[0073]

[0074] Step 2: Assume that the number of RSUs that meet the above requirements in the system is c, which together form a new set Φ = {φ1, φ2, ..., φ c In addition, the bandwidth resources allocated by RSU to the vehicle is another important factor affecting the transmission time. Therefore, in order to further reduce the transmission time, when the channel threshold coefficient is met, DT tends to allocate the RSU with the richest communication resources to the vehicle access after querying the internal data, and the expression of RSU k can be obtained:

[0075]

[0076] Step 3: Unlike previous offloading methods, this collaborative process only requires the transmission of task instructions. In fact, the task instructions only include the input data size, computing intensity (i.e., the total number of CPU cycles for computing the task), and QoE requirements. However, in certain environments, such as systems with extremely high real-time requirements or scenarios that are extremely sensitive to network transmission speeds, this means that the time required to transmit the task must be included in the overall response delay. The channel rate from the task vehicle to the RSU is as follows:

[0077]

[0078] where z k1 (t) is the bandwidth allocated to the vehicle by RSU k, pv,k represents the transmission power of the vehicle, σ 2 Represents the noise power. represents the complex channel fading coefficient, is the path loss, α is the path loss exponent, d v,k (t) represents the time-varying distance between the vehicle and RSU k during the mission initiation period. The time required for the mission instruction to be unloaded from the vehicle to RSU k is expressed as:

[0079]

[0080] D v Represents the data size of the task instruction.

[0081] Step 2: Based on the received task instructions, the digital twin system combines some information (i.e., mobile speed, location, computing power, wireless transmission capacity, etc.) delivered regularly by the RSU and makes an offloading decision under the premise of meeting the QoE requirements. The offloading decision includes task ratio, wireless bandwidth ratio, and adaptive transmission strategy (i.e., ISAC or InsT), etc.

[0082] Step 3: The digital twin system checks the real-time edge server status, selects nodes with good service status, splits complex tasks into subtasks and assigns them to collaborative nodes. The collaborative nodes select nearby SeVs for vehicle-road collaborative perception through edge selection strategies, including the following steps:

[0083] Step 1: DT generates corresponding decisions according to the requirements of the task vehicle, adaptively divides the task into subtasks and distributes the subtasks to SeV (service vehicle) and RSU for collaborative processing. The SeVs participating in the collaboration constitute the set Ι = {1, 2, ..., i, ..., I}. The RSUs participating in the collaboration constitute the set J = {1, 2, ..., j, ..., J}.

[0084] Step 2: Take a binary number represents the edge selection strategy of nearby SeV, which is specifically expressed as It means that SeV i is currently busy with business and does not choose to participate in collaborative computing tasks; on the contrary, It means that SeV i chooses to participate in the collaborative computing task and receives relevant task parameters and data required for processing the task from nearby RSUs. Assume that each RSU can be at most M max SeV delivery mission, thus we can get Similarly, each SeV selects at most one RSU for the receiving task, i.e.

[0085] Step 4: If the data required for the task is not cached locally, RSU j can sense it through the ISAC mode to obtain the resources required to process the task. Otherwise, the InsT mode is used. For the ISAC mode, multi-target sensing and multi-stream communication are performed simultaneously to obtain the environmental data required for processing the task. For the InsT mode, only the locally cached data needs to be preprocessed, that is, the perspective is transformed. The time for data processing depends on the size of the instruction and the coordinate transformation. Specifically, the following steps are included:

[0086] Step 1: Only with the support of corresponding data can this task be successfully completed. Assume that Task D task It is divided into n parts by RSUj. The ratio coefficient of each subtask to the total task is α j ,satisfy If the data required for the task is not cached locally, RSU j can sense it through the ISAC mode to obtain the resources required to process the task. Otherwise, the InsT mode is used. Define the binary number x j To indicate whether the indispensable data is cached in the edge server corresponding to RSU j;

[0087] Step 2: Calculate the task upload latency of the two parallel collaboration modes, ISAC and InsT, in turn;

[0088] Step 3: Synaesthesia integrated environmental perception mode Figure 3 shown.

[0089] If the ISAC collaborative mode is selected, it consists of an RSU equipped with N antennas and i mission vehicles, each vehicle has M antennas, where IM≤N. The range of interest (ROI), including the target sensing area and the interference area, is divided into cubes of equal size, each cube represents a pixel. Without loss of generality, there are O clutters as interference in the interference range around the target. There are two basic tasks in the vehicle-road cooperative wireless network, namely target perception and information communication, which are completed collaboratively by multiple mission vehicles and multi-antenna RSUs;

[0090] Establish the i-th vehicle superimposed coded transmission signal, assuming that the i-th vehicle constructs the sensing signal To perceive p targets in the target area and generate data As a communication signal to transmit information in each time slot, the specific description is as follows:

[0091]

[0092]

[0093] in, are the transmit beamforming vectors for the corresponding sensing signal and communication signal, respectively.

[0094] For the receiving signal of RSU, the details are as follows:

[0095]

[0096] Where n is the additive white Gaussian noise (AWGN) vector, as well as are the reflection coefficients of the pth target and the Oth clutter respectively. represents the cascade channel, where g i,p and g′ i,p are the channel gains from the i-th service vehicle to the p-th target and from the p-th target to the RSU, respectively. represents the cascade channel, where f i,o and f i ' ,o are the channel gains from the i-th service vehicle to the O-th clutter and from the O-th clutter to the RSU, respectively. In addition, is the channel gain from the i-th service vehicle to the RSU. Assume G i,p ,F i,o ,H i Remains constant within a time slot, but fades independently across time slots.

[0097] The above process can further effectively calculate the mean square error of target perception and the interference plus noise ratio of communication, and ensure that the delay of the corresponding mode is calculated under the condition of perception accuracy and communication quality.

[0098] To improve the accuracy of target sensing, all sensors collaborate to sense the target. Therefore, a linear unbiased estimator is deployed at the RSU to estimate the reflection coefficient of the target. In order to obtain accurate reflection coefficients for target sensing The RSU performs receive beamforming to enhance the desired signal and suppress co-channel interference.

[0099] After the relevant parameters are estimated, the mean square error (MSE) is used as the performance indicator of target perception. The difference between the estimated reflection coefficient and the actual reflection coefficient can be minimized to suppress interference from other signals and achieve high-precision target sensing. can be expressed as

[0100]

[0101] in is the sensing receive beamforming vector used for the pth target at the RSU. After the relevant parameter estimation, the mean square error (MSE) is used as the performance indicator of target perception. Not only is a function of , and is a function of other sensing signals and communication signals for different targets from different service vehicles. In this case, the estimated reflection coefficient can be minimized and the actual reflection coefficient z j1 The difference between them is used to suppress interference from other signals and achieve high-precision target sensing.

[0102]

[0103] in, is the noise power, R m is the reflection coefficient According to the root mean square value (RMS) of the prior probability of occurrence of each type,

[0104] Secondly, in order to improve the quality of the communication signal, the RSU performs response receive beamforming to mitigate interference. The received signal is given by:

[0105]

[0106] in is the communication receive beamforming vector of the lth communication signal from the i-th service vehicle. Since the received SINR determines the quality of the communication signal, it is usually considered as a performance metric for communication. The associated signal-to-interference-plus-noise ratio (SINR) can be expressed as

[0107]

[0108] in

[0109]

[0110] So as to obtain the communication delay

[0111]

[0112] z i1 (t) represents the bandwidth allocated to SeV i channel, and α i represents the task data transmission coefficient of each service vehicle, and The upload delay at this stage is obtained as That is, set the deadline for uploading the data required for the processing task to be t max ,when When , RSU chooses not to wait for the SeV any longer and directly processes the task.

[0113] Step 4: When the environment perception instruction cooperation mode is selected, the RSU obtains similar environment data and has been cached in the corresponding edge server, although the perspective is different. In order to eliminate the perspective difference and keep consistent with the input data obtained by the task vehicle, the environment data perceived by the RSU needs to be preprocessed first, that is, coordinate transformation. This can be achieved by using the matrix operation of the task vehicle coordinates contained in the calculation instruction, and then the RSU uses its own perceived environment data to perform the offload subtask. Not only that, the RSU can cache the offload decision to perceive and preprocess the corresponding environment data. In the case of InsT, the upload time of the service vehicle mainly depends on the coordinate transformation time. Assuming that the service vehicle has been sensing the environment data, the coordinate transformation can be performed immediately after receiving the calculation instruction. The conversion time depends on the amount of data sensed, which will be much less than the time required to upload the data. The time taken for execution depends on the computing power of the edge server coupled to RSU j and the CPU cycles required for the subtask.

[0114]

[0115] Among them, M inst represents the computational intensity of coordinate transformation, z j2 (t) represents the calculation rate of RSU.

[0116] In summary, the time required for this step can be listed as follows:

[0117] When executing the environmental perception task initiated by the vehicle, according to the established task processing flow, the total time required can be accurately expressed as:

[0118]

[0119] In the above embodiments, the description's reference to "this embodiment" indicates that a particular feature, structure, or characteristic described in conjunction with the embodiment is included in at least some embodiments, but not necessarily all embodiments. Multiple occurrences of "this embodiment" do not necessarily all refer to the same embodiment.

[0120] In the above-described embodiments, although the invention has been described in conjunction with specific embodiments of the invention, many substitutions, modifications, and variations of these embodiments will be apparent to those of ordinary skill in the art based on the foregoing description. For example, other storage structures (e.g., dynamic RAM (DRAM)) may use the embodiments discussed. Embodiments of the invention are intended to encompass all such substitutions, modifications, and variations that fall within the broad scope of the appended claims.

[0121] This embodiment further provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, any one of the methods in this embodiment is implemented.

[0122] This embodiment also provides an electronic terminal, including: a processor and a memory;

[0123] The memory is used to store a computer program, and the processor is used to execute the computer program stored in the memory, so that the terminal executes any one of the methods in this embodiment.

[0124] The computer-readable storage medium in this embodiment can be understood by ordinary technicians in this field: all or part of the steps of implementing the above-mentioned method embodiments can be completed by hardware related to the computer program. The aforementioned computer program can be stored in a computer-readable storage medium. When the program is executed, the steps of the above-mentioned method embodiments are executed; and the aforementioned storage medium includes: ROM, RAM, magnetic disk or optical disk and other media that can store program codes.

[0125] The electronic terminal provided in this embodiment includes a processor, a memory, a transceiver and a communication interface. The memory and the communication interface are connected to the processor and the transceiver and complete communication with each other. The memory is used to store computer programs, the communication interface is used to communicate, and the processor and the transceiver are used to run computer programs so that the electronic terminal executes each step of the above method.

[0126] In this embodiment, the memory may include a random access memory (RAM), and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

[0127] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

[0128] The present invention can be used in many general or special computing system environments or configurations, such as personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer electronic devices, network PCs, minicomputers, mainframe computers, distributed computing environments including any of the above systems or devices, and the like.

[0129] The present invention may be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The present invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules may be located in local and remote computer storage media, including storage devices.

[0130] Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solution of the present invention can be modified or replaced by equivalents without departing from the purpose and scope of the technical solution, which should be included in the scope of the claims of the present invention.

Claims

1. A method for environmental perception in a digital twin vehicle network based on synaesthesia integration, characterized by: The following steps are involved: S1: The vehicle initiates an environmental perception task, forwards the task instruction to the RSU with the most abundant communication resources when the channel threshold coefficient is met, and calculates the task transmission duration; S2: Based on the received task instructions, the digital twin system DT combines some information delivered periodically by the RSU and makes collaborative decisions on the premise of meeting the QoE requirements; the collaborative decisions include task ratio, wireless bandwidth ratio and adaptive transmission strategy; S3: The digital twin system checks the real-time RSU status, selects RSUs with good service status as collaboration nodes, splits complex tasks into subtasks and assigns them to collaboration nodes. The collaboration nodes select nearby service vehicles SeVs through edge selection strategies for vehicle-road collaborative perception. S4: If the data required for the task is not cached locally, RSU j uses ISAC to sense and obtain the resources required for processing the task, otherwise it uses the environment perception instruction mode InsT; For the ISAC mode, multi-target sensing and multi-stream communication are performed simultaneously to obtain the environmental data required for processing tasks; for the InsT mode, only the locally cached data needs to be preprocessed, that is, the perspective transformation; the data processing time depends on the size of the instruction and the coordinate transformation.

2. The method for environmental perception in a digital twin vehicle network based on synaesthesia integration according to claim 1 is characterized by: Step S1 specifically includes the following steps: S11: Use binary numbers v,m To indicate whether the vehicle and RSU m can establish a reliable communication connection: h v,m represents the channel threshold coefficient; S12: Let the set of RSUs that satisfy the channel threshold coefficient be Φ = {φ1, φ2, ..., φ c }, where c represents the number of RSUs that meet the channel threshold coefficient; when the channel threshold coefficient is met, the digital twin system DT allocates the RSU with the richest communication resources to the vehicle for access, and this RSU is represented by k: in They represent the real-time communication resources of RSU that meet the channel threshold coefficient respectively; S13: The task instruction only contains the input data size, computational intensity, and QoE requirements; the channel rate from the task vehicle to the RSU is as follows: where zk1(t) is the bandwidth allocated to vehicle by RSU k, pv,k represents the transmission power of the vehicle, and σ 2 represents the noise power, represents the complex channel fading coefficient, is the path loss, α is the path loss exponent, d v,k (t) represents the time-varying distance between the vehicle and RSU k during the mission initiation period; S14: The time required for the task instruction to be unloaded from the vehicle to RSU k is expressed as: D v Represents the data size of the task instruction, R v,k represent.

3. The method for environmental perception in a digital twin vehicle network based on synaesthesia integration according to claim 1 is characterized in that: The step S3 specifically comprises the following steps: S31: DT generates corresponding decisions according to the requirements of the task vehicle, adaptively divides the task into subtasks, and distributes the subtasks to the service vehicle SeV and RSU for collaborative processing. The SeVs participating in the collaboration constitute the set Ι={1,2,...,i,...,I}; the RSUs participating in the collaboration constitute the set J={1,2,...,j,...,J}; S32: The process of allocating tasks is to first deliver them to the relatively idle RSU nodes, and then the RSU delivers them to the nearby computing vehicles SeV i; binary numbers are used represents the edge selection strategy of nearby SeV, which is specifically expressed as It means that SeV i is currently busy with business and has not chosen to participate in the collaborative computing task; It means that SeV i chooses to participate in the collaborative computing task and receives relevant task parameters and data required for processing the task from the nearby RSU; assuming that each RSU can be at most M max SeV delivery mission, thus obtained Each SeV selects at most one RSU for the receiving task, that is 4. The method for environmental perception in a digital twin vehicle network based on synaesthesia integration according to claim 1 is characterized by: Step S4 The specific steps include: S41: Assumption Task D task It is divided into n parts by RSU j, and the ratio coefficient of each subtask to the total task is α j ,satisfy If the data required for the task is not cached locally, RSU j uses the ISAC mode to sense and obtain the resources required to process the task. Otherwise, it uses the InsT mode. Define the binary number x j To indicate whether the indispensable data is cached in the edge server corresponding to RSU j; S42: Calculate the task upload delay of two parallel collaboration modes, ISAC and InsT, in turn; S43: If the ISAC cooperative mode is selected, it consists of an RSU equipped with N antennas and i mission vehicles, each vehicle has M antennas, where IM≤N; the range of interest ROI includes the target sensing area and the interference area, which are divided into cubes of equal size, each cube represents a pixel point; there are O clutters as interference in the interference range around the target; there are two basic tasks in the vehicle-road cooperative wireless network, namely target perception and information communication, which are completed by multiple mission vehicles and multi-antenna RSUs in collaboration; S44: When the RSU obtains similar environmental data and has cached it in the corresponding edge server, the InsT mode is selected, and the matrix operation of the task vehicle coordinates contained in the calculation instruction is used to transform the coordinates of the environmental data perceived by the RSU, and then the RSU uses the environmental data perceived by itself to perform the subtask.

5. The method for environmental perception in a digital twin vehicle network based on synaesthesia integration according to claim 4 is characterized in that: Step S43 specifically includes the following steps: Establish the i-th vehicle superimposed coded transmission signal, assuming that the i-th vehicle constructs the sensing signal To perceive p targets in the target area and generate data As a communication signal to transmit information in each time slot, the specific description is as follows: in Indicates perception, means communication, are transmit beamforming vectors for corresponding sensing signals and communication signals, respectively; For the receiving signal of RSU, the details are as follows: in, Indicates perception, Indicates clutter interference, represents communication, n is the additive white Gaussian noise AWGN vector, as well as are the reflection coefficients of the pth target and the Oth clutter respectively; represents the cascade channel, where g i,p and g i ' ,p are the channel gains from the i-th service vehicle to the p-th target and from the p-th target to the RSU, respectively; represents the cascade channel, where f i,o and f i ' ,o are the channel gains from the i-th service vehicle to the O-th clutter and from the O-th clutter to the RSU, respectively; is the channel gain from the i-th service vehicle to the RSU; assuming G i,p ,F i,o ,H i Remains constant within a time slot, but fades independently across time slots; A linear unbiased estimator is deployed at the RSU to estimate the reflection coefficient of the target; in order to obtain accurate reflection coefficients for target sensing The RSU performs receive beamforming to enhance the desired signal and suppress co-channel interference; The mean square error (MSE) is used as the performance indicator of target perception to minimize the difference between the estimated reflection coefficient and the actual reflection coefficient to suppress interference from other signals, where the estimated reflection coefficient of the pth target is It is expressed as: in is the sensing receiving beamforming vector adopted at the RSU for the pth target; after the relevant parameters are estimated, the mean square error MSE is used as the performance indicator of target perception; the estimated reflection coefficient is minimized and the actual reflection coefficient z j1 to suppress interference from other signals: in, is the noise power, R m is the reflection coefficient According to the root mean square value RMS of the prior probability of occurrence of each type; The RSU performs responsive receive beamforming to mitigate interference. The received signal is given by: in is the communication receiving beamforming vector of the lth communication signal from the i-th service vehicle, and The associated signal-to-interference-plus-noise ratio SINR is expressed as: in So as to obtain the communication delay: z i1 (t) represents the bandwidth allocated to SeV i channel, and α i represents the task data transmission coefficient of each service vehicle, and The upload delay at this stage is obtained as That is, set the deadline for uploading the data required for the processing task to be t max ,when When , RSU chooses not to wait for the SeV any longer and directly processes the task.

6. The method for environmental perception in a digital twin vehicle network based on synaesthesia integration according to claim 4 is characterized by: In step S44, the RSU caches the offloading decision to sense and preprocess the corresponding environmental data; In the case of InsT, the upload time of the service vehicle depends on the coordinate transformation time. Assuming that the service vehicle has been sensing the environmental data, the coordinate transformation is performed immediately after receiving the calculation instruction. The transformation time depends on the amount of sensed data, and the execution time depends on the computing power of the edge server corresponding to RSU j and the CPU cycles required for the subtask: Among them, M inst represents the computational intensity of coordinate transformation, z j2 (t) represents the calculation rate of RSU; In summary, the time required for step S44 is expressed as: When executing the environmental perception task initiated by the vehicle, according to the established task processing flow, the total time required is expressed as:

Citation Information

Patent Citations

  • Task unloading method for vehicle-mounted edge computing system

    CN113179296A

  • Perception task processing method and system in digital twin Internet of Vehicles

    CN115086917A

  • Digital twinning-based car networking task unloading method

    CN118075265A