Method and apparatus for performing error correction on basis of semantic communication in wireless communication system

Abstract

The present disclosure relates to a method for operating a first node in a wireless communication system, comprising the steps of: establishing a connection with a second node; receiving a first node capability information request from the second node; transmitting first node capability information to the second node on the basis of the first node capability information request; receiving semantic communication indication information from the second node; and encoding data by using an attention technique through semantic communication-related information in the received semantic communication indication information and transmitting the encoded data to the second node, wherein the first node may encode the data on the basis of whether a first bitwise operation attention map is received from the second node and the number of semantic data retransmissions, and transmit the encoded data to the second node.

Description

Method and device for performing error correction based on semantic communication in a wireless communication system

[0001] The following describes a method and device for performing error correction based on semantic communication in a wireless communication system. Specifically, the present invention relates to a method and device for performing error detection based on an attention map in a wireless communication system and performing error correction based thereon.

[0002] Wireless access systems are widely deployed to provide various types of communication services, such as voice and data. Typically, wireless access systems are multiple access systems that support communications with multiple users by sharing available system resources (e.g., bandwidth, transmission power). Examples of multiple access systems include code division multiple access (CDMA), frequency division multiple access (FDMA), time division multiple access (TDMA), orthogonal frequency division multiple access (OFDMA), and single-carrier frequency division multiple access (SC-FDMA).

[0003] In particular, as numerous communication devices demand greater communication capacity, enhanced mobile broadband (eMBB) communication technologies are being proposed, improving upon existing radio access technology (RAT). Furthermore, massive machine type communications (mMTC), which connects multiple devices and objects to provide diverse services anytime and anywhere, as well as communication systems that consider reliability and latency-sensitive services / user equipment (UE), are being proposed. Various technological configurations are being proposed for these solutions.

[0004] The present disclosure relates to a method and device for performing semantic communication in a wireless communication system.

[0005] The present disclosure relates to a method and device for performing error correction based on semantic communication in a wireless communication system.

[0006] The present disclosure relates to a method and device for performing error correction based on an attention map based on semantic communication in a wireless communication system.

[0007] The present disclosure relates to a method and device for performing semantic communication based on bit operation attention feedback and the number of retransmissions received by a source in a wireless communication system.

[0008] The present disclosure relates to a method and device for performing error correction based on whether a destination performs a semantic error check based on semantic communication in a wireless communication system.

[0009] The present disclosure relates to a method and device for determining whether to prematurely terminate a destination upon detection of a semantic error based on semantic communication in a wireless communication system.

[0010] The technical objectives to be achieved in the present disclosure are not limited to those mentioned above, and other technical tasks not mentioned can be considered by a person having ordinary skill in the technical field to which the technical configuration of the present disclosure is applied from the embodiments of the present disclosure described below.

[0011] As an example of the present disclosure, a method for operating a first node in a wireless communication system comprises the steps of: establishing a connection with a second node; receiving a request for first node capability information from the second node; transmitting the first node capability information to the second node based on the request for first node capability information; receiving semantic communication instruction information from the second node; and encoding data using an attention technique through semantic communication-related information in the received semantic communication instruction information and transmitting the data to the second node, wherein the first node can encode the data and transmit the data to the second node based on whether or not it receives a first bitwise attention map from the second node and the number of times semantic data is retransmitted.

[0012] In addition, as an example of the present disclosure, in a method for operating a second node in a wireless communication system, the method comprises the steps of establishing a connection with a first node, transmitting a first node capability information request to the first node, receiving first node capability information from the first node based on the first node capability information request, transmitting semantic communication instruction information to the first node, and receiving data encoded based on an attention technique from the first node through semantic communication-related information in the semantic communication instruction information, wherein the second node can perform a downstream task through the data received from the first node based on whether a semantic error check is performed and whether a semantic error occurs.

[0013] Additionally, as an example of the present disclosure, the semantic communication-related information in the semantic communication instruction information may include at least one of an encoder model, a decoder model, an attention matrix calculation method, a fusion matrix, an attention value discard ratio, a bitwise attention map threshold, an error detection threshold, a maximum retransmission count, and an early stopping threshold.

[0014] Additionally, as an example of the present disclosure, if there is data to be transmitted to the second node, the first node can compare the number of semantic data retransmissions with the maximum retransmission count.

[0015] In addition, as an example of the present disclosure, if the number of semantic data retransmissions is less than the maximum value and the first node has received the first bit operation attention map from the second node, the first node may perform encoding by generating residual region data used to correct the semantic error, and if the number of semantic data retransmissions is less than the maximum value and the first node has not received the first bit operation attention map from the second node, the first node may determine the data to be transmitted to the second node as new data and perform encoding.

[0016] In addition, as an example of the present disclosure, encoding is performed based on at least one of an attention matrix operation method, a fusion matrix, and an attention value discard ratio, and a semantic representation and a second bit operation attention map are generated based on the encoding, and the semantic representation including the semantic representation and the second bit operation attention map can be transmitted to a second node.

[0017] In addition, as an example of the present disclosure, when the first bit operation attention map received by the first node is a bit operation attention map based on reconstructed data of a semantic level, the first node can obtain a residual region-based bit operation attention map by comparing the original data-based bit operation attention map with the reconstructed data-based bit operation attention map of the semantic level, and generate residual region data based on the residual region bit operation attention map.

[0018] Additionally, as an example of the present disclosure, if the first bit operation attention map received by the first node is a bit operation attention map based on residual region data used to correct semantic errors, residual region data can be generated based on the residual region bit operation attention map.

[0019] Additionally, as an example of the present disclosure, if the number of semantic data retransmissions is greater than the maximum value, the first node may perform a system failure operation.

[0020] Additionally, as an example of the present disclosure, the first node may perform at least one of transmitting a system failure message, re-establishing semantic error correction, and updating data based on the system failure operation.

[0021] The following effects may be achieved by embodiments based on the present disclosure.

[0022] According to the present disclosure, a method for performing semantic communication in a wireless communication system can be provided.

[0023] According to the present disclosure, a method for performing error correction based on semantic communication in a wireless communication system can be provided.

[0024] According to the present disclosure, a method for performing error correction based on an attention map based on semantic communication in a wireless communication system can be provided.

[0025] According to the present disclosure, a method for performing semantic communication based on bit operation attention feedback and the number of retransmissions received by a source in a wireless communication system can be provided.

[0026] According to the present disclosure, a method for performing error correction based on whether a destination performs a semantic error check based on semantic communication in a wireless communication system can be provided.

[0027] According to the present disclosure, a method for determining whether to early terminate a destination upon detection of a semantic error based on semantic communication in a wireless communication system can be provided.

[0028] The effects that can be obtained from the embodiments of the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly derived and understood by those skilled in the art to which the technical configuration of the present disclosure is applied, from the description of the embodiments of the present disclosure below. In other words, unintended effects that result from implementing the configuration described in the present disclosure can also be derived by those skilled in the art from the embodiments of the present disclosure.

[0029] The accompanying drawings are intended to aid understanding of the present disclosure and, together with detailed descriptions, may provide embodiments of the present disclosure. However, the technical features of the present disclosure are not limited to specific drawings, and the features disclosed in each drawing may be combined with each other to form new embodiments. Reference numerals in each drawing may indicate structural elements.

[0030] Figure 1 illustrates an example of a communication system applicable to the present disclosure.

[0031] FIG. 2 illustrates an example of a wireless device applicable to the present disclosure.

[0032] FIG. 3 illustrates a method for processing a transmission signal applicable to the present disclosure.

[0033] Figure 4 illustrates a communication procedure between a terminal and a base station applicable to the present disclosure.

[0034] FIG. 5 illustrates an example of a communication structure that can be provided in a 6G (6th generation) system applicable to the present disclosure.

[0035] Figure 6 illustrates an electromagnetic spectrum applicable to the present disclosure.

[0036] FIG. 7 illustrates a THz wireless communication transceiver applicable to the present disclosure.

[0037] Figure 8 illustrates a THz signal generation method applicable to the present disclosure.

[0038] FIG. 9 illustrates a wireless communication transceiver applicable to the present disclosure.

[0039] Figure 10 illustrates a transmitter structure applicable to the present disclosure.

[0040] Figure 11 illustrates a modulator structure applicable to the present disclosure.

[0041] Figure 12 illustrates the structure of a perceptron included in an artificial neural network applicable to the present disclosure.

[0042] Figure 13 illustrates an artificial neural network structure applicable to the present disclosure.

[0043] Figure 14 is a diagram showing a communication model divided into three stages applicable to the present disclosure.

[0044] FIG. 15 is a diagram illustrating a method for translating an input word, English, into an output word, French, based on an attention technique applicable to the present disclosure.

[0045] FIG. 16 is a diagram illustrating a method of applying an attention technique using a transformer model when the data modality applicable to the present disclosure is an image.

[0046] FIG. 17 is a diagram illustrating a method for performing semantic communication applicable to the present disclosure.

[0047] Figure 18 is a diagram showing semantic errors applicable to the present disclosure.

[0048] FIG. 19 is a diagram illustrating a method for operating multiple downstream tasks located at a destination when the modality of input data to which the present disclosure is applicable is an image.

[0049] FIG. 20 is a diagram illustrating a method for performing error detection applicable to the present disclosure.

[0050] FIG. 21 is a diagram illustrating a source structure for performing attention map-based semantic error correction applicable to the present disclosure.

[0051] FIG. 22 is a diagram illustrating a method for obtaining residual region data used to correct semantic errors in a source after error detection applicable to the present disclosure.

[0052] FIG. 23 is a diagram illustrating a residual region data-based bit operation attention map used to correct semantic errors applicable to the present disclosure.

[0053] FIG. 24 is a diagram illustrating a destination structure that performs semantic error correction applicable to the present disclosure.

[0054] FIG. 25 is a diagram illustrating ARC operation for residual area data used to correct semantic errors applicable to the present disclosure.

[0055] FIG. 26 is a diagram illustrating a method for performing error correction target data and data synthesis without detecting semantic errors in reconstructed data based on residual area data applicable to the present disclosure.

[0056] FIG. 27 is a diagram illustrating a case where the semantic error rate increases in data synthesized from semantic level reconstruction data based on residual area data used to correct semantic errors applicable to the present disclosure.

[0057] FIG. 28 is a diagram illustrating a method for obtaining an attention map based on synthesized data applicable to the present disclosure and performing a semantic error check based thereon.

[0058] Figure 29 is a diagram showing an initial setting method of semantic communication applicable to the present disclosure.

[0059] Figure 30 is a drawing showing a source operation method applicable to the present disclosure.

[0060] Figure 31 is a diagram showing a destination operation method applicable to the present disclosure.

[0061] Figure 32 is a flowchart showing a first node operation method applicable to the present disclosure.

[0062] Figure 33 is a drawing showing a second node operation method applicable to the present disclosure.

[0063] The following embodiments combine the components and features of the present disclosure in a predetermined form. Each component or feature may be considered optional unless explicitly stated otherwise. Each component or feature may be implemented without being combined with other components or features. Furthermore, some components and / or features may be combined to form embodiments of the present disclosure. The order of operations described in the embodiments of the present disclosure may be changed. Some components or features of one embodiment may be included in another embodiment or may be replaced with corresponding components or features of another embodiment.

[0064] In the description of the drawings, procedures or steps that may obscure the gist of the present disclosure are not described, and procedures or steps that can be understood by a person skilled in the art are also not described.

[0065] Throughout the specification, when a part is said to "comprising" or "including" a component, this does not mean that other components may be included, but rather that other components may be excluded, unless otherwise specifically stated. In addition, terms such as "...part," "...unit," and "module" described in the specification mean a unit that processes at least one function or operation, which may be implemented by hardware, software, or a combination of hardware and software. In addition, the words "a" or "an," "one," "the," and similar related words may be used in the context of describing the present disclosure (especially in the context of the claims below) to include both the singular and the plural, unless otherwise indicated herein or clearly contradicted by context.

[0066] Embodiments of the present disclosure described herein focus on the data transmission and reception relationship between a base station and a mobile station. Here, the base station is understood as a terminal node of a network that directly communicates with the mobile station. Certain operations described herein as being performed by the base station may, in some cases, be performed by an upper node of the base station.

[0067] That is, in a network consisting of multiple network nodes including a base station, various operations performed for communication with a mobile station may be performed by the base station or other network nodes other than the base station. In this case, the term 'base station' may be replaced by terms such as fixed station, Node B, eNB (eNode B), gNB (gNode B), ng-eNB, advanced base station (ABS), or access point.

[0068] Additionally, in the embodiments of the present disclosure, the term terminal may be replaced with terms such as user equipment (UE), mobile station (MS), subscriber station (SS), mobile subscriber station (MSS), mobile terminal, or advanced mobile station (AMS).

[0069] Additionally, a transmitter refers to a fixed and / or mobile node that provides data or voice services, and a receiver refers to a fixed and / or mobile node that receives data or voice services. Therefore, for uplink, a mobile station can be the transmitter, and a base station can be the receiver. Similarly, for downlink, a mobile station can be the receiver, and a base station can be the transmitter.

[0070] Embodiments of the present disclosure are wireless access systems, such as IEEE 802.xx systems, 3GPP (3 rd Generation Partnership Project) system, 3GPP LTE (Long Term Evolution) system, 3GPP 5G (5 th generation) NR (New Radio) system and 3GPP2 system, and in particular, the embodiments of the present disclosure may be supported by 3GPP TS (technical specification) 38.211, 3GPP TS 38.212, 3GPP TS 38.213, 3GPP TS 38.321 and 3GPP TS 38.331 documents.

[0071] Furthermore, the embodiments of the present disclosure can be applied to other wireless access systems and are not limited to the systems described above. For example, they can be applied to systems implemented after the 3GPP 5G NR system and are not limited to a specific system.

[0072] That is, obvious steps or parts not described in the embodiments of the present disclosure can be explained by referring to the above documents. In addition, all terms disclosed in this document can be explained by the above standard documents.

[0073] Hereinafter, preferred embodiments according to the present disclosure will be described in detail with reference to the accompanying drawings. The detailed description set forth below, together with the accompanying drawings, is intended to illustrate exemplary embodiments of the present disclosure and is not intended to represent the only embodiments in which the technical configurations of the present disclosure may be implemented.

[0074] Additionally, specific terms used in the embodiments of the present disclosure are provided to aid in understanding of the present disclosure, and the use of such specific terms may be changed to other forms without departing from the technical spirit of the present disclosure.

[0075] The following technology can be applied to various wireless access systems such as CDMA (code division multiple access), FDMA (frequency division multiple access), TDMA (time division multiple access), OFDMA (orthogonal frequency division multiple access), and SC-FDMA (single carrier frequency division multiple access).

[0076] For clarity, the following description is based on 3GPP communication systems (e.g., LTE, NR, etc.), but the technical spirit of the present disclosure is not limited thereto. LTE may refer to technology after 3GPP TS 36.xxx Release 8. Specifically, LTE technology after 3GPP TS 36.xxx Release 10 may be referred to as LTE-A, and LTE technology after 3GPP TS 36.xxx Release 13 may be referred to as LTE-A pro. 3GPP NR may refer to technology after TS 38.xxx Release 15. 3GPP 6G may refer to technology after TS Release 17 and / or Release 18. "xxx" refers to a standard document detail number. LTE / NR / 6G may be collectively referred to as a 3GPP system.

[0077] For background information, terms, abbreviations, etc. used in this disclosure, reference may be made to standard documents published prior to this disclosure. For example, reference may be made to standard documents 36.xxx and 38.xxx.

[0078] Communication system applicable to the present disclosure

[0079] Although not limited thereto, the various descriptions, functions, procedures, proposals, methods and / or operational flowcharts of the present disclosure disclosed in this document may be applied to various fields requiring wireless communication / connectivity (e.g., 5G) between devices.

[0080] Hereinafter, more specific examples will be provided with reference to the drawings. In the drawings / descriptions below, the same drawing reference numerals may represent identical or corresponding hardware blocks, software blocks, or functional blocks, unless otherwise described.

[0081] Figure 1 illustrates an example of a communication system applied to the present disclosure.

[0082] Referring to FIG. 1, a communication system (100) applied to the present disclosure includes a wireless device, a base station, and a network. Here, the wireless device refers to a device that performs communication using a wireless access technology (e.g., LTE, LTE-A, LTE-A pro, NR, 5G, 5G-A, 6G) and may be referred to as a communication / wireless / 5G device. Although not limited thereto, the wireless device may include a robot (100a), a vehicle (100b-1, 100b-2), an XR (extended reality) device (100c), a hand-held device (100d), a home appliance (100e), an IoT (Internet of Things) device (100f), and an AI (artificial intelligence) device / server (100g). For example, the vehicle may include a vehicle equipped with a wireless communication function, an autonomous vehicle, a vehicle capable of performing vehicle-to-vehicle communication, etc. Here, the vehicles (100b-1, 100b-2) may include unmanned aerial vehicles (UAVs) (e.g., drones). The XR devices (100c) include augmented reality (AR) / virtual reality (VR) / mixed reality (MR) devices, and may be implemented in the form of head-mounted devices (HMDs), head-up displays (HUDs) installed in vehicles, televisions, smartphones, computers, wearable devices, home appliances, digital signage, vehicles, robots, etc. The portable devices (100d) may include smartphones, smart pads, wearable devices (e.g., smartwatches, smart glasses), computers (e.g., laptops, etc.), etc. The home appliances (100e) may include TVs, refrigerators, washing machines, etc. The IoT devices (100f) may include sensors, smart meters, etc.For example, the base station (120) and the network (130) may also be implemented as wireless devices, and a specific wireless device (120a) may act as a base station / network node to other wireless devices.

[0083] Wireless devices (100a to 100f) can be connected to a network (130) via a base station (120). AI technology can be applied to the wireless devices (100a to 100f), and the wireless devices (100a to 100f) can be connected to an AI server (100g) via a network (130). The network (130) can be configured using a 3G network, a 4G (e.g., LTE) network, a 5G (e.g., NR), or a 6G network. The wireless devices (100a to 100f) can communicate with each other via the base station (120) / network (130), but can also communicate directly (e.g., sidelink communication) without going through the base station (120) / network (130). For example, vehicles (100b-1, 100b-2) can communicate directly (e.g., V2V (vehicle to vehicle) / V2X (vehicle to everything) communication). Additionally, an IoT device (100f) (e.g., a sensor) can communicate directly with another IoT device (e.g., a sensor) or another wireless device (100a to 100f).

[0084] Wireless communication / connection (150a, 150b, 150c) can be established between wireless devices (100a to 100f) / base stations (120), and base stations (120) / base stations (120). Here, the wireless communication / connection can be established through various wireless access technologies such as uplink / downlink communication (150a), sidelink communication (150b) (or D2D communication), and base station-to-base station communication (150c) (e.g., relay, IAB (integrated access backhaul)). Through the wireless communication / connection (150a, 150b, 150c), the wireless device and base station / wireless device, and base stations and base stations can transmit / receive wireless signals to / from each other. For example, the wireless communication / connection (150a, 150b, 150c) can transmit / receive signals through various physical channels. To this end, based on various proposals of the present disclosure, at least some of various configuration information setting processes for transmitting / receiving wireless signals, various signal processing processes (e.g., channel encoding / decoding, modulation / demodulation, resource mapping / demapping, etc.), resource allocation processes, etc. may be performed.

[0085] Devices applicable to the present disclosure

[0086] FIG. 2 illustrates an example of a wireless device applicable to the present disclosure.

[0087] Referring to FIG. 2, the wireless device (200) can transmit and receive wireless signals via various wireless access technologies (e.g., LTE, LTE-A, LTE-A pro, NR, 5G, 5G-A, 6G). The wireless device (200) includes at least one processor (202) and at least one memory (204), and may additionally include at least one transceiver (206) and / or at least one antenna (208).

[0088] The processor (202) controls the memory (204) and / or the transceiver (206), and may be configured to implement the descriptions, functions, procedures, proposals, methods, and / or operational flowcharts disclosed in this document. For example, the processor (202) may process information in the memory (204) to generate first information / signal, and then transmit a wireless signal including the first information / signal via the transceiver (206). In addition, the processor (202) may receive a wireless signal including second information / signal via the transceiver (206), and then store information obtained from signal processing of the second information / signal in the memory (204). The memory (204) may be connected to the processor (202) and may store various information related to the operation of the processor (202). For example, the memory (204) may store software code including instructions for performing some or all of the processes controlled by the processor (202), or for performing the descriptions, functions, procedures, proposals, methods, and / or operational flowcharts disclosed herein. Here, the processor (202) and the memory (204) may be part of a communication modem / circuit / chip designed to implement wireless communication technology. The transceiver (206) may be connected to the processor (202) and may transmit and / or receive wireless signals via at least one antenna (208). The transceiver (206) may include a transmitter and / or a receiver. The transceiver (206) may be used interchangeably with an RF (radio frequency) unit. In the present disclosure, a wireless device may also mean a communication modem / circuit / chip.

[0089] Hereinafter, the hardware elements of the wireless device (200) will be described in more detail. Although not limited thereto, at least one protocol layer may be implemented by at least one processor (202). For example, at least one processor (202) may implement at least one layer (e.g., a functional layer such as physical (PHY), media access control (MAC), radio link control (RLC), packet data convergence protocol (PDCP), radio resource control (RRC), and service data adaptation protocol (SDAP)). At least one processor (202) may generate at least one Protocol Data Unit (PDU) and / or at least one Service Data Unit (SDU) according to the descriptions, functions, procedures, proposals, methods, and / or operation flowcharts disclosed in this document. At least one processor (202) may generate a message, control information, data, or information according to the descriptions, functions, procedures, proposals, methods, and / or operation flowcharts disclosed in this document. At least one processor (202) can generate a signal (e.g., a baseband signal) including a PDU, an SDU, a message, control information, data or information according to the functions, procedures, proposals and / or methods disclosed in this document, and provide the signal to at least one transceiver (206). At least one processor (202) can receive a signal (e.g., a baseband signal) from at least one transceiver (206) and obtain the PDU, SDU, message, control information, data or information according to the descriptions, functions, procedures, proposals, methods and / or operational flowcharts disclosed in this document.

[0090] At least one processor (202) may be referred to as a controller, a microcontroller, a microprocessor, or a microcomputer. The at least one processor (202) may be implemented by hardware, firmware, software, or a combination thereof. For example, at least one application specific integrated circuit (ASIC), at least one digital signal processor (DSP), at least one digital signal processing device (DSPD), at least one programmable logic device (PLD), or at least one field programmable gate array (FPGA) may be included in the at least one processor (202). The descriptions, functions, procedures, proposals, methods, and / or operation flowcharts disclosed in this document may be implemented using firmware or software, and the firmware or software may be implemented to include modules, procedures, functions, etc. The descriptions, functions, procedures, proposals, methods, and / or operation flowcharts disclosed in this document may be included in the at least one processor (202), or may be stored in at least one memory (204) and driven by the at least one processor (202). The descriptions, functions, procedures, suggestions, methods and / or flowcharts disclosed in this document may be implemented using firmware or software in the form of code, instructions and / or sets of instructions.

[0091] At least one memory (204) can be connected to at least one processor (202) and can store various forms of data, signals, messages, information, programs, codes, instructions and / or commands. The at least one memory (204) can be configured as a read only memory (ROM), a random access memory (RAM), an erasable programmable read only memory (EPROM), a flash memory, a hard drive, a register, a cache memory, a computer readable storage medium and / or a combination thereof. The at least one memory (204) can be located internally and / or externally to the at least one processor (202). In addition, the at least one memory (204) can be connected to the at least one processor (202) via various technologies such as a wired or wireless connection.

[0092] At least one transceiver (206) can transmit user data, control information, wireless signals / channels, etc., mentioned in the methods and / or flowcharts of this document to at least one other device. At least one transceiver (206) can receive user data, control information, wireless signals / channels, etc. mentioned in the descriptions, functions, procedures, proposals, methods and / or flowcharts disclosed in this document from at least one other device. For example, at least one transceiver (206) can be connected to at least one processor (202) and can transmit and receive wireless signals. For example, at least one processor (202) can control at least one transceiver (206) to transmit user data, control information, or wireless signals to at least one other device. Furthermore, at least one processor (202) can control at least one transceiver (206) to receive user data, control information, or wireless signals from at least one other device. In addition, at least one transceiver (206) may be connected to at least one antenna (208), and at least one transceiver (206) may be configured to transmit and receive user data, control information, wireless signals / channels, etc. mentioned in the descriptions, functions, procedures, proposals, methods and / or operation flowcharts disclosed in this document through at least one antenna (208). In this document, at least one antenna may be a plurality of physical antennas or a plurality of logical antennas (e.g., antenna ports). At least one transceiver (206) may convert the received wireless signals / channels, etc. from RF band signals to baseband signals in order to process the received user data, control information, wireless signals / channels, etc. using at least one processor (202). At least one transceiver (206) may convert the processed user data, control information, wireless signals / channels, etc. from baseband signals to RF band signals using at least one processor (202).For this purpose, at least one transceiver (206) may include an (analog) oscillator and / or filter.

[0093] The components of the wireless device described with reference to FIG. 2 may be referred to by different terms in terms of functionality. For example, the processor (202) may be referred to as a control unit, the transceiver (206) as a communication unit, and the memory (204) as a storage unit. In some cases, the communication unit may be used to mean at least a portion of the processor (202) and the transceiver (206).

[0094] The structure of the wireless device described with reference to FIG. 2 can be understood as the structure of at least a portion of various devices. For example, the structure of the wireless device illustrated in FIG. 2 can be at least a portion of various devices described with reference to FIG. 1 (e.g., a robot (100a), a vehicle (100b-1, 100b-2), an XR device (100c), a portable device (100d), a home appliance (100e), an IoT device (100f), an AI device / server (100g)). Furthermore, according to various embodiments, in addition to the components illustrated in FIG. 2, the device may further include other components.

[0095] For example, the device may be a portable device such as a smartphone, a smart pad, a wearable device (e.g., a smart watch, smart glasses), or a portable computer (e.g., a laptop, etc.). In this case, the device may further include at least one of a power supply unit that supplies power and includes a wired / wireless charging circuit, a battery, etc., an interface unit that includes at least one port for connection with another device (e.g., an audio input / output port, a video input / output port), and an input / output unit for inputting and outputting image information / signals, audio information / signals, data, and / or information input from a user.

[0096] For example, the device may be a mobile device such as a mobile robot, a vehicle, a train, an aerial vehicle (AV), a ship, etc. In this case, the device may further include at least one of a driving unit including at least one of an engine, a motor, a power train, wheels, brakes, and a steering unit of the device, a power supply unit including a wired / wireless charging circuit, a battery, etc. that supplies power, a sensor unit that senses status information, environmental information, and user information of the device or its surroundings, an autonomous driving unit that performs functions such as path maintenance, speed control, and destination setting, and a position measurement unit that obtains location information of the mobile device through a global positioning system (GPS) and various sensors.

[0097] For example, the device may be an XR device such as an HMD, a head-up display (HUD) installed in a vehicle, a television, a smartphone, a computer, a wearable device, a home appliance, a digital signage, a vehicle, a robot, etc. In this case, the device may further include at least one of a power supply unit that supplies power and includes a wired / wireless charging circuit, a battery, etc., an input / output unit that obtains control information, data, etc. from the outside and outputs the generated XR object, and a sensor unit that senses status information, environmental information, and user information of the device or the surroundings of the device.

[0098] For example, the device may be a robot that can be classified into industrial, medical, household, military, etc. types depending on the purpose or field of use. In this case, the device may further include at least one of a sensor unit that senses status information, environmental information, and user information of the device or its surroundings, and a driving unit that performs various physical actions, such as moving the robot joints.

[0099] For example, the device may be an AI device such as a TV, a projector, a smartphone, a PC, a laptop, a digital broadcasting terminal, a tablet PC, a wearable device, a set-top box (STB), a radio, a washing machine, a refrigerator, digital signage, a robot, a vehicle, etc. In this case, the device may further include at least one of an input unit that acquires various types of data from the outside, an output unit that generates output related to sight, hearing, or touch, a sensor unit that senses status information, environmental information, and user information of the device or its surroundings, and a training unit that trains a model composed of an artificial neural network using learning data.

[0100] The structure of the wireless device illustrated in FIG. 2 may be understood as a part of a RAN node (e.g., a base station, DU, RU, RRH, etc.). That is, the device illustrated in FIG. 2 may be a RAN node. In this case, the device may further include a wired transceiver for front haul and / or back haul communications. However, if the front haul and / or back haul communications are based on wireless communications, at least one transceiver (206) illustrated in FIG. 2 may be used for front haul and / or back haul communications, and a wired transceiver may not be included.

[0101] FIG. 3 illustrates a method for processing a transmission signal applicable to the present disclosure. For example, the transmission signal may be processed by a signal processing circuit. At this time, the signal processing circuit (300) may include a scrambler (310), a modulator (320), a layer mapper (330), a precoder (340), a resource mapper (350), and a signal generator (360). At this time, as an example, the operations / functions of FIG. 3 may be performed in the processor (202) and / or the transceiver (206) of FIG. 2. Furthermore, as an example, the hardware elements of FIG. 3 may be implemented in the processor (202) and / or the transceiver (206) of FIG. 2. As an example, blocks 310 to 360 may be implemented in the processor (202) of FIG. 2. Additionally, blocks 310 to 350 may be implemented in the processor (202) of FIG. 2, and block 360 may be implemented in the transceiver (206) of FIG. 2, and are not limited to the above-described embodiment.

[0102] The codeword can be converted into a wireless signal through the signal processing circuit (300) of FIG. 3. Here, the codeword is an encoded bit sequence of an information block. The information block may include a transport block (e.g., a UL-SCH transport block, a DL-SCH transport block). The wireless signal may be transmitted through various physical channels (e.g., a PUSCH, a PDSCH). Specifically, the codeword can be converted into a bit sequence scrambled by a scrambler (310). The scramble sequence used for scrambling is generated based on an initialization value, and the initialization value may include ID information of the wireless device, etc. The scrambled bit sequence can be modulated into a modulation symbol sequence by a modulator (320). The modulation scheme may include pi / 2-binary phase shift keying (pi / 2-BPSK), m-phase shift keying (m-PSK), m-quadrature amplitude modulation (m-QAM), etc.

[0103] A complex modulation symbol sequence can be mapped to at least one transmission layer by a layer mapper (330). The modulation symbols of each transmission layer can be mapped to corresponding antenna port(s) by a precoder (340). The output z of the precoder (340) can be obtained by multiplying the output y of the layer mapper (330) by a precoding matrix W of NХM, where N is the number of antenna ports and M is the number of transmission layers. Here, the precoder (340) can perform precoding after performing transform precoding (e.g., discrete Fourier transform (DFT) transform) on the complex modulation symbols. Additionally, the precoder (340) can perform precoding without performing transform precoding.

[0104] The resource mapper (350) can map modulation symbols of each antenna port to time-frequency resources. The time-frequency resources can include multiple symbols (e.g., CP-OFDMA symbols, DFT-s-OFDMA symbols) in the time domain and multiple subcarriers in the frequency domain. The signal generator (360) generates a wireless signal from the mapped modulation symbols, and the generated wireless signal can be transmitted to another device through each antenna. To this end, the signal generator (360) can include an inverse fast Fourier transform (IFFT) module, a cyclic prefix (CP) inserter, a digital-to-analog converter (DAC), a frequency uplink converter, and the like.

[0105] The signal processing process for a received signal in a wireless device may be configured in reverse order of the signal processing process (310 to 360) of FIG. 3. For example, a wireless device (e.g., 200 of FIG. 2) may receive a wireless signal from the outside through an antenna port / transceiver. The received wireless signal may be converted into a baseband signal through a signal restorer. For this purpose, the signal restorer may include a frequency downlink converter, an analog-to-digital converter (ADC), a CP remover, and a fast Fourier transform (FFT) module. Thereafter, the baseband signal may be restored to a codeword through a resource demapper process, a postcoding process, a demodulation process, and a descrambling process. The codeword may be restored to the original information block through decoding. Therefore, a signal processing circuit (not shown) for a received signal may include a signal restorer, a resource demapper, a postcoder, a demodulator, a descrambler, and a decoder.

[0106] Figure 4 illustrates a communication procedure between a terminal and a base station applicable to the present disclosure. Figure 4 illustrates operations of a terminal (410) and a base station (420) transmitting and / or receiving data and operations performed prior thereto.

[0107] Referring to FIG. 4, in step 401, the terminal (410) and the base station (420) perform synchronization. For example, the terminal (410) performs an initial cell search operation. Specifically, the terminal (410) can detect at least one synchronization signal transmitted from the base station (420) according to a predefined rule. Here, the synchronization signal can include multiple synchronization signals classified according to structure or purpose (e.g., primary synchronization signal, secondary synchronization signal). Through this, the terminal (410) can check the boundary of the frame, subframe, slot, and / or symbol of the base station (420) and obtain information about the base station (420) (e.g., cell identifier).

[0108] In step 403, the terminal (410) obtains system information transmitted from the base station (420). The system information is information related to the properties, characteristics, and / or capabilities of the base station (420) required to access the base station (420) and use the service, and may be classified according to the content (e.g., whether it is essential for access), transmission structure (e.g., channel used, whether provided on-demand), etc., and may be classified into, for example, a master information block (MIB) and a system information block (SIB). If necessary, the terminal (410) may transmit a signal requesting system information before receiving the system information. However, the request and provision of the system information may be performed after the random access procedure described below.

[0109] In step 405, the terminal (410) and the base station (420) perform a random access procedure. The terminal (410) may transmit and / or receive at least one message (e.g., a random access preamble, a random access response (RAR) message, etc.) for the random access procedure based on information related to the random access channel of the base station (420) obtained through system information (e.g., channel position, channel structure, supported preamble structure, etc.). For example, the terminal (410) may transmit a preamble (e.g., MSG1) through the random access channel, receive an RAR message (e.g., MSG2), transmit a message (e.g., MSG3) including information related to the terminal (410) (e.g., identification information) to the base station (420) using scheduling information included in the RAR message, and receive a message (e.g., MSG4) for contention resolution and / or connection establishment. As another example, MSG1 and MSG3 may be sent and received as one message, or MSG2 and MSG4 may be sent and received as one message.

[0110] In step 407, the terminal (410) and the base station (420) perform signaling of control information. Here, the control information may be defined in various layers, such as a layer that controls a connection (e.g., a radio resource control (RRC) layer), a layer that handles mapping between logical channels and transport channels (e.g., a media access control (MAC) layer), and a layer that handles physical channels (e.g., a physical (PHY) layer). For example, the terminal (410) and the base station (420) may perform at least one of signaling for establishing a connection, signaling for determining settings related to communication, and signaling for indicating allocated resources.

[0111] In step 409, the terminal (410) and the base station (420) transmit and / or receive data. In other words, the terminal (410) and the base station (420) can process, transmit, and / or receive data based on the signaling of the control information. For example, when transmitting data, the terminal (410) or the base station (420) can perform at least one of channel encoding, rate matching, scrambling, constellation mapping, layer mapping, waveform modulation, antenna mapping, and resource mapping on the information bits. Conversely, when receiving data, the terminal (410) or the base station (420) can perform at least one of signal extraction from resources, waveform demodulation for each antenna, signal arrangement considering layer mapping, constellation demapping, descrambling, and channel decoding.

[0112] 6G communication systems and core implementation technologies of 6G systems

[0113] The 5G system defines various operating bands within FR1 (frequency range 1), which covers 410 MHz to 7125 MHz, and FR2 (frequency range 2), which covers 24,250 MHz to 71,000 MHz. Various frequencies are being discussed as operating bands for the subsequent 6G system, and the use of higher frequencies than 5G systems is also being considered for wider bandwidth and higher transmission speeds. One such band is the THz (terahertz) frequency band, which covers approximately 100 GHz to 10 THz. The THz frequency band is a band that has both the transparency of radio waves and the straightness of light waves, and communications using the THz frequency band are expected to play a transitional role from existing radio-centered communications to lightwave-based communications.

[0114] 6G systems utilizing the THz frequency band are aimed at i) very high data rates per device, ii) a very large number of connected devices, iii) global connectivity, iv) very low latency, v) reducing energy consumption of battery-free IoT devices, vi) ultra-reliable connectivity, and vii) connected intelligence with machine learning capabilities. The vision of the 6G system can be divided into four aspects: “intelligent connectivity,” “deep connectivity,” “holographic connectivity,” and “ubiquitous connectivity,” and the 6G system can be designed to satisfy the requirements as shown in [Table 1] below.

[0115] [Table 1]

[0116]

[0117] At this time, the 6G system may have key factors such as enhanced mobile broadband (eMBB), ultra-reliable low latency communications (URLLC), massive machine type communications (mMTC), AI integrated communication, tactile internet, high throughput, high network capacity, high energy efficiency, low backhaul and access network congestion, and enhanced data security.

[0118] Figure 5 illustrates an example of a communication structure that can be provided in a 6G system applicable to the present disclosure. Referring to Figure 5, a 6G system is expected to have 50 times higher simultaneous wireless communication connectivity than a 5G wireless communication system. URLLC, a key feature of 5G, is expected to become an even more important technology in 6G communications by providing end-to-end latency of less than 1 ms. Furthermore, 6G systems will have significantly superior volumetric spectral efficiency, unlike the frequently used area spectral efficiency. 6G systems can provide extremely long battery life and advanced battery technologies for energy harvesting, so mobile devices in 6G systems may not need to be separately charged.

[0119] As core implementation technologies of the 6G system, technologies such as artificial intelligence (AI), THz (terahertz) communication, optical wireless technology, FSO backhaul network, massive MIMO technology, blockchain, 3D networking, quantum communication, unmanned aerial vehicles, cell-free communication, wireless information and energy transfer (WIET), integration of sensing and communication, integration of access backhaul networks, holographic beamforming, big data analysis, and large intelligent surface (LIS) can be adopted.

[0120] For example, THz communication is a communication that utilizes a spectrum in a frequency band between 0.1 THz and 10 THz with a corresponding wavelength in the range of 0.03 mm to 3 mm as shown in Fig. 6, and can be implemented using circuit elements having a structure as shown in Fig. 7. In addition, optical wireless technology is a technology that generates and modulates THz signals using optical elements, and can be implemented based on devices having structures as shown in Figs. 8, 9, 10, and 11.

[0121] In addition, artificial intelligence can be implemented based on various models such as neural networks and machine learning (machine models). For example, an artificial intelligence model of a neural network structure can be based on the structure of a perceptron as in Fig. 12. Referring to Fig. 12, an artificial neural network can be composed of multiple perceptrons. According to the structure of the perceptron, when an input vector x={x1, x2,... xd} is input, each component is multiplied by a weight {W1, W2,... Wd}, and all the results are added, and then the activation function σ(·) is applied. A large artificial neural network structure can be formed by extending the simplified perceptron structure illustrated in Fig. 12, and the input vector can be applied to perceptrons of different dimensions. When perceptrons are stacked, a neural network having an input layer, a hidden layer, and an output layer as in Fig. 13 can be configured.

[0122] Figure 14 is a diagram illustrating a three-stage communication model applicable to the present disclosure. Referring to Figure 14, the communication model can be explained by dividing it into three stages. Stage 1, from a technical perspective, may be concerned with whether symbols for communication are accurately transmitted, and Shannon's information theory can be viewed as a theory focusing on this technical aspect. On the other hand, Stage 2, from a semantic perspective, may be concerned with how accurately the transmitted symbols convey the correct meaning, and Stage 3, from an effectiveness perspective, may be concerned with how effectively the received meaning influences the correct operation.

[0123] One of the various goals of 6G communications may be to provide services that interconnect humans and machines. Semantic communication, based on the concept of "meaning transfer," can be considered as one of the next-generation wireless communication paradigms for this purpose. For example, conventional communication involves a receiver (e.g., destination) decoding an encoded signal received from a transmitter (e.g., source) into a conventional signal without error. In contrast, semantic communication focuses on the meaning intended to be conveyed through the signal, as people exchange information through the "meaning" of words when communicating.

[0124] For example, semantic communication can be a communication method based on whether the concept related to the message sent by the source is correctly interpreted by the destination. For example, the source can generate a semantic representation based on raw data and transmit it to the destination. The destination can perform communication by evaluating whether the task intended by the source is performed properly using the received semantic representation, rather than with the goal of reducing reconstruction errors. In other words, in semantic communication, communication can be performed based on whether the task is performed properly (i.e., whether the interpretation is correct) at the destination, rather than with the goal of reducing reconstruction errors.

[0125] As a specific example, a source can generate a semantic representation and transmit it to a destination. Here, the source needs to generate the semantic representation by considering the task operations performed at the destination. In other words, the source can operate based on a task-oriented semantic communication system that enables the generation of a semantic representation based on whether the task operations are performed well at the destination. Considering the above, there is a need to introduce useful invariances for the tasks performed at the destination while preserving task-relevant information. For example, to perform semantic communication considering the above, a new layer can be added as a semantic layer that governs the overall operation of semantic representations and messages. For example, the semantic layer can be located at both the source and the destination, reflecting the task-oriented semantic communication system. To perform communication between semantic radars located at each of the source and the destination, a protocol and a series of operation procedures, which are rules between the layers, need to be determined.

[0126] As an example, the following describes a method for performing attention map-based error detection in semantic communication. The attention map can be generated based on an attention technique. Attention techniques can be applied in the field of neural machine translation (NMT). Specifically, when applying the attention technique to the field of NMT, the decoder can refer back to the input sequence of the encoder at each time step to predict an output word. Here, the decoder can perform prediction by referring to an input sequence that is highly related to the predicted output word among the input sequences. In other words, the decoder can focus (attention) on the input sequence that is highly related to the predicted word rather than referring to the input sequence equally when performing output word prediction, thereby improving prediction accuracy. Considering the above, the technique can be an attention technique because it utilizes the focused (attentioned) portion, but it may not be limited to that name. However, for convenience of explanation, it is referred to as the attention technique below.

[0127] As an example, FIG. 15 is a diagram illustrating a method for translating an input word, English, into an output word, French, based on an attention technique applicable to the present disclosure. Referring to FIG. 15, an attention technique may be applied in sequence modeling between the input word, English, and the output word, French. Here, the sequence modeling between the input word, English, and the output word, French, may include weight values ​​expressed as a correlation matrix. For example, in FIG. 15, the closer the color of a pixel is to white, the higher the correlation between the words may be. Referring to FIG. 15, even if the order in which English sentences are written differs from the order in which French sentences are written, a weight may be higher for a part that is to be translated into a word that has a correlation regardless of the position, thereby increasing the prediction accuracy.

[0128] Here, as an example, the attention technique, based on the transformer model, can be applied to network architectures other than neural machine translation. Specifically, the transformer model architecture allows attention to be applied to all significant parts regardless of input length. Accordingly, attention-based processing can be performed on text, images, graphs, and other diverse data modalities, but may not be limited to a specific format.

[0129] FIG. 16 is a diagram illustrating a method of applying an attention technique using a transformer model when the data modality applicable to the present disclosure is an image. Referring to FIG. 16, a vision transformer may be applied as a transformer model for image processing. As a more specific example, the vision transformer may be a data-efficient image transformer (DeiT), but this is only one example and may not be limited thereto. Referring to FIG. 16, the vision transformer model may use a class token for matching the true label of the input image with the input value of DeiT, tokens obtained by tokenizing the input image in units of patches, and distillation tokens that play a role in learning the knowledge of the teacher model by reducing the error with the inferred value of the teacher model. Here, the classic token and the distilled token are randomly initialized before being applied to the transformer structure, and may be changed to an optimized value while passing through multiple layers.

[0130] As described above, the attention technique may be a technique for processing data by focusing on a part that is highly related to the predicted output from the input data. Here, as an example, FIG. 17 is a diagram illustrating a method for performing semantic communication applicable to the present disclosure. Referring to FIG. 17, a transmitter (transmitter, 1710) may perform semantic encoding and channel encoding on input data (sentence, s) and transmit it to a receiver (receiver, 1720). The receiver (1720) may perform channel decoding and semantic encoding on data received through the channel to reconstruct data ( ) can be obtained. Here, semantic encoding and semantic decoding can be performed through the transformer model-based encoder and transformer model-based decoder described above from the perspective of semantic communication. For example, in the case of performing semantic communication based on FIG. 17, the loss function can be as shown in the following mathematical expression 1. Referring to mathematical expression 1, the loss function can be composed of a part for cross entropy and a part for mutual information. Here, the cross entropy part is composed of input data (s) and reconstructed data ( ) can be the cross entropy between the input data (s), which can be as shown in Equation 2. The cross entropy part is how well the input data (s) is restored to the reconstructed data ( ) may be the part that determines whether or not it has been achieved. For example, in mathematical expression 2, is the lth word in the sentence (sentence, s) as input data. is the actual probability, is reconstructed data The lth word in It can be a predicted probability for . That is, the cross entropy part can mean the difference in the probability between the input data and the reconstructed data.

[0131] [Mathematical Formula 1]

[0132]

[0133] [Equation 2]

[0134]

[0135] Here, the mathematical expression described above can be a complete comparison between the input data and the reconstructed data. However, in semantic communication, the intent conveyed by the source can be crucial for performing downstream tasks. Therefore, it is necessary to consider the reconstructive operation for the portion of the input data that the source intends to convey, rather than the entire data. Considering the above, the following describes a method for utilizing an attention map obtained through an attention technique.

[0136] For example, when applying attention techniques from the perspective of semantic communication, the source can use attention techniques to generate and transmit a semantic representation (SR) to express the intention it wants to convey. The destination can then use attention techniques based on the received semantic representation to determine which part of the original data was more focused on, and through this, determine whether it can interpret the meaning that the source intended to convey. In other words, in semantic communication, attention techniques can perform error detection not based on the reconstruction of the entire data, but only on the part of the entire data that contains the meaning it wants to convey, and a method for this may be necessary.

[0137] Here, the existing system was configured using the existing Transformer model structure as is, and learning was performed to reconstruct the input data based on this, and the trained model was used for inference. In addition, the existing system did not detect errors in the reconstruction of the source input data at the destination by utilizing the attention map (attention matrix), which is the result of the attention technique utilized in each layer constituting the Transformer model. In other words, it was possible to perform only the detection of errors in the reconstruction of the input data, which is the result of the application of the attention technique, without focusing on the attention map, which is the result of the attention technique utilized in each layer constituting the Transformer model. However, semantic communication can be a method of communicating meaning based on the reconstructed data at the semantic level as described above. Therefore, semantic error detection, which detects errors only in the portion of the entire data that contains the meaning to be conveyed, may be necessary, and the following describes a method for performing this based on the attention technique.

[0138] As an example, FIG. 18 is a diagram illustrating a semantic error applicable to the present disclosure. Referring to FIG. 18, when transmitting a message through a communication channel containing noise based on semantic communication, the message received at the destination may contain an error due to the channel noise. Here, the error may occur at the technical level, Level A, as described above in FIG. 14, or at the semantic level, Level B, as described above. Specifically, the technical level may have the ultimate goal of syntactic preservation of the transmitted and received messages. In other words, an error may be determined based on whether the received message can be preserved in the same form as the transmitted message. Accordingly, the difference may be referred to as a syntactic difference, but may not be limited thereto.

[0139] On the other hand, the semantic level may not aim to preserve the syntactic structure of the transmitted and received messages, but rather to reason similarly between the semantics contained in the transmitted message and the semantics contained in the received message. In other words, the semantic level can determine the difference between the transmitted and received messages from the perspective of the destination operation that reflects the intention of the source sending the message, and thereby determine errors. Therefore, a semantic error may be referred to as a semantic difference between a transmitted and received message, but may not be limited thereto.

[0140] As a specific example, referring to FIG. 18, a source (1810) may instruct a destination (1820) by voice the word “copy machine.” Here, the pronunciation of “p” may be similar to the pronunciation of “ff.” Therefore, the destination (1820) receiving the message by voice may misinterpret “copy machine” as “coffee machine.” Considering syntactic integrity, the error may not be significant because some spellings of the transmitted and received messages are different. However, considering the semantic level, misinterpreting “copy machine” as “coffee machine” may be a significant error because it may be interpreted as a different meaning. Considering the above, the source (1810) may transmit additional information to prevent the destination (1820) from misinterpreting at the semantic level. For example, in FIG. 18, the source (1810) may transmit “xerox” as additional information to the destination (1820). As another example, the source (1810) may receive feedback containing misinterpreted information from the destination (1820) and transmit “xerox” as additional information. Here, even if the destination (1820) misinterprets “copy machine” as “coffee machine,” the destination (1820) may recognize that the meaning the source (1810) intends to convey is “copy machine” by using the word “xerox.” Here, the above-described operation may be semantic error correction, and the destination (1820) may perform the semantic error correction operation as intended by the source.

[0141] As described above, a semantic mismatch due to a semantic error may occur between a source (1810) and a destination (1820) performing semantic communication. Therefore, in order to ensure reliability in semantic communication, the destination (1820) needs to check for semantic mismatch based on semantic error detection, and when a semantic error is detected, accurate semantic information reflecting the intention of the source (1810) can be obtained through a semantic error correction process. Below, a method for performing a semantic error correction operation based on this is described.

[0142] As an example, the following describes a method and procedure for performing error detection and error correction based on an attention map in a semantic communication-based system. The following may be a case where two-way communication is performed at a semantic level based on Level B of FIG. 14, but is not limited thereto.

[0143] Task-based operations can be performed in a semantic communication system. Specifically, a source can generate a semantic representation based on the intended message and transmit it to a destination. The destination can then reconstruct the received semantic representation at the semantic level and use the reconstructed data as input to multiple downstream tasks located at the destination to obtain the task's output. Here, semantic-level reconstruction, unlike conventional reconstruction that perfectly restores input data, can be a reconstruction that performs the operations of downstream tasks normally (or according to the intended intent) so that the destination obtains an output corresponding to the intended operation of the source.

[0144] For example, FIG. 19 is a diagram illustrating a method for operating multiple downstream tasks located at a destination when the modality of input data applicable to the present disclosure is an image. Referring to FIG. 19, a source and a destination may have a labeled dataset necessary for learning a multi-task. For example, a source may be an entity that transmits data, such as a terminal, a base station, or other device. In addition, a destination may be an entity that receives data and performs a task appropriate for the purpose, such as a terminal, a base station, or other device. In other words, the source and the destination may be each entity that performs communication, and may not be limited to a specific type of device. For convenience of explanation, the following description will be based on the source and the destination. For example, the source and the destination may have a labeled dataset necessary for learning a task, and the destination may perform a multi-task. Here, each multi-task can operate based on a different purpose, and the semantic representation can be passed from the source to the destination, where the reconstructed data at the semantic level can be passed as input to each multi-task. For example, each multi-task can operate based on its input for a different purpose.

[0145] As a concrete example, a source can encode data given as input (image x, 1910) to generate a semantic representation (latent representation y, 1920). Here, the semantic representation (1920) can be transmitted to a destination through a channel. The destination decodes the received semantic representation (1930) to reconstruct data at the semantic level. (reconstruction data , 1940) can be obtained. After that, the destination is You can use each multi-task as input and check the output after performing an action suitable for the purpose of each task.

[0146] Below, attention techniques are applied to perform inference operations based on trained encoders and decoders, enabling multi-tasking at the destination. Here, the destination can perform error detection on reconstructed data at the semantic level. Below, the operation of the source and destination performing error correction after error detection is described. As an example, the description is based on the respective structures of the source and destination.

[0147] For example, the reconstructed error at the semantic level may not be a reconstructed error for the entire data that the source intends to convey, but may be a reconstructed error for a data region that is intended to be focused on in relation to the meaning that is intended to be conveyed. Therefore, when measuring the reconstructed error at the semantic level, the reconstructed error in a portion other than the region that is intended to be focused on may not be considered. For example, the reconstructed error at the semantic level may be calculated as in Equation 3 below. Specifically, the reconstructed error at the semantic level may be determined based on the ratio of the regions in which the configuration (element) of the bitwise attention map of the target data to be transmitted is 1 among the regions in which the configuration of the bitwise attention map of the target data to be compared is 1. In Equation 3 below, if the region in which the configuration of the bitwise attention map of the target data to be transmitted is 1 and the region in which the configuration of the bitwise attention map of the target data to be compared is 1 are the same, the error rate may be 0, and the error rate may increase as the difference increases.

[0148] [Equation 3]

[0149] Error rate (in semantic level) = 100% - (the proportion of areas where the element of the bitwise attention map of the comparison target is 1 among the areas where the element of the bitwise attention map of the data to be transmitted is 1)

[0150] As an example, the following describes a semantic error detection operation, but this is only one example and may not be limited thereto. Specifically, the source may construct a bitwise attention map based on a set threshold and transmit the bitwise attention map to the destination. The destination may perform error detection using the bitwise attention map transmitted from the source.

[0151] As a specific example, FIG. 20 is a diagram illustrating a method for performing error detection applicable to the present disclosure. For example, FIG. 20 describes the case where the modality of the input data is an image, but this is merely an example for convenience of explanation and may not be limited thereto. Furthermore, FIG. 20 describes one-way communication from a source (2010) to a destination (2020), but this is merely for convenience of explanation and can be equally applied to two-way communication.

[0152] Referring to FIG. 20, a source (2010) may include an encoder (2011) that has completed training based on an attention technique. When input data is provided to the encoder (2011), the encoder (2011) may generate a semantic representation and an attention matrix. Here, the semantic representation may include the meaning to be conveyed based on semantic communication. In addition, the attention matrix may be a matrix generated based on an attention technique. In addition, an attention map may be obtained based on the attention matrix. For example, when the encoder (2011) includes a single layer to which an attention technique is applied, an attention map may be obtained through the attention matrix used in the layer. On the other hand, if the encoder (2011) is composed of multiple layers to which the attention technique is applied, the attention map can be obtained by considering all attention matrices obtained from each layer to which the attention technique is applied.

[0153] As a specific example, when the attention technique is applied to multiple layers, the attention matrix of each layer can be constructed using the following mathematical formula 4 based on the transformer model. Referring to mathematical formula 4, the attention matrix for each layer constituting the transformer model can be obtained. Here, can be an attention matrix indicating how much attention flow will occur from token j of the previous layer to token i of the next layer. That is, represents how much attention the jth token of the previous layer will give to the ith token of the current layer, and multiplying the matrix between the two layers can obtain the total attention flow between the two layers. In addition, the transformer model can use residual connections to prevent the loss of positional encoding information due to backpropagation during the learning process. That is, positional information (or order information) can be provided during the learning process, and residual blocks based on residual connections can be utilized to prevent the information from being lost during the backpropagation process, thereby ensuring that learning converges well even when the number of layers increases. In the transformer model, the unit matrix of Equation 4 may be an additional configuration considering the above-mentioned points.

[0154] [Equation 4]

[0155]

[0156] In addition, as an example, if the downstream task located at the destination (2020) can transmit the target class information it wants to obtain to the source (2010), the source (2010) can first receive the target class information and then calculate an attention aware matrix for obtaining an attention map. That is, the target class information that the downstream task wants to obtain can be reflected in the process of obtaining the attention map. Here, the attention aware matrix is ​​expressed by Equation 4. The gradient value can be obtained by reflecting it as in the following mathematical expression 5. For example, in mathematical expression 5, can be the gradient value related to the target class between token j of the previous layer and token i of the current layer.

[0157] [Equation 5]

[0158]

[0159] In addition, as an example, each layer is applied with multi-head attention according to the transformer model structure. Here, the attention head may be a part to focus on, and the part to focus on may be different for each attention head. Here, the part of interest (or focus) in the data may be set differently depending on the way each attention head is combined (fused). That is, the part to focus on in the data may be set differently based on the multi-head attention structure, and a fusion metric that considers the attention head combination may be applied. As an example, the fusion metric is the mathematical expression 4 (or mathematical expression 5) described above. (or * ) can be used to calculate.

[0160] In addition, as an example, in the attention technique, rather than being interested in each attention value constituting the attention matrix, it is necessary to focus on the upper attention value, and a discard ratio can be set for this purpose. Specifically, only attention values ​​with upper values ​​based on the attention matrix can be utilized, and attention values ​​with lower values ​​may not be necessary. Considering the above, a setting for discarding attention values ​​with lower values ​​can be performed, and a discard ratio can be set for this. In addition, the set discard ratio is in Equation 4 (or Equation 5). (or * ) can be applied.

[0161] Here, the attention recognition matrix can be calculated recursively after applying the fusion matrix and discard ratio set in a specific layer L, which can be as shown in Equation 5 below. For example, the final attention recognition matrix is ​​calculated as a result of calculating the attention matrix of the entire layer through Equation 6. can be obtained.

[0162] [Equation 6]

[0163]

[0164] Final attention recognition matrix based on mathematical expression 6 When obtaining , each layer maintains the total attention flow as 1. Perform normalization to make rows 1 for +I.

[0165] However, the above-described mathematical equations 4 to 6 are only examples for obtaining an attention matrix and may not be limited thereto. For example, in order to focus on a portion of interest in the data, it is necessary to set a fusion matrix and a discard ratio, as described above. The fusion matrix and discard ratio may be set and adjusted based on the operation of the downstream task. As a specific example, in the case of a downstream task operation that requires a large amount of information from the input data, the discard ratio may be adjusted low and error detection may be performed on a larger portion. However, this is only an example and may not be limited thereto.

[0166] When the attention map is obtained based on the above, a threshold-based bitwise attention map (bitwise attention map, ) can be generated. For example, the source (2010) is an attention recognition matrix obtained through the encoder (2011). For each element of It can be applied as in the following mathematical formula 7, and based on this, a threshold-based bit operation attention map can be obtained. In mathematical formula 7 It can mean the configuration of the attention recognition matrix i row j column obtained based on the encoder (2011). The threshold-based bit operation attention map finally obtained through this is This can be derived. For example, It can be a reference value for generating an attention map that takes into account the part that determines whether data reconstruction is normal when performed at the destination.

[0167] [Equation 7]

[0168]

[0169] In addition, based on the above, the source (2010) can finally generate a semantic representation and a threshold-based bit operation attention map and transmit them to the destination (2020). Thereafter, the destination (2020) can perform a reconstruction operation using the semantic representation. Specifically, the decoder (2021) of the destination (2020) reconstructs the semantic representation to generate reconstructed data at the semantic level. can be obtained. After that, the encoder (2022) located at the destination (2020) reconstructs the semantic level data. Attention map with input can be obtained. For example, the encoder (2022) of the destination (2020) obtains an attention map based on the same method as the encoder (2011) of the source (2010). That is, the encoder (2022) of the destination (2020) applies the fusion matrix and the discard ratio based on the same attention matrix calculation method as the encoder (2011) of the source (2010) to obtain a threshold-based bit operation attention map based on the above-described mathematical expression 7. can be obtained. After that, it is transmitted from the source (2010). Generated via the encoder (2021) of the destination (2020) Error detection can be performed by comparing the data received from the source (2010). Specifically, Generated via the encoder (2021) of the destination (2020) An attention aware redundancy check (ARC) can be performed by performing a comparison. ARC is Contrast It can be a process of measuring the number of configurations that do not match 1 as an error rate by checking how many configurations match 1. After that, error detection can be performed using. For example, This can be a criterion for determining whether the reconstructed data is of a semantic level that can convey semantic information to downstream tasks. That is, If it is not satisfied, it may not be passed as input to the downstream task.

[0170] As an example, the following describes a method for performing error correction based on the error detection operation described above. As a specific example, the following describes a method for performing error correction based on an environment as shown in Table 2. However, this is merely an example for convenience of explanation and may not be limited thereto.

[0171] [Table 2]

[0172]

[0173] FIG. 21 is a diagram illustrating a source structure for performing attention map-based semantic error correction applicable to the present disclosure. Referring to FIG. 21, a source (2110) may receive a bit operation attention map based on noisy data (i.e., data restored to a semantic level at the destination) from a destination. However, this is merely a configuration for convenience of explanation and may not be limited to the corresponding operation. Here, the bit operation attention map received by the source (2110) may be one of the bit operation attention maps in Table 3 below. Specifically, the bit operation attention map received by the source (2110) may be a bit operation attention map obtained by using noisy data as input to an encoder located at the destination. Here, the noisy data may be reconstructed data of a semantic level restored by a decoder at the destination using a semantic representation transmitted by the source. That is, the destination decodes the semantic expression received from the source to obtain reconstructed data at the semantic level, and provides this as input to the destination's encoder, so that the obtained bit operation attention map can be transmitted to the source.

[0174] As another example, the bit operation attention map received by the source (2110) may be a bit operation attention map for the remaining area excluding the area occupied by the bit operation attention map obtained by providing noise data as input to the destination's encoder in the bit operation attention map transmitted by the source (2110). In other words, it may be a map representing the residual area based on the bit operation map.

[0175] [Table 3]

[0176]

[0177] When the source (2110) receives a bit operation attention map from the destination, the source (2110) can check whether the number of retransmissions for the current semantic error correction exceeds a maximum retransmission count (maxSemanticRetCnt) as a threshold value. Here, the threshold for the number of retransmissions may be the maximum retransmission count, but may not be limited to that name. For example, whether the number of retransmissions for the current semantic error correction exceeds the threshold may be performed in a semantic data retransmission count checker (2111), but may not be limited thereto. Here, the maximum retransmission count (maxSemanticRetCnt) may be a maximum transmission count-based counter for error correction in the semantic domain, thereby preventing indiscriminate retransmissions. That is, if the number of retransmissions for the current semantic error correction exceeds the maximum retransmission count (maxSemanticRetCnt), the source (2110) may perform a system failure operation indicating that the semantic error correction has failed and transmit a system failure message. For example, the system failure operation may be performed based on a system failure operator (2115), but may not be limited thereto. The source (2110) may perform re-configuration for semantic error correction based on the system failure or update existing data with new data and perform transmission. However, this is just one example and may not be limited thereto.

[0178] If the number of retransmissions for the current semantic error correction does not exceed the maximum retransmission count (maxSemanticRetCnt), the source (2110) can check whether the bitwise attention map of Table 3 described above has been received from the destination. For example, whether the bitwise attention map of Table 3 has been received can be performed in the bitwise attention map receipt checker (2112), but it may not be limited thereto. Here, if the source (2110) does not receive the bitwise attention map and the number of retransmissions for error correction is 0, the source (2110) can recognize that new data is being transmitted from the source to the destination via semantic communication. Accordingly, the source (2110) can input the new data into the encoder (2113) to generate the above-described semantic representation and bitwise attention map and transmit them to the destination, as described above.

[0179] On the other hand, if the source (2110) receives the bit operation attention map while the number of retransmissions for the current semantic error correction does not exceed the maximum retransmission count (maxSemanticRetCnt), the source (2110) can extract a part for performing semantic error correction at the destination from the original data. For example, the operation of extracting a part for performing semantic error correction at the destination from the original data may be performed by a residual area data extractor (2116), but this is only one example and is not limited thereto. For example, the operation of extracting a part for performing semantic error correction at the destination from the original data may vary depending on the type of bit operation attention map.

[0180] Specifically, when the source (2110) receives a bit operation attention map based on noise data (i.e., data restored to a semantic level at the destination) from the destination, the source can generate a bit operation attention map representing the remaining area excluding the area occupied by the transmitted bit operation attention map from the area occupied by the bit operation attention map generated based on the original data. Thereafter, the source (2110) can extract residual area data used to correct semantic errors by masking the bit operation attention map to the original data and performing semantic error correction. On the other hand, when the source (2110) receives a residual area-based bit operation attention map from the destination, the source (2110) can extract residual area data used to correct semantic errors by masking the received bit operation attention map to the original data and performing semantic error correction.

[0181] FIG. 22 is a diagram illustrating a method for obtaining residual region data used to correct semantic errors at a source after error detection applicable to the present disclosure. Referring to FIG. 22, a source (2110) can compare a bit operation attention map (2210) based on original data with a bit operation attention map (2220) based on noise data received from a destination (i.e., data restored to a semantic level at the destination). The source (2110) can derive a bit operation attention map (2230) for the remaining portion by excluding overlapping portions from each bit operation attention map. Thereafter, the bit operation attention map for the remaining portion can be masked to the original data to obtain residual region data (2240) used to correct semantic errors. After that, the source (2110) can obtain a semantic representation and a bit operation attention map by providing the residual region data (2240) as an input to the encoder (2113). Specifically, the source (2110) obtains an attention matrix based on the residual region data (2240) and adds the attention matrix to the attention matrix. By performing a bitwise operation based on the bitwise operation, the final bitwise operation attention map can be obtained. For example, the attention matrix generated by the encoder (2113) can be derived as a bitwise operation attention map by a bitwise operation attention map generator (2117) and can be transmitted to a semantic packet generator (2114). In addition, the semantic expression generated by the encoder (2113) can also be transmitted to the semantic packet generator (2114), and the semantic expression and the bitwise operation attention map can be configured as a semantic packet and transmitted to the destination, but are not limited thereto. After transmitting the semantic packet, the source (2110) can store (2118) the bitwise operation attention map included in the semantic packet. Additionally, the source (2110) may store a bit operation attention map based on residual region data configured in the semantic packet, depending on whether error detection is performed on the reconstruction data of the semantic level based on residual region data based on the initial operation settings, but is not limited thereto.

[0182] FIG. 23 is a diagram illustrating a bit operation attention map based on residual region data used to correct semantic errors applicable to the present disclosure. Referring to FIG. 23, residual region data (2310) can be obtained through masking using a bit operation attention map for the remaining portion of the original data. Specifically, residual region data (2310) used to correct semantic errors can be obtained through the operation of a residual region extractor (2116) based on a bit operation attention map received from a destination in the original data.

[0183] Thereafter, residual region data (2310) may be provided as input to an encoder (2113) of a source (2110), so that a semantic representation and a bit operation attention map (2320) for the residual region data may be generated. The source (2110) may transmit the semantic representation and the bit operation attention map generated based on the residual region data (2310) to a destination.

[0184] FIG. 24 is a diagram illustrating a destination structure that performs semantic error correction applicable to the present disclosure. Referring to FIG. 24, the destination (2410) can perform semantic level reconstruction on residual area data used to correct semantic errors through a decoder (2412) using a semantic representation received from a source, thereby obtaining reconstructed data at the semantic level. As a specific example, the destination (2410) can receive a semantic packet including a semantic representation and a bit operation attention map from the source, and decompose the semantic representation and the bit operation attention map. Here, the semantic packet can be decomposed into the semantic representation and the bit operation attention map through a semantic packet decomposer (2411), but may not be limited thereto.

[0185] The destination (2410) can obtain reconstructed data at the semantic level through a semantic expression. Here, the reconstructed data type checker (2413) can check the type of the reconstructed data at the semantic level. The reconstructed data type at the semantic level can be the residual area data used to correct semantic errors or the original data (i.e., new data for which semantic errors are first checked). If the reconstructed data type at the semantic level is the original data, the data type can be set to the original data and then the data type can be passed to the data type configurator (2415). On the other hand, if the reconstructed data type at the semantic level is residual area data, the destination (2410) can determine whether to perform error detection on the reconstructed data at the semantic level, which is the residual area data used to correct semantic errors. For example, whether to perform error detection on the reconstructed data of the semantic level of residual area data used to correct semantic errors may be performed by a checker (checker for performing semantic error checking, 2414) of the destination (2410), but may not be limited thereto. For example, the above-described operation based on whether to perform error detection on the reconstructed data of the semantic level based on residual area data may be selected based on the initial operation setting of the destination (2410), but may not be limited thereto.

[0186] When performing semantic error detection on reconstructed data at a semantic level based on residual area data used to correct semantic errors, the data type can be set to residual area data and passed to the data type setter (2415).

[0187] On the other hand, if error detection is not performed on the semantic level reconstruction data based on the residual region data used to correct semantic errors, synthesis can be performed with the semantic level reconstruction data obtained from the previous process that is the target of semantic error correction. For example, data synthesis can be performed in a data compositor (2418), but may not be limited thereto. Here, the data type can be set to the synthesized data of the semantic level and transmitted to the data type configurator (2415) described above. The restored data of the semantic level obtained through the decoder (2412) or the synthesized data obtained through the data synthesizer (2418) can be transmitted as the input of the encoder (2414). In the encoder (2414), data transmitted to the encoder (2414) can be selected based on the data type transmitted from the data type setter (2415) and the data can be used as input to the encoder (2414).

[0188] The encoder (2416) obtains an attention matrix by applying a set metric based on the input data, and sets the same threshold as the source ( ) can be used to obtain the final bit operation attention map. For example, the above-described operation may be performed in the attention map generator (2417) of the destination (2410), but may not be limited thereto.

[0189] After that, the destination (2410) can perform an attention aware redundancy check (ARC) that compares the final bit operation attention map with the received bit operation attention map. For example, the ARC can be performed in a semantic error checker (2419) of the destination (2410), but may not be limited thereto. In the case where semantic error detection is performed on the reconstructed data at a semantic level based on residual region data used to correct semantic errors, an ARC operation can be performed to check the error rate by comparing the received bit operation attention map related to the residual region data with the bit operation attention map generated based on the reconstructed data that restores the semantic expression of the residual region data received at the destination (2410) to the semantic level. That is, if the error rate is lower than a threshold (based on the ARC operation), ) can be checked whether it is less than or equal to.

[0190] FIG. 25 is a diagram illustrating an ARC operation for residual region data used to correct semantic errors applicable to the present disclosure. Referring to FIG. 25, a source can generate a bit operation attention map (2520) from residual region data (2510) and transmit it to a destination, as described above. The destination (2410) can generate reconstructed data at a semantic level based on the semantic representation obtained from the source, and can generate a bit operation attention map (2530) through the same, and perform an ARC operation to compare the two bit operation attention maps. Here, if no semantic error occurs, the data type for the reconstructed data at the semantic level can be checked. For example, the type check for the reconstructed data at the semantic level can be performed in a reconstructed data type checker (2420), but is not limited thereto. For example, in the case described above, the semantic-level reconstruction data may be residual region data used to correct semantic errors, and the residual region data may be passed to the data synthesizer (2418) described above and combined with the semantic-level reconstruction data of the previous process. On the other hand, if the semantic-level reconstruction data is not residual data, it may be provided as input to a downstream task, and this will be described later.

[0191] As another example, if semantic error detection is not performed on the semantic level reconstruction data based on the residual region data used to correct semantic errors, the data that is the target of semantic error correction and the semantic level reconstruction data based on the residual region data may be synthesized, and a bit operation attention map may be obtained from the synthesized data. Here, the ARC operation may be performed between the original data-based bit operation attention map received in the previous process and the bit operation attention map generated from the synthesized data. As an example, FIG. 26 is a diagram illustrating a method of performing an ARC operation applicable to the present disclosure. Referring to FIG. 26, the destination (2410) may synthesize the semantic level-restored residual region data (2610) and the semantic level-restored data (2620) stored in the previous process as the target of semantic error correction. At this time, semantic error detection is not performed on the semantic level-restored residual region data (2610). Here, a bit operation attention map (2650) can be obtained based on the synthesized data of the semantic level and can be compared with the original data-based bit operation attention map (2640). Through the above-described comparison, the ARC operation can be performed. That is, when the error rate is below the threshold ( ) can be determined. Here, if the error rate is less than the aforementioned threshold, it can be determined that no semantic error occurs in the synthesized data at the semantic level through semantic error correction. Accordingly, the destination (2410) can use the synthesized data at the semantic level as input to a downstream task to perform the task in accordance with the intention desired by the source.

[0192] In addition, as an example, if an error occurs based on a semantic error check in FIG. 24, an early stopping check may be performed. Here, the early stopping check may be performed by an early stopping checker (2421), but may not be limited thereto. More specifically, the early stopping check may be determined based on whether the error rate has improved by a certain rate or more. As an example, an early stopping threshold for the above-described determination ( ) can be set. The destination is a threshold ( ) can be used to determine whether to stop the semantic error correction operation by early stopping. That is, the semantic error rate measured based on the data obtained by performing synthesis on the data that is the target of semantic error correction is higher than the threshold set in comparison to the previously measured semantic error rate. ) If the improvement is greater than or equal to the above, the destination (2410) can set a new residual area based on the currently set residual area and perform retransmission for semantic error correction. For example, the destination (2410) can generate a bitwise attention map-based packet through a bitwise attention map-based packet generator (2422) and transmit the generated packet to the source.

[0193] On the other hand, the data obtained by performing synthesis on the data that is the target of semantic error correction is set to a threshold ( ) is improved by a lower semantic error rate, the destination (2410) may decide to early abort. More specifically, in the above-described situation, retransmission of existing data may be more efficient than retransmission of remaining area data. That is, since the error rate is not improved even if retransmission based on remaining area data is performed, there is a need to perform retransmission based on existing original data. Considering the above-described point, the early abort check related threshold ( ) so that the destination (2410) can perform an early abort to perform a system failure operation even if the current number of retransmissions is lower than the maximum retransmission count (maxSemanticRetCnt) related to the retransmission count confirmed by the source. Through this, the destination (2410) can perform a re-configuration operation for the currently performed semantic error correction or prepare an operation to receive new data instead of existing data, but is not limited thereto.

[0194] After an early termination is determined at the destination (2410), a system failure operation can be performed and a system failure message can be transmitted. For example, the system failure operation can be performed based on a system failure operator (2423), but may not be limited thereto. Based on the system failure, the destination (2410) can perform re-configuration for semantic error correction or update existing data with new data to perform transmission. However, this is merely an example and may not be limited thereto.

[0195] On the other hand, if the destination (2410) determines that it does not need to perform early termination, it can store the reconstructed data and the bit operation attention map at the semantic level based on the data type used as the input of the encoder (2416). In addition, the destination (2410) can transmit the bit operation attention map to request retransmission for semantic error correction to the source after performing an operation related to the bit operation attention map to be transmitted to the source. Here, the operation related to the bit operation attention map may be an operation based on the type of the bit operation attention map received from the source. For example, the destination (2410) can determine which bit operation attention map to transmit to the source when performing the initial setup.

[0196] For example, if the semantic error detection target is the semantic level reconstruction data for the residual region data used to correct the semantic error, and no error occurs based on the semantic error check, only the part of the semantic level reconstruction data for the non-semantic error region can be used to perform synthesis with the data that is the semantic error correction target. As an example, FIG. 27 is a diagram illustrating a method for performing data synthesis using the reconstruction data based on the residual region data used to correct the semantic error applicable to the present disclosure. Referring to FIG. 27, semantic error detection can be performed on the reconstruction data based on the residual region data used to correct the semantic error. As an example, the ARC operation can be performed by comparing the bit operation attention map (2710) received from the source and the bit operation attention map (2720) acquired through the semantic level reconstruction data based on the residual region data acquired at the destination. Here, the destination (2410) performs the ARC operation to obtain a threshold ( ) is less than, a bit operation attention map (2730) for a part that is not a semantic error can be obtained, and residual region data (2740) used to correct semantic errors can be obtained by masking it to the reconstruction data of the semantic level. Thereafter, the residual region data (2740) can be synthesized with the data (2750) obtained in the previous process as a target of semantic error correction.

[0197] As an example, FIG. 28 is a diagram illustrating a method for obtaining an attention map based on synthesized data applicable to the present disclosure and performing a semantic error check based thereon. Referring to FIG. 28, a bit operation attention map (2830) can be generated based on the synthesized data (2810) of the semantic level through FIG. 27, and a semantic error check can be performed by comparing it with the bit operation attention map (2820) of the original data. Here, if the semantic error rate is less than a threshold (semantic error rate < ), the destination (2410) can use the data as input to a downstream task to perform a task operation that matches the source's intended intent. On the other hand, if the semantic error rate is greater than the threshold based on the semantic error check (semantic error rate≥ ), the destination (2410) may determine that there is a semantic error in the synthetic data and perform the early termination check described above. Thereafter, the destination (2410) may perform a process of determining whether to request retransmission of the remaining area data for semantic error correction, as described above.

[0198] FIG. 29 is a diagram illustrating an initial setup method of semantic communication applicable to the present disclosure. Referring to FIG. 29, a first node (2910) may obtain a synchronization signal from a second node (2920) and perform synchronization to be connected. For example, the first node (2910) may be the aforementioned source, and the second node (2920) may be the aforementioned destination. In another example, the first node (2910) may be the aforementioned destination, and the second node (2920) may be the aforementioned source. In addition, as an example, in FIG. 30, the first node (2910) may be a terminal, and the second node (2920) may be a base station. In addition, as an example, the first node (2910) may be a base station, and the second node (2920) may be a terminal, and the present invention is not limited to a specific form. Additionally, as an example, FIG. 30 can be applied to both one-way and two-way communications and is not limited to a specific form.

[0199] However, for the convenience of explanation, the description is based on the case where the first node (2910) is a terminal and the second node is a base station (2920). The second node (2920) can request capability information from the first node (2910). Here, the capability information may include various information based on the first node type. For example, the capability information may include information on whether the first node (2910) has the above-described semantic communication performance capability. That is, the capability information may include semantic communication capability information of the first node (2910). The first node (2910) can transmit the capability information to the second node (2920) based on a request from the second node (2920). Here, for example, the capability information may further include information on the types of raw data that the first node (2910) can generate, collect, or process, and the computational capabilities of the device, and may not be limited to a specific form. Thereafter, the second node (2920) can determine whether to perform semantic communication. For example, the second node (2920) can recognize that the first node (2910) has the capability to perform semantic communication based on the capability information of the first node (2910). In addition, the second node (2920) can further consider other acquired information and other parameters to determine whether to perform semantic communication, and can instruct the first node (2910) whether to perform semantic communication. That is, if the second node (2920) determines to perform communication with the first node (2910) based on semantic communication, the second node (2920) can transmit information indicating semantic communication to the first node (2910). Here, the information indicating semantic communication can include semantic communication-related information. Afterwards, the first node (2910) can store semantic communication related information transmitted together with semantic communication instruction information.For example, the semantic communication-related information may include an encoder / decoder model, an attention matrix calculation method, an attention head fusion matrix, an attention value discard ratio, a threshold related to a bit operation attention map, an error detection-related threshold, a maximum semantic data transmission count, and an early termination threshold. For example, the attention matrix calculation method included in the semantic communication-related information may be information about mathematical expressions 4 to 6, but may not be limited thereto. In addition, the threshold related to a bit operation attention map may be. And the threshold for error detection is It may be, but is not limited to,

[0200] Also, as an example, the maximum semantic data transmission count may be the maximum retransmission count (maxSemanticRetCnt) described above. Also, as an example, the early termination threshold may be the It may be, but is not limited to,

[0201] Additionally, semantic communication instruction information and semantic communication related information may be transmitted from the second node (2920) to the first node (2910) via at least one of a DCI (downlink control information), a MAC (medium access control) CE (control element), and an RRC (radio resource control) message.

[0202] As another example, semantic communication indication information may be indicated through upper layer signaling, and semantic communication-related information may also be transmitted through DCI. That is, the second node (2920) may obtain capability information from the first node (2910) and, if semantic communication in the above-described manner is possible, transmit semantic communication-related information to the first node (2910). The first node (2910) may store the received information and perform the above-described semantic communication. In addition, as an example, each step and operation of FIG. 29 may be omitted or merged based on settings or configurations, and may not be limited to a specific form.

[0203] FIG. 30 is a diagram illustrating a source operation method applicable to the present disclosure. Referring to FIG. 30, the source can check whether there is data to be transmitted (S3001). If there is data to be transmitted from the source, the source can check whether the semantic data retransmission count is less than the maximum retransmission count (S3002). For example, the maximum retransmission count may be the above-described maxSemanticRetCnt, but may not be limited thereto. Here, if the retransmission count is greater than the maximum retransmission count, the source can perform a system failure operation (S3003). For example, the source can perform re-configuration for semantic error correction based on the system failure or perform transmission by updating existing data with new data. As another example, the source can reset the semantic data retransmission count to 0 and initialize the previously stored bit operation attention map information, but may not be limited thereto. On the other hand, if the retransmission counter is less than or equal to the maximum retransmission count, the source can check whether the received bit operation attention map exists (S3004). Here, if the received bit operation attention map does not exist in the source, the source can recognize that it is a new data transmission. That is, the input may be new data (S3005), and the new data may be encoded (S3009). On the other hand, if the received bit operation attention map exists in the source, the source can increase the retransmission counter by one (S3006), and extract the residual region data used to correct a semantic error based on the bit operation attention map (S3007), and the source can recognize that it is a residual region data transmission for semantic error correction (S3008), and the residual region data may be encoded.(S3009) For example, encoding can be performed by considering a matrix, a fusion matrix, and an attention value discard ratio for obtaining an attention matrix, as described above. Then, the source can generate a bit operation attention map based on the encoding. (S3010) Here, the bit operation attention map is a threshold based on the attention matrix. ) can be generated. After that, the source can generate a semantic packet including a bit operation attention map and a semantic representation and transmit it to the destination, as described above. (S3011) After that, the source can store the bit operation attention map transmitted to the destination. (S3012)

[0204] FIG. 31 is a diagram illustrating a destination operation method applicable to the present disclosure. Referring to FIG. 31, a destination can receive a semantic packet transmitted from a source (S3101). Here, the semantic packet can include a semantic representation and a bit operation attention map, and the destination can obtain the semantic representation and the bit operation attention app from the received semantic packet. For example, the received semantic packet can be decomposed into the semantic representation and the bit operation attention app through a semantic decomposer. Thereafter, decoding can be performed from the semantic representation obtained through the semantic decomposer to obtain reconstructed data at the semantic level (S3102).

[0205] After that, the destination can check the type of the reconstructed data at the semantic level. (S3104) Here, if the reconstructed data at the semantic level is reconstructed data based on the original data, the reconstructed data can be provided as an input to the encoder. (S3105) The encoding can be performed in the same manner as the source, and thus a bit operation attention map can be generated. On the other hand, if the reconstructed data at the semantic level is reconstructed data based on residual region data, it can be determined whether a semantic error check is required. (S3106) For example, whether a semantic error check is required can be determined based on an initial setting, but may not be limited thereto. Here, if a semantic error check is required, the destination can provide residual region data used to correct semantic errors as an input to the encoder. (S3107) The encoding can be performed in the same manner as the source, and thus a bit operation attention map can be generated. On the other hand, if semantic error checking is not required, the destination can synthesize semantic-level reconstruction data for the residual region data and semantic-level reconstruction data stored in a previous process as a target of semantic error correction (S3108). Here, the synthesized semantic-level reconstruction data can be provided as an input to the encoder (S3109). Encoding can be performed in the same manner as the source, and a bit-operation attention map can be generated accordingly. That is, the encoding input can be determined as reconstruction data based on original data, semantic-level reconstruction data for the residual region based on whether semantic error checking is performed, or synthesized semantic-level data. Thereafter, the destination can perform encoding by considering a matrix, a fusion matrix, and an attention value discard ratio for obtaining an attention matrix in the same manner as the source.(S3110) After that, the destination can generate a bit operation attention map in the same manner as the source. (S3111) Here, the bit operation attention map is thresholded based on the attention matrix. ) can be generated. After that, the destination can perform semantic error detection, and semantic error detection can be performed by setting a threshold ( ) can be performed through (S3112). Here, it is checked whether a semantic error has occurred (S3113). If no semantic error is detected, the destination can check the input data type of the encoder. (S3114) For example, if the data type is residual area data, combination with the reconstructed data of the semantic level of the previous process can be performed. On the other hand, if the data type is not residual area data, the data may be restored data of the semantic level of the original data or synthesized data. The destination can perform the operation intended by the source by passing the data to the downstream task and performing the task. (S3115)

[0206] On the other hand, when checking whether a semantic error has occurred (S3113), if a semantic error is detected, the destination can check whether to stop early (S3116). Here, early stop is determined by a threshold ( ), which is as described above. For example, if early termination is determined based on the check for early termination, the destination may perform a system failure operation, which is as described above. (S3117) On the other hand, if early termination is not determined based on the check for early termination, the destination may store the reconstructed data of the semantic level or the synthesized data of the semantic level and the bit operation attention map based on the bit operation attention map and the received original data (S3118), and may transmit the bit operation attention map information based on the reconstructed data of the semantic level or the synthesized data of the semantic level to the source, which is as described above. (S3119)

[0207] Fig. 32 is a flowchart illustrating a first node operation method applicable to the present disclosure. Referring to Fig. 33, the first node can establish a connection with the second node (S3210). Here, the first node may be the aforementioned source, and the second node may be the aforementioned destination. As another example, the first node may be the aforementioned destination, and the second node may be the aforementioned source. In addition, as an example, the first node may be a terminal, and the second node may be a base station. In addition, as an example, the first node may be a base station, and the second node may be a terminal, and the present invention is not limited to a specific form. In addition, as an example, Fig. 33 may be applicable to both one-way communication and two-way communication, and is not limited to a specific form.

[0208] Here, the first node can receive a request for first node capability information from the second node (S3220), and based on this, transmit the first node capability information to the second node. (S3230) For example, the first node capability information can include information indicating whether the first node supports downstream task-based semantic communication. In addition, the first node capability information can further include at least one of first node creation information, first node collection information, processable raw data type information, and device computation capability information, as described above. Next, the first node can receive semantic communication instruction information from the second node. (S3240) Here, the semantic communication-related information in the semantic communication instruction information can include at least one of an encoder model, a decoder model, an attention matrix calculation method, a fusion matrix, an attention value discard ratio, a bitwise attention map threshold, an error detection threshold, a maximum retransmission count, and an early stopping threshold, as described above. Thereafter, the first node can encode the data using the attention technique through the received semantic communication-related information and transmit it to the second node. (S3250) Here, the first node can encode the data and transmit it to the second node based on whether it receives the first bitwise attention map from the second node and the number of times the semantic data is retransmitted. For example, if there is data to be transmitted to the second node, the first node can compare the number of times the semantic data is retransmitted with the maximum retransmission count.If the number of semantic data retransmissions is less than the maximum value and the first node has received the first bit operation attention map from the second node, the first node can perform encoding by generating residual region data used to correct semantic errors. In addition, if the number of semantic data retransmissions is less than the maximum value and the first node has not received the first bit operation attention map from the second node, the first node can recognize that the data transmitted to the second node is new data, and can encode and transmit the data. Here, the encoding can be performed based on at least one of an attention matrix operation method, a fusion matrix, and an attention value discard ratio. In addition, a semantic representation and a second bit operation attention map can be generated based on the encoding, and a semantic representation including the semantic representation and the second bit operation attention map can be transmitted to the second node. For example, if the first bit operation attention map received by the first node is a bit operation attention map based on reconstructed data at the semantic level, the first node can obtain a residual region-based bit operation attention map by comparing the original data-based bit operation attention map with the reconstructed data-based bit operation attention map at the semantic level. In addition, the first node can generate residual region data used to correct a semantic error based on the residual region bit operation attention map. On the other hand, if the first bit operation attention map received by the first node is a bit operation attention map based on residual region data, residual region data can be generated based on the residual region bit operation attention map.

[0209] Additionally, if the number of semantic data retransmissions is greater than the maximum value, the first node may perform a system failure operation. Here, the first node may perform at least one of transmitting a system failure message, re-establishing semantic error correction, and updating data based on the system failure operation, as described above.

[0210] Fig. 33 is a flowchart illustrating a second node operation method applicable to the present disclosure. Referring to Fig. 34, the second node can establish a connection with the first node (S3310). Here, the first node may be the aforementioned source, and the second node may be the aforementioned destination. As another example, the first node may be the aforementioned destination, and the second node may be the aforementioned source. In addition, as an example, the first node may be a terminal, and the second node may be a base station. In addition, as an example, the first node may be a base station, and the second node may be a terminal, and the present invention is not limited to a specific form. In addition, as an example, Fig. 30 may be applicable to both one-way communication and two-way communication, and is not limited to a specific form.

[0211] Here, the second node can transmit a request for first node capability information to the first node (S3320), and based on this, can receive first node capability information from the first node (S3330). For example, the first node capability information may include information indicating whether the first node supports downstream task-based semantic communication. In addition, the first node capability information may further include at least one of first node creation information, first node collection information, processable raw data type information, and device computation capability information, as described above. Next, the second node can transmit semantic communication instruction information to the first node. (S3340) Here, the semantic communication-related information in the semantic communication instruction information can include at least one of an encoder model, a decoder model, an attention matrix calculation method, a fusion matrix, an attention value discard ratio, a bitwise attention map threshold, an error detection threshold, a maximum retransmission count, and an early stopping threshold, as described above. Thereafter, the second node can receive data encoded using an attention technique from the first node through the received semantic communication-related information. (S3350)

[0212] Here, the second node can perform a downstream task through the data received from the first node based on whether a semantic error check is performed and whether a semantic error has occurred. For example, the second node can receive a semantic packet from the first node and obtain a semantic representation and a first bit operation attention map through the received semantic packet. Here, the received semantic packet can be decomposed into the semantic representation and the first bit operation attention map based on a semantic decomposer, but may not be limited thereto. Thereafter, the second node can decode the semantic representation to obtain semantic-level reconstructed data from the semantic representation. Here, the semantic-level reconstructed data is data reconstructed at the semantic level from the semantic representation associated with the newly transmitted data, and the first bit operation attention map can be a bit operation attention map based on the newly transmitted data. Additionally, the reconstruction data of the semantic level is the reconstruction data of the semantic level based on residual region used to correct semantic errors, and the first bit operation attention map may be a bit operation attention map based on residual region.

[0213] In addition, when the second node performs a semantic error check on the residual region data used to correct semantic errors, encoding of the residual region-based semantic level reconstruction data can be performed in the same manner as the encoding method of the first node. On the other hand, when the second node does not perform a semantic error check on the residual region data used to correct semantic errors, encoding can be performed in the same manner as the encoding method of the first node by synthesizing the residual region-based semantic level reconstruction data and the stored semantic level reconstruction data. Here, the encoding can be performed based on at least one of an attention matrix operation method, a fusion matrix, and an attention value discard ratio. A second bit operation attention map can be generated based on the encoding, and semantic error detection can be performed based on the first bit operation attention map and the second bit operation attention map.

[0214] Here, if a semantic error occurs based on the performed semantic error detection through the error detection threshold, the second node can determine whether to terminate early. Furthermore, if no semantic error occurs based on the performed semantic error detection through the error detection threshold, the second node can perform downstream tasks after checking the data type.

[0215] For example, when a semantic error occurs, whether to perform an early termination can be determined through an early termination threshold based on a first bit operation attention map and a second bit operation attention map. In addition, when the second node performs an early termination, the second node can perform a system failure operation. The second node can perform at least one of transmitting a system failure message, re-establishing semantic error correction, and updating data based on the system failure operation. In addition, when the second node does not perform an early termination, the second node can store at least one of the reconstruction data and the synthetic data of the semantic level based on the residual region, and store and transmit a bit operation attention map based on the stored data to the first node.

[0216] It is clear that the examples of the proposed methods described above can also be considered as a type of proposed methods, as they can be included as one of the implementation methods of the present disclosure. Furthermore, the proposed methods described above can be implemented independently, but they can also be implemented in the form of a combination (or merge) of some of the proposed methods. Information regarding the applicability of the proposed methods (or information regarding the rules of the proposed methods) can be defined by a rule such that the base station notifies the terminal of the application of the proposed methods through a predefined signal (e.g., a physical layer signal or a higher layer signal).

[0217] The present disclosure may be embodied in other specific forms without departing from the technical ideas and essential features described herein. Therefore, the above detailed description should not be construed as limiting in all respects but rather as illustrative. The scope of the present disclosure should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the present disclosure are intended to be included within the scope of the present disclosure. Furthermore, claims that do not explicitly cite each other in the claims may be combined to form embodiments or incorporated into new claims through post-filing amendments.

[0218] Embodiments of the present disclosure can be applied to various wireless access systems. As an example of various wireless access systems, 3GPP (3 rd Generation Partnership Project) or 3GPP2 system, etc.

[0219] The embodiments of the present disclosure can be applied not only to the various wireless access systems described above, but also to all technical fields that utilize these various wireless access systems. Furthermore, the proposed method can also be applied to mmWave and THz communication systems utilizing ultra-high frequency bands.

[0220] Additionally, embodiments of the present disclosure can be applied to various applications such as autonomous vehicles and drones.

Claims

1. In a first node operation method in a wireless communication system, Step of establishing a connection with a second node; A step of receiving a request for first node capability information from the second node; A step of transmitting first node capability information to the second node based on the first node capability information request; A step of receiving semantic communication instruction information from the second node; and Encode data using an attention technique through semantic communication-related information in the received semantic communication instruction information and transmit it to the second node. A method of operating a first node, wherein the first node encodes the data and transmits it to the second node based on whether the first node receives a first bitwise attention map from the second node and the number of times the semantic data is retransmitted.

2. In paragraph 1, A second node operating method, wherein the semantic communication-related information in the semantic communication instruction information includes at least one of an encoder model, a decoder model, an attention matrix calculation method, a fusion matrix, an attention value discard ratio, a bitwise attention map threshold, an error detection threshold, a maximum retransmission count, and an early stopping threshold.

3. In paragraph 1, A first node operation method, wherein the first node compares the number of semantic data retransmissions with the maximum retransmission count when there is data to be transmitted to the second node.

4. In paragraph 3, If the number of retransmissions of the semantic data is less than the maximum value and the first node receives the first bit operation attention map from the second node, the first node performs the encoding by generating residual region data used to correct the semantic error, A method for operating a first node, wherein if the number of retransmissions of the semantic data is less than the maximum value and the first node does not receive the first bit operation attention map from the second node, the first node determines the data transmitted to the second node as new data and performs the encoding.

5. In paragraph 4, The above encoding is performed based on at least one of an attention matrix operation method, a fusion matrix, and an attention value discard ratio, A first node operation method, which generates a semantic representation and a second bit operation attention map based on the encoding, and transmits a semantic representation including the semantic representation and the second bit operation attention map to the second node.

6. In paragraph 4, If the first bit operation attention map received by the first node is a bit operation attention map based on reconstructed data of the semantic level, the first node obtains a residual region-based bit operation attention map by comparing the original data-based bit operation attention map with the reconstructed data-based bit operation attention map of the semantic level, A first node operation method for generating the residual region data based on the residual region bit operation attention map.

7. In paragraph 4, A first node operation method, wherein the first bit operation attention map received by the first node is a bit operation attention map based on residual region data used to correct semantic errors, and wherein the residual region data is generated based on the residual region bit operation attention map.

8. In paragraph 3, A first node operating method, wherein if the number of retransmissions of the above semantic data is greater than the maximum value, the first node performs a system failure operation.

9. In paragraph 8, A first node operating method, wherein the first node performs at least one of transmitting a system failure message, re-establishing semantic error correction, and updating data based on the system failure operation.

10. In a second node operation method in a wireless communication system, Step of establishing a connection with the first node; A step of transmitting a request for first node capability information to the first node; A step of receiving first node capability information from the first node based on the first node capability information request; A step of transmitting semantic communication instruction information to the first node; and Receive encoded data based on the attention technique from the first node through semantic communication related information in the above semantic communication instruction information, A second node operating method, wherein the second node performs a downstream task through the data received from the first node based on whether a semantic error check is performed and whether a semantic error has occurred.

11. In clause 10, A second node operating method, wherein the semantic communication-related information in the semantic communication instruction information includes at least one of an encoder model, a decoder model, an attention matrix calculation method, a fusion matrix, an attention value discard ratio, a bitwise attention map threshold, an error detection threshold, a maximum retransmission count, and an early stopping threshold.

12. In paragraph 11, The second node receives a semantic packet from the first node, Obtaining a semantic representation and a first bit operation attention map from the received semantic packet, Obtaining reconstruction data at the semantic level from the above semantic expression, A second node operation method, wherein the above semantic level reconstruction data is residual region-based semantic level reconstruction data, and the first bit operation attention map is a residual region-based bit operation attention map.

13. In paragraph 12, When the second node performs the semantic error check, the reconstruction data of the residual area-based semantic level is encoded in the same manner as the encoding method of the first node, A second node operation method, wherein, when the second node does not perform the semantic error check, encoding is performed in the same manner as the encoding method of the first node by synthesizing the reconstruction data of the semantic level based on the residual area and the reconstruction data of the stored semantic level.

14. In paragraph 13, The above encoding is performed based on at least one of an attention matrix operation method, a fusion matrix, and an attention value discard ratio, A second node operation method for generating a second bit operation attention map based on the above encoding and performing semantic error detection based on the second bit operation attention map.

15. In paragraph 14, If a semantic error occurs based on the semantic error detection performed above, the second node determines whether to stop early, A second node operation method, wherein if the semantic error does not occur based on the performed semantic error detection, the second node performs the downstream task after checking the data type.

16. In paragraph 15, The second node determines whether the semantic error has occurred through the error detection threshold based on the first bit operation attention map and the second bit operation attention map, A second node operation method, wherein, when the above semantic error occurs, whether to perform the early termination is determined through the early termination threshold based on the first bit operation attention map and the second bit operation attention map.

17. In paragraph 16, If the second node performs the early termination, the second node performs a system failure operation. A second node operating method, wherein the second node performs at least one of transmitting a system failure message, re-establishing semantic error correction, and updating data based on the system failure operation.

18. In paragraph 16, A second node operation method, wherein, if the second node does not perform the early termination, the second node stores at least one of the reconstruction data and the synthetic data of the residual region-based semantic level, and stores and transmits a bit operation attention map based on the stored data to the first node.

19. In a first node in a wireless communication system, Transmitter and receiver; and comprising a processor connected to the above transceiver, The above processor, Establish a connection with the second node, Controlling the transceiver to receive a request for first node capability information from the second node; Controlling the transceiver to transmit the first node capability information to the second node based on the first node capability information request; Controlling the transceiver to receive semantic communication instruction information from the second node, and Controlling the transceiver to encode data using an attention technique and transmit it to the second node through semantic communication-related information in the received semantic communication instruction information; A first node, wherein the first node encodes the data and transmits it to the second node based on whether the first node receives a first bitwise attention map from the second node and the number of times the semantic data is retransmitted.

20. In a second node in a wireless communication system, Transmitter and receiver; and comprising a processor connected to the above transceiver, The above processor, Establish a connection with the first node, Controlling the transceiver to transmit a request for first node capability information to the first node; Controlling the transceiver to receive first node capability information from the first node based on the first node capability information request; Controlling the transceiver to transmit semantic communication instruction information to the first node, and Controlling the transceiver to receive encoded data from the first node based on the attention technique through semantic communication-related information in the semantic communication instruction information; A second node that performs a downstream task using the data received from the first node based on whether a semantic error check is performed and whether a semantic error has occurred.

21. A device comprising at least one memory and at least one processor functionally connected to the at least one memory, At least one processor of the device, Establish a connection with another device, Controlling the device to receive a device capability information request from the other device; Controlling the device to transmit device capability information to the other device based on the device capability information request; Controlling the device to receive semantic communication instruction information from the other device, and Controlling the device to encode data using an attention technique and transmit it to the other device through semantic communication-related information in the received semantic communication instruction information; A device wherein the device encodes the data and transmits it to the other device based on whether the device receives a first bitwise attention map from the other device and the number of times the semantic data is retransmitted.

22. In a non-transitory computer-readable medium storing at least one instruction, comprising at least one instruction executable by the processor; At least one of the above commands causes the device to: Establish a connection with another device, Controlling the device to receive a device capability information request from the other device; Controlling the device to transmit device capability information to the other device based on the device capability information request; Controlling the device to encode data using an attention technique and transmit it to the other device through semantic communication-related information in the received semantic communication instruction information; A computer-readable medium wherein the device encodes the data and transmits it to the other device based on whether the device receives a first bitwise attention map from the other device and the number of times the semantic data is retransmitted.

Images