Device and method for designing integrated codebook sequence for semantic communication in wireless communication system
By designing a joint codebook sequence for semantic communication, the solution addresses inefficiencies in wireless systems, reducing data requirements and improving reliability and latency, particularly in complex communication scenarios.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- LG ELECTRONICS INC
- Filing Date
- 2024-10-29
- Publication Date
- 2026-05-07
AI Technical Summary
Existing wireless communication systems face challenges in efficiently managing large communication capacities, enhancing reliability and reducing latency, especially in scenarios involving massive machine type communications and devices sensitive to reliability and latency, while also optimizing data transmission efficiency.
The proposed solution involves designing a joint codebook sequence for semantic communication, utilizing background knowledge matching and aligning representation spaces through reference signals to generate a codebook sequence, controlling the size of representation spaces, and performing initial connection procedures to reduce data transmission requirements.
This approach reduces the amount of data needed for transmission in semantic communication, enhancing data efficiency and improving communication reliability and latency performance.
Smart Images

Figure KR2024016611_07052026_PF_FP_ABST
Abstract
Description
Device and method for designing an integrated codebook sequence for semantic communication in a wireless communication system
[0001] The present disclosure relates to a wireless communication system, and more specifically to an apparatus and method for designing a joint codebook sequence for semantic communication in a wireless communication system.
[0002] Wireless access systems are being widely deployed to provide various types of communication services, such as voice and data. Generally, a wireless access system is a multiple access system capable of supporting communication with multiple users by sharing available system resources (bandwidth, transmission power, etc.). Examples of multiple access systems include CDMA (code division multiple access), FDMA (frequency division multiple access), TDMA (time division multiple access), OFDMA (orthogonal frequency division multiple access), and SC-FDMA (single carrier frequency division multiple access) systems.
[0003] In particular, as many communication devices require large communication capacities, enhanced mobile broadband (eMBB) communication technology is being proposed as an improvement over existing radio access technology (RAT). Furthermore, communication systems are being proposed that consider not only massive machine type communications (mmTC), which connects multiple devices and objects to provide various services anytime and anywhere, but also services and user equipment (UE) that are sensitive to reliability and latency. Various technical configurations are being proposed for this purpose.
[0004] The present disclosure relates to an apparatus and method for semantic communication in a wireless communication system.
[0005] The present disclosure relates to background knowledge matching for semantic communication in a wireless communication system.
[0006] The present disclosure relates to an apparatus and method for reducing entropy for semantic communication in a wireless communication system.
[0007] The present disclosure relates to an apparatus and method for establishing relationships between labels for semantic communication in a wireless communication system.
[0008] The present disclosure relates to an apparatus and method for generating a codebook sequence based on a reference signal in a wireless communication system.
[0009] The present disclosure relates to an apparatus and method for background knowledge matching based on a codebook sequence in a wireless communication system.
[0010] The present disclosure relates to an apparatus and method for aligning the order of corresponding representation spaces using a reference signal in a wireless communication system.
[0011] The present disclosure relates to an apparatus and method for generating a codebook sequence having a corresponding semantic relationship in semantic communication in a wireless communication system.
[0012] The present disclosure relates to an apparatus and method for providing a protocol of a layer for semantic communication in a wireless communication system.
[0013] The present disclosure relates to an apparatus and method for controlling the size of a representation space for a codebook sequence in a wireless communication system.
[0014] The technical objectives to be achieved in this disclosure are not limited to those mentioned above, and other unmentioned technical problems may be considered by those skilled in the art to which the technical configuration of this disclosure applies, based on the embodiments of this disclosure described below.
[0015] As an example of the present disclosure, the method comprises the steps of performing an initial connection procedure, transmitting capability information, performing signaling for a setting related to communication, controlling the size of representation spaces, transmitting a reference signal, and generating a codebook sequence based on the distance between the representation spaces and the reference signal.
[0016] As an example of the present disclosure, the method comprises the steps of performing an initial connection procedure, transmitting capability information, performing signaling for a setting related to communication, controlling the size of representation spaces, receiving a reference signal, and generating a codebook sequence based on the distance between the representation spaces and the reference signal.
[0017] As an example of the present disclosure, the first device comprises a transceiver and a processor coupled to the transceiver, wherein the processor is configured to perform an initial connection procedure, transmit capability information, perform signaling for settings related to communication, control the size of representation spaces, transmit a reference signal, and generate a codebook sequence based on the distance between the representation spaces and the reference signal.
[0018] As an example of the present disclosure, a second device comprises a transceiver and a processor connected to the transceiver, wherein the processor is configured to perform an initial connection procedure, transmit capability information, perform signaling for settings related to communication, control the size of representation spaces, receive a reference signal, and generate a codebook sequence based on the distance between the representation spaces and the reference signal.
[0019] As an example of the present disclosure, a communication device comprises at least one processor, at least one memory connected to the at least one processor and storing instructions that cause the device to perform operations as executed by the at least one processor, wherein the operations include performing an initial connection procedure, transmitting capability information, performing signaling for a setting related to communication, controlling the size of representation spaces, transmitting a reference signal, and generating a codebook sequence based on the distance between the representation spaces and the reference signal.
[0020] A non-transitory computer-readable medium storing at least one program instruction comprises the steps of: causing a device to perform operations as the at least one program instruction is executed by at least one processor; performing an initial connection procedure; transmitting capability information; performing signaling for a setting related to communication; controlling the size of representation spaces; transmitting a reference signal; and generating a codebook sequence based on the distance between the representation spaces and the reference signal.
[0021] The embodiments of the present disclosure described above are merely some of the preferred embodiments of the present disclosure, and various embodiments reflecting the technical features of the present disclosure can be derived and understood by those skilled in the art based on the detailed description of the present disclosure set forth below.
[0022] The following effects may be achieved by embodiments based on the present disclosure.
[0023] According to the present disclosure, the amount of data required to transmit a message in semantic communication can be reduced through background knowledge matching.
[0024] The effects obtainable from the embodiments of the present disclosure are not limited to those mentioned above, and other unmentioned effects can be clearly derived and understood by a person skilled in the art to which the technical configuration of the present disclosure applies from the description of the embodiments of the present disclosure below. That is, unintended effects resulting from implementing the configuration described in the present disclosure can also be derived by a person skilled in the art from the embodiments of the present disclosure.
[0025] The drawings attached below are intended to aid in understanding the present disclosure and may provide embodiments of the present disclosure together with the detailed description. However, the technical features of the present disclosure are not limited to specific drawings, and features disclosed in each drawing may be combined with one another to form new embodiments. Reference numerals in each drawing may denote structural elements.
[0026] FIG. 1 illustrates an example of a communication system applicable to the present disclosure.
[0027] FIG. 2 illustrates an example of a wireless device applicable to the present disclosure.
[0028] FIG. 3 illustrates a method for processing a transmission signal applicable to the present disclosure.
[0029] FIG. 4 illustrates a communication procedure between a terminal and a base station applicable to the present disclosure.
[0030] FIG. 5 illustrates an example of a communication structure that can be provided in a 6G (6th generation) system applicable to the present disclosure.
[0031] FIG. 6 illustrates an electromagnetic spectrum applicable to the present disclosure.
[0032] FIG. 7 illustrates a transmitter structure applicable to the present disclosure.
[0033] FIG. 8 illustrates an example of a functional framework for the application of artificial intelligence technology applicable to the present disclosure.
[0034] FIG. 9 illustrates an example of a procedure for utilizing an artificial intelligence model applicable to the present disclosure.
[0035] FIG. 10 illustrates a communication procedure based on artificial intelligence (AI) technology applicable to the present disclosure.
[0036] Figure 11 illustrates a three-level problem that constitutes wireless communication.
[0037] Figure 12 conceptually illustrates the structure of semantic communication.
[0038] FIG. 13 illustrates an example of semantic communication between devices having different background knowledge.
[0039] Figure 14 illustrates an example of semantic channel equalization according to a ball radius parameter.
[0040] Figure 15a illustrates the label relationship between the task of distinguishing numbers from 0 to 9 and the task of distinguishing even or odd numbers.
[0041] FIG. 15b illustrates the label relationship between the task of determining modulus 3 and the task of distinguishing numbers 0 through 9.
[0042] Figure 16 illustrates a background knowledge matching process using multiple reference signals.
[0043] Figure 17a illustrates the codebook sequence of the source's representation space.
[0044] Figure 17b illustrates the codebook sequence of the destination representation space.
[0045] FIG. 18a illustrates an example of a codebook sequence of a source according to one embodiment of the present disclosure.
[0046] FIG. 18b illustrates an example of a codebook sequence of a destination according to one embodiment of the present disclosure.
[0047] FIG. 19a illustrates an example of a source representation codebook sequence based on a reference signal according to one embodiment of the present disclosure.
[0048] FIG. 19b illustrates an example of a destination representation codebook sequence based on a reference signal according to one embodiment of the present disclosure.
[0049] FIG. 20 illustrates an example of an integrated semantic representation codebook sequence generation procedure according to one embodiment of the present disclosure.
[0050] FIG. 21 illustrates an example of a procedure for performing semantic communication of a terminal according to one embodiment of the present disclosure.
[0051] FIG. 22 illustrates an example of a communication procedure according to codebook sequence generation according to one embodiment of the present disclosure.
[0052] FIG. 23 illustrates an example of a codebook sequence generation procedure according to one embodiment of the present disclosure.
[0053] FIG. 24 illustrates an example of a codebook sequence generation procedure based on the distance between representation spaces according to one embodiment of the present disclosure.
[0054] FIG. 25 illustrates an example of a wireless device applicable to the present disclosure.
[0055] FIG. 26 illustrates an example of a portable device applicable to the present disclosure.
[0056] FIG. 27 illustrates an example of a vehicle or autonomous vehicle applicable to the present disclosure.
[0057] FIG. 28 illustrates an example of a vehicle applicable to the present disclosure.
[0058] FIG. 29 illustrates an example of an XR (extended reality) device applicable to the present disclosure.
[0059] FIG. 30 illustrates an example of a robot applicable to the present disclosure.
[0060] FIG. 31 illustrates an example of an AI device applicable to the present disclosure.
[0061] The following embodiments are combinations of the components and features of the present disclosure in a predetermined form. Each component or feature may be considered optional unless otherwise explicitly stated. Each component or feature may be implemented in a form not combined with other components or features. Additionally, some components and / or features may be combined to form embodiments of the present disclosure. The order of operations described in the embodiments of the present disclosure may be changed. Some components or features of any embodiment may be included in other embodiments, or may be replaced with corresponding components or features of other embodiments.
[0062] In the description of the drawings, procedures or steps that could obscure the gist of the present disclosure have not been described, nor have procedures or steps that are understandable to those skilled in the art been described.
[0063] Throughout the specification, when a part is described as "comprising" or "including" a component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components. Furthermore, terms such as "...part," "...unit," and "module" as used in the specification refer to a unit that performs at least one function or operation, and this may be implemented in hardware, software, or a combination of hardware and software. Additionally, "one (a or an)," "one," "the," and similar related terms may be used in the context describing the present disclosure (particularly in the context of the following claims) in both singular and plural forms, unless otherwise indicated in the specification or clearly contradicted by the context.
[0064] In this specification, the embodiments of the present disclosure are described with a focus on the data transmission and reception relationship between a base station and a mobile station. Here, the base station refers to a terminal node of a network that communicates directly with a mobile station. Specific operations described in this document as being performed by a base station may, in some cases, be performed by an upper node of the base station.
[0065] That is, in a network consisting of multiple network nodes including a base station, various operations performed for communication with a mobile station may be performed by the base station or other network nodes other than the base station. In this case, 'base station' may be replaced by terms such as fixed station, Node B, eNB (eNode B), gNB (gNode B), ng-eNB, advanced base station (ABS), or access point.
[0066] Additionally, in the embodiments of the present disclosure, the term terminal may be replaced with terms such as user equipment (UE), mobile station (MS), subscriber station (SS), mobile subscriber station (MSS), mobile terminal, or advanced mobile station (AMS).
[0067] Furthermore, the transmitting end refers to a fixed and / or mobile node that provides data or voice services, and the receiving end refers to a fixed and / or mobile node that receives data or voice services. Therefore, in the case of the uplink, a mobile station can be the transmitting end and a base station can be the receiving end. Similarly, in the case of the downlink, a mobile station can be the receiving end and a base station can be the transmitting end.
[0068] Embodiments of the present disclosure may be supported by standard documents disclosed in at least one of the wireless access systems, such as IEEE 802.xx systems, 3GPP (3rd Generation Partnership Project) systems, 3GPP LTE (Long Term Evolution) systems, 3GPP 5G (5th generation) NR (New Radio) systems and 3GPP2 systems, and in particular, embodiments of the present disclosure may be supported by 3GPP TS (technical specification) 38.211, 3GPP TS 38.212, 3GPP TS 38.213, 3GPP TS 38.321 and 3GPP TS 38.331 documents.
[0069] In addition, the embodiments of the present disclosure may be applied to other wireless access systems and are not limited to the systems described above. For example, they may be applicable to systems applied after the 3GPP 5G NR system and are not limited to specific systems.
[0070] That is, obvious steps or parts not described in the embodiments of the present disclosure may be described by referring to the aforementioned documents. Additionally, all terms disclosed in this document may be explained by the aforementioned standard documents.
[0071] Hereinafter, preferred embodiments according to the present disclosure will be described in detail with reference to the accompanying drawings. The detailed description disclosed below, together with the accompanying drawings, is intended to describe exemplary embodiments of the present disclosure and is not intended to represent the only embodiment in which the technical configuration of the present disclosure can be implemented.
[0072] Additionally, specific terms used in the embodiments of the present disclosure are provided to aid in understanding the present disclosure, and the use of such specific terms may be modified in other forms without departing from the technical spirit of the present disclosure.
[0073] The following technology can be applied to various wireless access systems such as CDMA (code division multiple access), FDMA (frequency division multiple access), TDMA (time division multiple access), OFDMA (orthogonal frequency division multiple access), and SC-FDMA (single carrier frequency division multiple access).
[0074]
[0075] For the sake of clarity, the following description is based on 3GPP communication systems (e.g., LTE, NR, etc.), but the technical scope of this disclosure is not limited thereto. LTE may refer to technology from 3GPP TS 36.xxx Release 8 onwards. Specifically, LTE technology from 3GPP TS 36.xxx Release 10 onwards is referred to as LTE-A, and LTE technology from 3GPP TS 36.xxx Release 13 onwards may be referred to as LTE-A pro. 3GPP NR may refer to technology from TS 38.xxx Release 15 onwards. 3GPP 6G may refer to technology from TS Release 17 and / or Release 18 onwards. "xxx" indicates a specific standard document number. LTE / NR / 6G may be collectively referred to as 3GPP systems.
[0076] Regarding the background technology, terms, abbreviations, etc. used in this disclosure, reference may be made to standard documents published prior to this disclosure. For example, reference may be made to standard documents 36.xxx and 38.xxx.
[0077]
[0078] Communication systems applicable to the present disclosure
[0079] Although not limited thereto, the various descriptions, functions, procedures, proposals, methods, and / or flowcharts of the disclosure disclosed in this document may be applied to various fields requiring wireless communication / connection (e.g., 5G) between devices.
[0080] Examples are provided in more detail below with reference to the drawings. In the following drawings and descriptions, the same reference numerals may represent the same or corresponding hardware blocks, software blocks, or function blocks unless otherwise described.
[0081] FIG. 1 illustrates an example of a communication system to which the present disclosure applies.
[0082] Referring to FIG. 1, the communication system (100) to which the present disclosure applies includes a wireless device, a base station, and a network. Here, the wireless device refers to a device that performs communication using wireless access technology (e.g., LTE, LTE-A, LTE-A pro, NR, 5G, 5G-A, 6G) and may be referred to as a communication / wireless / 5G device. Although not limited thereto, the wireless device may include a robot (100a), a vehicle (100b-1, 100b-2), an XR (extended reality) device (100c), a hand-held device (100d), a home appliance (100e), an IoT (Internet of Thing) device (100f), and an AI (artificial intelligence) device / server (100g). For example, the vehicle may include a vehicle equipped with wireless communication capabilities, an autonomous vehicle, a vehicle capable of performing inter-vehicle communication, etc. Here, the vehicle (100b-1, 100b-2) may include an unmanned aerial vehicle (UAV) (e.g., a drone). The XR device (100c) includes an augmented reality (AR) / virtual reality (VR) / mixed reality (MR) device and may be implemented in the form of a head-mounted device (HMD), a head-up display (HUD) equipped in a vehicle, a television, a smartphone, a computer, a wearable device, a home appliance, digital signage, a vehicle, a robot, etc. The portable device (100d) may include a smartphone, a smartpad, a wearable device (e.g., a smartwatch, smart glasses), a computer (e.g., a laptop, etc.). The home appliance (100e) may include a TV, a refrigerator, a washing machine, etc. The IoT device (100f) may include a sensor, a smart meter, etc.For example, the base station (120) and network (130) may also be implemented as wireless devices, and a specific wireless device (120a) may act as a base station / network node to other wireless devices.
[0083] Wireless devices (100a to 100f) can be connected to a network (130) through a base station (120). AI technology may be applied to the wireless devices (100a to 100f), and the wireless devices (100a to 100f) can be connected to an AI server (100g) through the network (130). The network (130) can be configured using a 3G network, a 4G (e.g., LTE) network, a 5G (e.g., NR) network, or a 6G network. The wireless devices (100a to 100f) may communicate with each other through the base station (120) / network (130), but may also communicate directly (e.g., sidelink communication) without going through the base station (120) / network (130). For example, vehicles (100b-1, 100b-2) can communicate directly (e.g., V2V (vehicle to vehicle) / V2X (vehicle to everything) communication). Also, an IoT device (100f) (e.g., a sensor) can communicate directly with another IoT device (e.g., a sensor) or other wireless devices (100a to 100f).
[0084] Wireless communication / connection (150a, 150b, 150c) can be established between wireless devices (100a to 100f) / base station (120) and between base station (120) / base station (120). Here, wireless communication / connection can be established through various wireless access technologies such as uplink / downlink communication (150a), sidelink communication (150b) (or D2D communication), and communication between base stations (150c) (e.g., relay, IAB (integrated access backhaul)). Through wireless communication / connection (150a, 150b, 150c), wireless devices and base stations / wireless devices, and base stations and base stations can transmit / receive wireless signals to / from each other. For example, wireless communication / connection (150a, 150b, 150c) can transmit / receive signals through various physical channels. To this end, based on the various proposals of the present disclosure, at least some of the following may be performed: a process for setting various configuration information for transmitting / receiving wireless signals, a process for various signal processing (e.g., channel encoding / decoding, modulation / demodulation, resource mapping / demapping, etc.), a resource allocation process, etc.
[0085]
[0086] Devices applicable to the present disclosure
[0087] FIG. 2 illustrates an example of a wireless device that can be applied to the present disclosure.
[0088] Referring to FIG. 2, the wireless device (200) can transmit and receive wireless signals through various wireless access technologies (e.g., LTE, LTE-A, LTE-A pro, NR, 5G, 5G-A, 6G). The wireless device (200) includes at least one processor (202) and at least one memory (204), and may additionally include at least one transceiver (206) and / or at least one antenna (208).
[0089] The processor (202) controls the memory (204) and / or the transceiver (206) and may be configured to implement the descriptions, functions, procedures, proposals, methods, and / or sequences of operation disclosed in this document. For example, the processor (202) may process information within the memory (204) to generate a first information / signal and then transmit a wireless signal containing the first information / signal through the transceiver (206). Additionally, the processor (202) may receive a wireless signal containing a second information / signal through the transceiver (206) and then store information obtained from the signal processing of the second information / signal in the memory (204). The memory (204) may be connected to the processor (202) and may store various information related to the operation of the processor (202). For example, memory (204) may store software code containing instructions for performing some or all of the processes controlled by the processor (202) or for performing the descriptions, functions, procedures, proposals, methods, and / or sequences of operations disclosed in this document. Here, the processor (202) and memory (204) may be part of a communication modem / circuit / chip designed to implement wireless communication technology. A transceiver (206) may be connected to the processor (202) and may transmit and / or receive wireless signals through at least one antenna (208). The transceiver (206) may include a transmitter and / or receiver. The transceiver (206) may be interchangeable with a radio frequency (RF) unit. In this disclosure, a wireless device may mean a communication modem / circuit / chip.
[0090] Hereinafter, hardware elements of the wireless device (200) will be described in more detail. Although not limited thereto, at least one protocol layer may be implemented by at least one processor (202). For example, at least one processor (202) may implement at least one layer (e.g., functional layers such as PHY (physical), MAC (media access control), RLC (radio link control), PDCP (packet data convergence protocol), RRC (radio resource control), and SDAP (service data adaptation protocol). At least one processor (202) may generate at least one PDU (Protocol Data Unit) and / or at least one SDU (service data unit) according to the descriptions, functions, procedures, proposals, methods and / or operation sequences disclosed in this document. At least one processor (202) may generate messages, control information, data, or information according to the descriptions, functions, procedures, proposals, methods and / or operation sequences disclosed in this document. At least one processor (202) may generate a signal (e.g., baseband signal) including a PDU, SDU, message, control information, data, or information according to the functions, procedures, proposals, and / or methods disclosed in this document and provide it to at least one transceiver (206). At least one processor (202) may receive a signal (e.g., baseband signal) from at least one transceiver (206) and may obtain a PDU, SDU, message, control information, data, or information according to the descriptions, functions, procedures, proposals, methods, and / or operation sequences disclosed in this document.
[0091] At least one processor (202) may be referred to as a controller, microcontroller, microprocessor, or microcomputer. At least one processor (202) may be implemented by hardware, firmware, software, or a combination thereof. For example, at least one application-specific integrated circuit (ASIC), at least one digital signal processor (DSP), at least one digital signal processing device (DSPD), at least one programmable logic device (PLD), or at least one field programmable gate array (FPGA) may be included in at least one processor (202). The descriptions, functions, procedures, proposals, methods, and / or operation sequences disclosed in this document may be implemented using firmware or software, and the firmware or software may be implemented to include modules, procedures, functions, etc. Firmware or software configured to perform the descriptions, functions, procedures, proposals, methods, and / or operation sequences disclosed in this document may be included in at least one processor (202) or stored in at least one memory (204) and driven by at least one processor (202). The descriptions, functions, procedures, proposals, methods, and / or flowcharts disclosed in this document may be implemented using firmware or software in the form of code, instructions, and / or sets of instructions.
[0092] At least one memory (204) may be connected to at least one processor (202) and may store various forms of data, signals, messages, information, programs, codes, instructions, and / or commands. At least one memory (204) may be composed of ROM (read-only memory), RAM (random access memory), EPROM (erasable programmable read-only memory), flash memory, hard drive, registers, cache memory, computer read storage media, and / or combinations thereof. At least one memory (204) may be located inside and / or outside of at least one processor (202). Additionally, at least one memory (204) may be connected to at least one processor (202) via various technologies, such as wired or wireless connections.
[0093] At least one transceiver (206) may transmit user data, control information, wireless signals / channels, etc., as mentioned in the methods and / or operation flowcharts, etc. of this document to at least one other device. At least one transceiver (206) may receive user data, control information, wireless signals / channels, etc., as mentioned in the descriptions, functions, procedures, proposals, methods and / or operation flowcharts, etc. disclosed in this document from at least one other device. For example, at least one transceiver (206) may be connected to at least one processor (202) and may transmit and receive wireless signals. For example, at least one processor (202) may control at least one transceiver (206) to transmit user data, control information, or wireless signals to at least one other device. Additionally, at least one processor (202) may control at least one transceiver (206) to receive user data, control information, or wireless signals from at least one other device. Additionally, at least one transceiver (206) may be connected to at least one antenna (208), and at least one transceiver (206) may be configured to transmit and receive user data, control information, wireless signals / channels, etc., as described in the descriptions, functions, procedures, proposals, methods, and / or operation sequence diagrams disclosed in this document through at least one antenna (208). In this document, at least one antenna may be a plurality of physical antennas or a plurality of logical antennas (e.g., antenna ports). At least one transceiver (206) may convert the received wireless signals / channels, etc., from RF band signals to baseband signals in order to process the received user data, control information, wireless signals / channels, etc., using at least one processor (202). At least one transceiver (206) may convert the processed user data, control information, wireless signals / channels, etc., from baseband signals to RF band signals using at least one processor (202).To this end, at least one transceiver (206) may include an (analog) oscillator and / or filter.
[0094] The components of the wireless device described with reference to FIG. 2 may be referred to by other terms in terms of their function. For example, the processor (202) may be referred to as the control unit, the transceiver (206) as the communication unit, and the memory (204) as the storage unit. In some cases, the communication unit may be used to mean at least a part of the processor (202) and the transceiver (206).
[0095] The structure of the wireless device described with reference to FIG. 2 can be understood as the structure of at least part of various devices. For example, the structure of the wireless device exemplified in FIG. 2 may be at least part of the various devices described with reference to FIG. 1 (e.g., robot (100a), vehicle (100b-1, 100b-2), XR device (100c), portable device (100d), home appliance (100e), IoT device (100f), AI device / server (100g)). Furthermore, according to various embodiments, the device may include other components in addition to the components exemplified in FIG. 2.
[0096] For example, the device may be a portable device such as a smartphone, smartpad, wearable device (e.g., smart watch, smart glasses), or portable computer (e.g., laptop, etc.). In this case, the device may further include at least one of a power supply unit that supplies power and includes a wired / wireless charging circuit, a battery, etc., an interface unit that includes at least one port for connection with another device (e.g., audio input / output port, video input / output port), and an input / output unit for inputting and outputting video information / signals, audio information / signals, data, and / or information input by a user.
[0097] For example, the device may be a mobile device such as a mobile robot, vehicle, train, manned / unmanned aerial vehicle (AV), or ship. In this case, the device may further include at least one of a drive unit comprising at least one of an engine, motor, power train, wheel, brake, and steering device of the device; a power supply unit that supplies power and includes a wired / wireless charging circuit, battery, etc.; a sensor unit that senses state information, environmental information, and user information of the device or its surroundings; an autonomous driving unit that performs functions such as path maintenance, speed control, and destination setting; and a position measurement unit that acquires position information of the moving body through a GPS (global positioning system) and various sensors.
[0098] For example, the device may be an XR device such as an HMD, a HUD (head-up display) equipped in a vehicle, a television, a smartphone, a computer, a wearable device, a home appliance, digital signage, a vehicle, a robot, etc. In this case, the device may further include at least one of a power supply unit that supplies power and includes a wired / wireless charging circuit, a battery, etc., an input / output unit that acquires control information, data, etc. from the outside and outputs a generated XR object, and a sensor unit that senses state information, environment information, and user information of the device or the surroundings of the device.
[0099] For example, the device may be a robot that can be classified into industrial, medical, household, military, etc., depending on the purpose or field of use. In this case, the device may further include at least one of a sensor unit that senses state information, environmental information, and user information of the device or its surroundings, and a drive unit that performs various physical actions, such as moving robot joints.
[0100] For example, the device may be an AI device such as a TV, projector, smartphone, PC, laptop, digital broadcasting terminal, tablet PC, wearable device, set-top box (STB), radio, washing machine, refrigerator, digital signage, robot, vehicle, etc. In this case, the device may further include at least one of an input unit that acquires various types of data from the outside, an output unit that generates output related to sight, hearing, or touch, a sensor unit that senses state information, environmental information, and user information of the device or its surroundings, and a training unit that learns a model composed of an artificial neural network using training data.
[0101] The structure of the wireless device illustrated in FIG. 2 can be understood as part of a RAN node (e.g., base station, DU, RU, RRH, etc.). That is, the device illustrated in FIG. 2 may be a RAN node. In this case, the device may further include a wired transceiver for front haul and / or back haul communication. However, if the front haul and / or back haul communication is based on wireless communication, at least one transceiver (206) illustrated in FIG. 2 is used for front haul and / or back haul communication, and the wired transceiver may not be included.
[0102]
[0103] FIG. 3 illustrates a method for processing a transmission signal applicable to the present disclosure. For example, the transmission signal may be processed by a signal processing circuit. In this case, the signal processing circuit (300) may include scramblers (310), modulators (320), a layer mapper (330), a precoder (340), resource mappers (350), and signal generators (360). In this case, for example, the operation / function of FIG. 3 may be performed in the processor (202) and / or transceiver (206) of FIG. 2. Also, for example, the hardware elements of FIG. 3 may be implemented in the processor (202) and / or transceiver (206) of FIG. 2. For example, blocks 310 to 360 may be implemented in the processor (202) of FIG. 2. Additionally, blocks 310 to 350 may be implemented in the processor (202) of FIG. 2, and block 360 may be implemented in the transceiver (206) of FIG. 2, and are not limited to the embodiments described above.
[0104] A codeword can be converted into a wireless signal through the signal processing circuit (300) of FIG. 3. Here, the codeword is an encoded bit sequence of an information block. The information block may include a transmission block (e.g., UL-SCH transmission block, DL-SCH transmission block). Here, the information block may include AI-related data (e.g., training data, AI model data, input data, output data, etc.), and the codeword may be an encoded bit sequence corresponding to the AI-related data. The wireless signal may be transmitted through various physical channels (e.g., PUSCH, PDSCH). Specifically, the codeword may be converted into a scrambled bit sequence by scramblers (310). The scrambled sequence used for scrambling is generated based on an initialization value, which may include ID information of the wireless device, etc. The scrambled bit sequence may be modulated into a modulation symbol sequence by modulators (320). Modulation methods may include pi / 2-BPSK (pi / 2-binary phase shift keying), m-PSK (m-phase shift keying), m-QAM (m-quadrature amplitude modulation), etc.
[0105] A complex modulation symbol sequence can be mapped to at least one transmission layer by a layer mapper (330). Here, a transmission layer is a logical resource unit for mapping signals or data transmitted through spatial resources to antenna ports, and one transmission layer can correspond to one stream or one antenna port. Each complex modulation symbol included in the complex modulation symbol sequence is mapped to at least one transmission layer, thereby determining which antenna port it will be transmitted through. The modulation symbols of each transmission layer can be mapped to the corresponding antenna port(s) by a precoder (340). The output z of the precoder (340) can be obtained by multiplying the output y of the layer mapper (330) by an N-XM precoding matrix W, where N is the number of antenna ports and M is the number of transmission layers. Here, the precoder (340) can perform precoding after performing transform precoding (e.g., a discrete Fourier transform (DFT)) on the complex modulation symbols. Additionally, the precoder (340) can perform precoding without performing transform precoding.
[0106] Resource mappers (350) can map the modulation symbols of each antenna port to time-frequency resources. The time-frequency resources may include multiple symbols (e.g., CP-OFDMA symbols, DFT-s-OFDMA symbols) in the time domain and multiple subcarriers in the frequency domain. Signal generators (360) generate radio signals from the mapped modulation symbols, and the generated radio signals can be transmitted to other devices through each antenna. To this end, each of the signal generators (360) may include an inverse fast Fourier transform (IFFT) module, a cyclic prefix (CP) inserter, a digital-to-analog converter (DAC), a frequency uplink converter, etc.
[0107] The signal processing process for a received signal in a wireless device can be configured as the inverse of the signal processing process (310 to 360) of FIG. 3. For example, a wireless device (e.g., 200 in FIG. 2) can receive a wireless signal from the outside through an antenna port / transceiver. The received wireless signal can be converted into a baseband signal through a signal restorer. To this end, the signal restorer may include a frequency downlink converter, an analog-to-digital converter (ADC), a CP remover, and a fast Fourier transform (FFT) module. Subsequently, the baseband signal can be restored into a codeword through a resource de-mapper process, a postcoding process, a demodulation process, and a de-scrambling process. The codeword can be restored into the original information block through decoding. Accordingly, a signal processing circuit (not shown) for a received signal may include a signal restorer, a resource de-mapper, a postcoder, a demodulator, a de-scrambler, and a decoder.
[0108] The signal processing circuit (300) described with reference to FIG. 3 is illustrated as including a plurality of scramblers (310), modulators (320), a plurality of resource mappers (350), and a plurality of signal generators (360). However, at least one of the scramblers, modulators, resource mappers, and signal generators may be implemented as a single integrated structure. That is, the number of at least one of the scramblers, modulators, resource mappers, and signal generators may be less than the number of layers. Furthermore, at least one of the components illustrated in FIG. 3 may be omitted.
[0109]
[0110] FIG. 4 illustrates a communication procedure between a terminal and a base station applicable to the present disclosure. FIG. 4 illustrates the operation of a terminal (410) and a base station (420) transmitting and / or receiving data, and the operation performed prior to this.
[0111] Referring to FIG. 4, in step 401, the terminal (410) and the base station (420) perform synchronization. For example, the terminal (410) performs an initial cell search operation. Specifically, the terminal (410) can detect at least one synchronization signal transmitted from the base station (420) according to a predefined rule. Here, the synchronization signal may include a plurality of synchronization signals (e.g., primary synchronization signal, secondary synchronization signal) classified according to structure or use. Through this, the terminal (410) can identify the boundaries of the frame, subframe, slot, and / or symbol of the base station (420) and obtain information about the base station (420) (e.g., cell identifier).
[0112] In step 403, the terminal (410) obtains system information transmitted from the base station (420). The system information is information related to the attributes, characteristics, and / or capabilities of the base station (420) required to connect to the base station (420) and use the service, and can be classified according to content (e.g., whether it is essential for connection), transmission structure (e.g., channel used, whether it is provided on-demand), etc., and can be classified, for example, into a master information block (MIB) and a system information block (SIB). If necessary, the terminal (410) may transmit a signal requesting the system information prior to receiving the system information. The system information may include information related to AI functions. For example, the system information is information required for operations performed based on AI, and may include at least one of information related to an AI model, information related to training, and information related to inference / prediction. However, the request and provision of the system information may be performed after the random access procedure described later.
[0113] In step 405, the terminal (410) and the base station (420) perform a random access procedure. The terminal (410) may transmit and / or receive at least one message for the random access procedure (e.g., random access preamble, RAR (random access response) message, etc.) based on information related to the random access channel of the base station (420) obtained through system information (e.g., channel location, channel structure, structure of supported preamble, etc.). For example, the terminal (410) may transmit a preamble (e.g., MSG1) through the random access channel, receive a RAR message (e.g., MSG2), transmit a message (e.g., MSG3) containing information related to the terminal (410) (e.g., identification information) to the base station (420) using scheduling information included in the RAR message, and receive a message (e.g., MSG4) for contention resolution and / or connection establishment. As another example, MSG1 and MSG3 can be transmitted and received as a single message, or MSG2 and MSG4 can be transmitted and received as a single message.
[0114] In step 407, the terminal (410) and the base station (420) perform signaling of control information. Here, the control information may be defined in various layers, such as a layer that controls the connection (e.g., a radio resource control (RRC) layer), a layer that handles mapping between logical channels and transmission channels (e.g., a media access control (MAC) layer), and a layer that handles physical channels (e.g., a physical (PHY) layer). For example, the terminal (410) and the base station (420) may perform at least one of signaling to establish a connection, signaling to determine settings related to communication, and signaling to indicate allocated resources. Additionally, the signaling of control information may be performed to convey information related to AI functions. For example, information related to AI functions is information necessary for operations performed based on AI, and may include at least one of information related to an AI model, information related to training, and information related to inference / prediction. More specifically, the information related to the AI function signaled in step 407 can be combined and / or combined with the information related to the AI function signaled in step 403, and both can be defined as having a hierarchical, mutually complementary, or substitute structure.
[0115] In step 409, the terminal (410) and the base station (420) transmit and / or receive data. That is, the terminal (410) and the base station (420) can process, transmit and / or receive data based on the signaling of control information. For example, when transmitting data, the terminal (410) or the base station (420) may perform at least one of channel encoding, rate matching, scrambling, constellation mapping, layer mapping, waveform modulation, antenna mapping, and resource mapping on the information bits. Conversely, when receiving data, the terminal (410) or the base station (420) may perform at least one of signal extraction from resources, antenna-specific waveform demodulation, signal placement considering layer mapping, constellation demapping, descrambling, and channel decoding. Here, the transmitted data is AI-related data, and may include, for example, data for AI-based operations or data generated by AI-based operations.
[0116] Steps 401 through 409 described with reference to FIG. 4 must not necessarily be performed in the order exemplified in FIG. 4, and the order of at least some of the steps may vary. Additionally, at least some of steps 401 through 409 may be combined into a single step or omitted. That is, the steps exemplified in FIG. 4 may be performed in various modified forms.
[0117]
[0118] 6G communication systems and core implementation technologies of 6G systems
[0119] 5G systems define various operating bands within FR1 (frequency range 1), which includes 410 MHz to 7125 MHz, and FR2 (frequency range 2), which includes 24,250 MHz to 71,000 MHz. Various frequencies are being discussed as operating bands for subsequent 6G systems, and the use of frequencies higher than those of 5G systems is also being considered for wider bandwidth and higher transmission speeds. As one example, the use of the THz (Terahertz) frequency band, which includes approximately 100 GHz to 10 THz, is being discussed. The THz frequency band is a band that possesses both the penetrability of radio waves and the directivity of optical waves, and communication using the THz frequency band is expected to play a transitional role from existing radio-based communication to optical-based communication.
[0120] 6G systems utilizing the THz frequency band as described above aim for: i) very high data rates per device, ii) a very large number of connected devices, iii) global connectivity, iv) very low latency, v) reduced energy consumption of battery-free IoT devices, vi) ultra-reliable connectivity, and vii) connected intelligence with machine learning capabilities. The vision of 6G systems can be four aspects, such as "intelligent connectivity," "deep connectivity," "holographic connectivity," and "ubiquitous connectivity," and 6G systems can be designed to satisfy requirements such as those shown in [Table 1] below.
[0121] Per device peak data rate1 TbpsE2E latency1 msMaximum spectral efficiency100 bps / HzMobility supportup to 1000 km / hrSatellite integrationFullyAIFullyAutonomous vehicleFullyXRFullyHaptic CommunicationFully
[0122] At this time, the 6G system may have key factors such as enhanced mobile broadband (eMBB), ultra-reliable low latency communications (URLC), massive machine type communications (mMTC), AI integrated communication, tactile internet, high throughput, high network capacity, high energy efficiency, low backhaul and access network congestion, and enhanced data security. FIG. 5 illustrates an example of a communication structure that can be provided by a 6G system applicable to the present disclosure. Referring to FIG. 5, the 6G system is expected to have simultaneous wireless communication connectivity 50 times higher than that of a 5G wireless communication system. URLLC, a key feature of 5G, is expected to become an even more dominant technology in 6G communication by providing end-to-end latency of less than 1ms. In this case, 6G systems will exhibit significantly superior volumetric spectral efficiency, unlike the frequently used area-spectral efficiency. Since 6G systems can provide very long battery life and advanced battery technology for energy harvesting, mobile devices in 6G systems may not require separate charging. New network characteristics in 6G could be as follows: - Satellite integrated network: To provide a global mobile population, 6G is expected to be integrated with satellites. Integrating terrestrial, satellite, and airborne networks into a single wireless communication system is critical for 6G.
[0123] - Connected Intelligence: Unlike previous generations of wireless communication systems, 6G is innovative and will update wireless evolution from "connected things" to "connected intelligence." AI can be applied at each stage of the communication process (or at each step of the signal processing described below).
[0124] - Seamless integration of wireless information and energy transfer: 6G wireless networks will transfer power to charge the batteries of devices such as smartphones and sensors. Therefore, wireless information and energy transfer (WIET) will be integrated.
[0125] - Ubiquitous Super 3D Connectivity: Connectivity to the network and core network functions of drones and very low Earth orbit satellites will create Super 3D connectivity in 6G ubiquitous.
[0126] Some general requirements regarding the new network characteristics of 6G mentioned above may be as follows.
[0127] - Small cell networks: The idea of small cell networks was introduced to improve the quality of received signals in cellular systems as a result of increased throughput, energy efficiency, and spectrum efficiency. Consequently, small cell networks are an essential feature of communication systems for 5G and beyond 5G (5GB). Therefore, 6G communication systems also adopt the characteristics of small cell networks.
[0128] - Ultra-dense heterogeneous network: Ultra-dense heterogeneous networks will be another important characteristic of 6G communication systems. Multi-tier networks composed of heterogeneous networks improve overall QoS and reduce costs.
[0129] - High-capacity backhaul: Backhaul connections are characterized as high-capacity backhaul networks to support high-volume traffic. High-speed fiber optics and free-space optics (FSO) systems can be possible solutions to this problem.
[0130] - Radar technology integrated with mobile technology: High-precision localization (or location-based services) through communication is one of the functions of 6G wireless communication systems. Therefore, radar systems will be integrated with 6G networks.
[0131] - Softwarization and virtualization: Softwarization and virtualization are two important features that form the basis of the design process in 5GB networks to ensure flexibility, reconfigurability, and programmability. Additionally, billions of devices can be shared across a shared physical infrastructure.
[0132] To satisfy the aforementioned characteristics, technologies such as artificial intelligence (AI), THz (Terahertz) communication, optical wireless technology, FSO backhaul network, massive MIMO technology, blockchain, 3D networking, quantum communication, unmanned aerial vehicles, cell-free communication, wireless information and energy transfer (WIET), integration of sensing and communication, integration of access backhaul networks, holographic beamforming, big data analysis, and large intelligent surface (LIS) may be adopted as core implementation technologies of the 6G system.
[0133] For example, THz communication can be utilized in 6G systems. THz communication is a communication that uses a spectrum in the frequency band between 0.3 THz and 3 THz with a corresponding wavelength in the range of 0.1 mm to 1 mm as shown in Fig. 6. Referring to Fig. 6, the frequency band of the THz wave is located in the intermediate region between the infrared band and the millimeter wave band; accordingly, the THz wave can be understood as a radio wave with the shortest wavelength and, at the same time, a light wave with the longest wavelength. As a result, the THz wave shares some characteristics of infrared and microwave waves, and specifically, can simultaneously possess the penetrability of electromagnetic waves and the directivity of light waves.
[0134]
[0135] FIG. 7 illustrates a transmitter structure applicable to the present disclosure.
[0136] Referring to Fig. 7, in order to modulate data onto an optical signal, the optical source of a laser can be passed through an optical wave guide to change the phase of the signal. At this time, data is loaded by changing electrical characteristics through a microwave contact, etc. Therefore, the optical modulator output is formed as a modulated waveform.
[0137] Data may be provided by a data signal generator. Here, the data may include various user data, configuration information, control information, etc. transmitted through a channel. Furthermore, the data may include data related to AI-based operations, for example, information for configuring an AI model, input / output data for tasks of an AI model, etc. To this end, components related to AI functions (e.g., an AI processing unit) may be included in the data signal generator or may interact with the data signal generator.
[0138] An O / E converter can generate THz pulses based on optical rectification by a nonlinear crystal, O / E conversion by a photoconductive antenna, emission from a bundle of relativistic electrons, etc. THz pulses generated in such a manner can have a length ranging from femtoseconds to picoseconds. The O / E converter performs down-conversion by utilizing the non-linearity of the device.
[0139] When considering the usage of the THz spectrum, it is highly likely that multiple contiguous GHz bands will be used for fixed or mobile service applications for THz systems. According to outdoor scenario criteria, available bandwidth can be classified based on an oxygen attenuation of 10^2 dB / km in the spectrum up to 1 THz. Accordingly, a framework in which the available bandwidth is composed of multiple band chunks can be considered. As an example of the above framework, if the length of the THz pulse for a single carrier is set to 50 ps, the bandwidth (BW) becomes approximately 20 GHz.
[0140] Effective down-conversion from the infrared band to the THz band depends on how the nonlinearity of the photoelectric converter (O / E converter) is utilized. In other words, to achieve down-conversion to the desired THz band, it is required to design an O / E converter with the most ideal nonlinearity for transferring to that specific band. If an O / E converter that does not match the target frequency band is used, there is a high probability of errors occurring regarding the amplitude and phase of the corresponding pulse.
[0141] In a single-carrier system, a THz transceiver system can be implemented using a single photoelectric converter. Depending on the channel environment, in a multi-carrier system, as many photoelectric converters as there are carriers may be required. This phenomenon will be particularly pronounced in multi-carrier systems utilizing multiple broadbands according to the plans related to the aforementioned spectrum applications. In this regard, a frame structure for the multi-carrier system may be considered. A signal down-frequency converted based on a photoelectric converter can be transmitted in a specific resource region (e.g., a specific frame). The frequency domain of the specific resource region may include multiple chunks. Each chunk may consist of at least one component carrier (CC).
[0142]
[0143] AI technology can be introduced in 6G systems. Efficient resource management and optimization are required to maintain connectivity between various services and devices. AI technology may include techniques capable of performing data analysis, pattern recognition, and predictive modeling using AI / ML (artificial intelligence / machine learning) models. Here, an AI / ML model can be understood as a set of parameter values and / or weight values related to mathematical formulas or algorithms generated through learning, designed to discover patterns in input data or perform predictions. To create such an AI / ML model, an AI / ML model training procedure is required to build the model by learning the relationship between input and output in a data-driven manner. Various learning algorithms, such as supervised learning, unsupervised learning, and reinforcement learning, can be utilized as training algorithms. Users can input specific data into a trained AI / ML model to generate output, and the procedure of obtaining output data by inputting input data into the AI / ML model can be referred to as AI / ML 'inference' or 'prediction'.
[0144] Network control parameters can be obtained as output through AI / ML inference using trained AI / ML models. Users can improve network efficiency by utilizing these output parameter values. For example, AI technology can be applied in various fields, such as wireless network resource allocation, traffic management, fault prediction, and Quality of Service (QoS) management. In particular, machine learning can efficiently allocate resources even in dynamically changing network environments based on real-time data. Therefore, AI technology can be utilized to provide hyper-connectivity and ultra-low latency.
[0145] In this case, AI / ML inference can be performed based on a combination of various devices. For example, the UE and the network can jointly perform AI / ML inference, and such an AI / ML model may be referred to as a two-sided AI / ML model or a two-sided model. In this case, the UE may perform the first part of the inference first, and the base station may perform the remaining inference, and vice versa. As another example, all inference may be performed by the UE, and such an AI / ML model may be referred to as a UE-side AI / ML model or a UE-side model.
[0146] In addition, life cycle management (LCM) for AI / ML models can be performed. Life cycle management may include model training, model deployment, model inference, model monitoring, and model updating. To this end, support may be required for data collection, model training, functionality / model identification, model delivery / transfer, model inference operations, functionality / model selection / enable / disable / fallback, functionality / model monitoring, model updating, and UE capabilities.
[0147] For example, AI / ML technology can be operated based on a functional framework such as FIG. 8. FIG. 8 illustrates an example of a functional framework for the application of AI / ML technology applicable to the present disclosure. First, a data collection function (810) generates training data (801), monitoring data (803), and / or inference data (805) containing processed input data by performing data preparation on input data collected from objects (e.g., UE, RAN node, network node, etc.). A model training function (820), having received the training data (801) from the data collection function (810), performs training on an AI / ML model using the training data (801) and provides the trained / updated model (813) to a model repository (840). The model repository (840) can store and retain the received trained / updated model (813).
[0148] A management function (830) may be used to control AI / ML model training. The management function (830) may control the operation of AI / ML models or AI / ML functions, or supervise their performance. To this end, the management function (830) may receive monitoring data (830) from the data collection function (810) and receive inference output (809) from the inference function (840). The management function (830) performs the role of managing the inference operation so that it can be performed efficiently based on the data received from the data collection function (810) and the inference function (840). That is, the management function (830) may transmit performance feedback or a retraining request (807) to the model training function (820) to improve the inference operation. Here, the performance feedback may be used to direct the learning goal or as a reward for reinforcement learning. Additionally, the management function (830) can provide management instructions (811) that instruct the inference function (840) to select AI / ML models or AI / ML-based functions to use, enable / disable them, or switch to non-AI / ML operations.
[0149] The inference function (840) generates an inference output (809) by performing inference and / or prediction using inference data (805) received by the data collection function (810). Here, the inference output (809) refers to the inference output of the AI / ML model used by the inference function (840), and the details of the inference output may vary depending on the use case. The AI / ML model used by the inference function (840) can be controlled by the management function (830). That is, the management function (830) can transmit a model transmission / delivery request signal (815) to the model repository function (850) to request the necessary AI / ML model, and the model repository function (850) can transmit the corresponding AI / ML model to the inference function (840) via a model transmission / delivery signal (817). Thus, the inference function (840) can perform inference using the AI / ML model (817) according to the received management instructions (811).
[0150] Additionally, the management function (830) can trigger or perform a specified task / action based on the inference output (809). Thus, the management function (830) can trigger a task / action on other objects (e.g., at least one UE, at least one RAN node, at least one network node, etc.) or on itself. Any one of the functions exemplified in FIG. 8 described above may be performed by two or more entities among the RAN, network node, network operator's OAM, or UE in collaboration. This may be referred to as a split AI operation.
[0151] To use an AI / ML model, not all of the functions (810 to 850) illustrated in FIG. 8 must be used, and the method of combining them is not limited to a specific method. Therefore, the functions (810 to 850) may be operated in an integrated manner, or some functions may be omitted. Furthermore, the functions (810 to 850) illustrated in FIG. 8 are not necessarily limited to being implemented as separate devices or apparatuses. For example, some or all of the functions (810 to 850) may be included in the processor (202) of FIG. 2. Additionally, the model storage function (850) may be included in the memory (204) of FIG. 2.
[0152]
[0153] FIG. 9 illustrates an example of a procedure for utilizing an AI model applicable to the present disclosure. FIG. 9 illustrates a case where a model training function (820) is included in a network node and a model inference function (840) is included in a RAN node. Referring to FIG. 9, in step 1, RAN node 1 and RAN node 2 transmit input data (e.g., training data) for training an AI model to a network node. Here, RAN node 1 and RAN node 2 may also transmit data collected from a UE (e.g., UE measurements related to RSRP, RSRQ, SINR of a serving cell and neighboring cells, UE location, velocity, etc.) to the network node. In step 2, the network node trains the AI model using the received training data. In step 3, the network node distributes / updates the AI model to RAN node 1 and / or RAN node 2. RAN node 1 and / or RAN node 2 may continue to perform model training based on the received AI model. In this procedure, it is assumed that the AI model is deployed / updated only to RAN Node 1. In Step 4, RAN Node 1 receives input data (e.g., inference data) for AI model inference from the UE and RAN Node 2. In Step 5, RAN Node 1 generates output data (e.g., prediction or decision) by performing AI model-based inference using the received inference data. In Step 6, if applicable, RAN Node 1 may transmit model performance feedback to the network nodes. In Step 7, RAN Node 1, RAN Node 2, and the UE (or 'RAN Node 1 and UE', or 'RAN Node 1 and RAN Node 2') perform an action based on the output data. For example, in the case of a load balancing action, the UE may move from RAN Node 1 to RAN Node 2. In Step 8, RAN Node 1 and RAN Node 2 transmit feedback information to the network nodes.
[0154] Network nodes can manage AI models based on feedback information regarding the inference results of AI models. For example, network nodes can perform additional training on AI models or generate additional information about AI models (e.g., performance information, accuracy information, etc.). If additional training is performed on AI models, network nodes can distribute the updated AI models to RAN node 1.
[0155] As explained with reference to Fig. 9, model training can be performed by network nodes, and inference using the model can be performed by RAN node 1. In other words, the model training and inference functions can be distributed. Generally, model training requires a large amount of computational resources because it involves optimization using large amounts of data and complex algorithms. In contrast, inference is a process of drawing conclusions about new data using an already trained model, and therefore requires relatively fewer computational resources compared to model training. Therefore, by using the procedure of Fig. 9, model training can be performed through network nodes if the computational resources of the UE or RAN nodes are insufficient. Additionally, security regarding the AI model can be ensured because the AI model is not exposed to the UE.
[0156] FIG. 9 illustrates a case where the model training function (820) is included in a network node and the model inference function (840) is included in a RAN node, but the present disclosure is not limited thereto. For example, if the computational resources of the RAN node are sufficient, both the model training function (820) and the model inference function (840) may be included in RAN node 1. In this case, RAN node 1 receives training data for training an AI model from the UE and RAN node 2. RAN node 1 trains the AI model using the received training data. Subsequently, RAN node 1 receives inference data for AI model inference from the UE and RAN node 2. RAN node 1 generates output data by performing AI model-based inference using the received inference data. Based on the output data, the UE, RAN node 1, and RAN node 2 can perform communication-related operations (e.g., handover, cell change). Subsequently, the UE and RAN node 2 can transmit feedback regarding the operations to RAN node 1. Therefore, RAN Node 1 can train the AI model and update the AI model it will use through feedback information regarding the inference results of the AI model. According to the aforementioned method, since signaling with the network is not required for AI model training and inference, the network load or the latency to train the AI model or receive inference results can be reduced. Additionally, since the UE performs inference using the AI model, the UE's personal information is not transmitted to network nodes, etc. Consequently, security regarding personal information can be enhanced.
[0157] As another example, the model training function (820) may be included in the RAN node, and the model inference function (840) may be included in the UE. The RAN node receives training data for training an AI model from the UE and trains the AI model using the received training data. The RAN node distributes the trained AI model to the UE. The UE can generate output data by performing inference based on the received AI model. At this time, the data for inference can be received from the RAN node or data acquired by the UE itself can be used. The UE and the RAN node can perform communication-related operations based on the output data generated by inference. Subsequently, the UE can send feedback regarding the operation to the RAN node. Thus, through feedback information regarding the inference results of the AI model, the RAN node can train the AI model and distribute the updated AI model to the UE. According to the method described above, the load on the RAN node can be reduced by having the model training function (820) in the RAN node and the model inference function (840) in the UE perform inference. In addition, if the UE performs inference using data acquired independently, even if the UE loses its connection to the RAN node after receiving the AI model, the UE can continue to perform inference using the received AI model and operate based on the inference results.
[0158] According to the aforementioned framework and procedure, an AI model can be trained and utilized in a wireless communication system. The model training function (820) and the model inference function (840) can be combined in various ways and are not necessarily limited to the case of FIG. 9. In the aforementioned framework and procedure, various data such as input data, training data, and inference data are introduced, and the specific details of the aforementioned data may vary depending on the task in which the AI model is utilized. For example, information used in the various embodiments of the present disclosure described below may be included in the aforementioned data.
[0159]
[0160] FIG. 10 illustrates an AI technology-based communication procedure applicable to the present disclosure. The detailed procedure illustrated in FIG. 10 may be combined with various embodiments of the present disclosure described below. For example, data generated according to various embodiments of the present disclosure may be used for operations (e.g., setup, training, inference, and / or data transmission / reception) in at least one of the detailed procedure illustrated in FIG. 10. As another example, the result of the inference illustrated in FIG. 10 may be used to transmit and / or receive data according to various embodiments of the present disclosure.
[0161] Referring to FIG. 10, in step S1001, at least one of the UE (1010), RAN node (1020), and network node (1030) performs an initial connection procedure. For example, in this step, at least one of an initial cell search operation, a system information acquisition operation, a random access operation, and a registration operation may be performed. In step S1003, at least one of the UE (1010), RAN node (1020), and network node (1030) performs a configuration procedure. Through the configuration procedure, parameters, resources, connections, and / or entities necessary to perform subsequent procedures at layers between the UE (1010) and the RAN node (1020) and / or at least one layer between the UE (1010) and the network node (1030) may be determined and / or created. At this time, the configuration procedure may be performed based on information, status, and / or characteristics of the AI model used for subsequent training and inference.
[0162] In step S1005, at least one of the UE (1010), RAN node (1020), and network node (1030) performs a model training procedure. At least one of the UE (1010), RAN node (1020), and network node (1030) may collect training data and perform training using the training data. For example, the model training procedure may be performed as described with reference to FIG. 9. If an offline trained model is used, this step may be omitted.
[0163] In step S1007, at least one of the UE (1010), RAN node (1020), and network node (1030) performs a task using a trained model. That is, the task may be performed by the result of inference and / or prediction using the trained model. For example, the task may be a procedure belonging to a communication protocol, a preliminary operation for subsequent data transmission and / or reception, related to data transmission and / or reception, or related to data processing (e.g., encoding, decoding, etc.).
[0164] In step S1009, at least one of the UE (1010), RAN node (1020), and network node (1030) transmits and / or receives data. At this time, the result of the task performed in step 1007 may be used. In some cases, the task performed in step 1007 may include the transmission and / or reception of data, in which case this step may be omitted as it is part of step 1007.
[0165]
[0166] Specific embodiments of the present disclosure
[0167] The present disclosure is intended to prevent mismatches in the interpretation of semantic expressions between a source and a destination in semantic communication. Semantic communication refers to a communication technique in which a source and a destination transmit and receive semantic expressions and perform communication through the interpretation of semantic expressions. The source and the destination each possess background knowledge. Through background knowledge, the entropy of semantic communication can be reduced. However, because the background knowledge of the source and the destination differs, the source and the destination may interpret a single semantic expression differently, and a mismatch may occur. A matching method through the alignment of semantic expressions between a source and a destination to prevent such mismatches is disclosed below. The alignment of semantic expressions can be performed based on the transmission of a reference signal and the semantic expression of the reference signal. For the alignment of semantic expressions, semantic expressions can be connected to each other. For example, semantic expressions can be connected in a sequence. Semantic expressions connected in a sequence can be matched by aligning them based on at least one semantic expression or a codebook vector.
[0168]
[0169] Problems related to communication can be divided into three levels as illustrated in FIG. 11, according to the philosophy of Shannon and Weaver. FIG. 11 illustrates a communication model applicable to the present disclosure. The problem of Level A (1110) is a technical problem related to how accurately symbols in communication can be transmitted, and the problem of Level B (1120) is a semantic problem related to how accurately the transmitted symbols convey the desired meaning. The problem of Level C (1130) is an effectiveness problem related to how effectively the received meaning influences the operation in the desired manner.
[0170] Shannon's information theory focuses only on technical problems at Level A (1110). However, Weaver explains that if semantic transmitters, semantic receivers, and semantic noise are added to Shannon's communication model, Shannon's information theory is general enough to account for problems at Level B (1120) and Level C (1130).
[0171] Meanwhile, one of the various goals of 6G communication is to enable various new services that interconnect people and machines. Therefore, in addition to considering only the technical problems of Level A (1110) in the communication system, it is necessary to provide a semantic communication method that considers the semantic problems of Level B (1120). Semantic communication means that a first device and a second device corresponding to the source and destination, respectively, efficiently transmit and receive semantic information using background knowledge, which is common information. Referring to the communication model of FIG. 11, if the meaning of the intended message sent by the first device corresponding to the source is accurately interpreted by the second device corresponding to the destination, it can be said that correct semantic communication has been performed.
[0172] For semantic communication, a source can generate a semantic representation based on given or collected raw data and transmit the generated semantic representation to a destination. The destination interprets and reasons the received semantic representation in accordance with the source's intent. In this context, semantic communication requires an approach that considers not the reduction of reconstruction errors occurring during the process of restoring the received semantic representation to the original raw data, but rather whether the downstream task—the task performed at the destination—can operate according to the source's intent using the received semantic representation. Therefore, the destination utilizes its own background knowledge when performing reasoning operations, and it is desirable that the background knowledge contained in the data transmitted from the source be reflected in the destination's background knowledge to obtain correct interpretation results. In other words, since the destination performs interpretation and reasoning operations on the semantic representation using background knowledge, it is necessary for the source and the destination to share the same background knowledge.
[0173] As mentioned above, semantic features generated at a source and transmitted to a destination must be created with downstream operations running at the destination in mind. Therefore, a task-oriented semantic communication system is required, and such a system enables the preservation of task-relevant information while introducing invariances useful for downstream operations.
[0174] Figure 12 conceptually illustrates the structure of semantic communication. The semantic communication in Figure 12 corresponds to the semantic communication at level B of Figure 11. Referring to Figure 12, a message transmitted from a source to a destination In relation to, it is defined as follows.
[0175] World model The Shannon entropy of is given by Equation 1. The Shannon entropy of the world model is called the model entropy of the semantic source.
[0176]
[0177] In mathematical formula 1, is the World model Shannon entropy, is a probability distribution, represents the model distribution.
[0178] World Model The probability distribution It is a set of interpretations, and is the model distribution, cast The model where is "true" When referred to as the set of its models, the message The logical probability of is given by Equation 2.
[0179]
[0180] In mathematical formula 2, is a message The logical probability of, is a probability distribution, is the model distribution, means world model. A symbol is a general propositional satisfaction relation ( is the usual propositional satisfaction relation), semantically meaning that it "entails the following result" or "is a stronger condition." This sign reveals an association from a semantic perspective.
[0181] semantic entropy It is expressed as in mathematical formula 3.
[0182]
[0183] In mathematical formula 3, Is semantic entropy, is a message It means the logical probability of.
[0184] Background Knowledge When considering , the set of possible worlds in Equations 2 and 3 is background knowledge It is restricted to sets compatible with . Therefore, semantic entropy is expressed as a conditional logical probability as expressed in Equations 4 and 5.
[0185]
[0186] In mathematical formula 4, background knowledge Message considering The logical probability of, represents the model distribution.
[0187]
[0188] In mathematical formula 5, background knowledge Message considering The logical probability of, background knowledge Message considering It refers to the semantic entropy of.
[0189] for example, is statistical probabilities, and background knowledge Let us assume that the truth table is as shown in Table 2. Table 2 is and This is a truth table.
[0190] # probability10010.2520110.2531000.2541110.25
[0191] In Table 2, the possible worlds are It is "reduced" to a series of true assignments, namely Cases 1, 2, and 4. Thus, a conditional logical probability as in Equation 6 is obtained.
[0192]
[0193] In mathematical formula 6, background knowledge Message considering The logical probability that is true, background knowledge Message considering The logical probability that is true, Is and It refers to the logical probability that all are true.
[0194] Due to the influence of background knowledge, logical probabilities differ from priori statistical probabilities, and in a new distribution and is no longer logically independent. In other words, am.
[0195] Background Knowledge If exists, If this is a new distribution of the set of models, the new model distribution and Shannon entropy are expressed as Equation 7 and Equation 8, respectively.
[0196]
[0197] In mathematical formula 7, represents the model distribution.
[0198]
[0199] In mathematical formula 8, background knowledge A model considering It refers to the semantic entropy of.
[0200] In the example of Table 2, the model entropy of the source without considering background knowledge is given by Equation 9.
[0201]
[0202] In mathematical formula 9, is a model It refers to the semantic entropy of.
[0203] In the example of Table 2, the model entropy of the source considering background knowledge is given by Equation 10.
[0204]
[0205] In mathematical formula 10, background knowledge A model considering It refers to the semantic entropy of.
[0206] Equations 9 and 10 demonstrate that the presence of shared background knowledge allows for the compression of the message intended to be transmitted from the source without information loss, and enables the maximum extraction of information from the source using shorter messages. In other words, one of the main reasons why communication at the semantic level can provide performance improvements over communication at the conventional technical level is that background knowledge is taken into account. As previously mentioned, when semantic features are generated and transmitted considering downstream tasks located at the destination, the utilization of background knowledge can be seen as consistent with the purpose of performing semantic communication.
[0207] In order for semantic communication incorporating all the previously described components to be performed, a new layer called a semantic layer, which governs the overall operation of semantic data and messages, may be added to the communication device. This semantic layer can be located at the source and destination based on a task-oriented semantic communication system. To perform communication between the semantic layers located at the source and destination, it is necessary to define a protocol—a set of rules between layers—and a series of operational processes.
[0208] In semantic communication configured in a newly defined semantic layer, the source and destination require a consensus process regarding background knowledge information to perform accurate reasoning. Fig. 13 illustrates an example of semantic communication between devices having different background knowledge. Fig. 13 shows a device that distinguishes digits from 0 to 9 for the MNIST dataset. and a device that distinguishes between even and odd numbers The process of performing semantic communication between them is illustrated. Referring to Fig. 13, since the two devices have different background knowledge, they generate representations in different spaces for the same message signal. Therefore, the device The RX of the device Inference cannot be performed on the expression generated by .
[0209] To overcome the background knowledge mismatch problem in such semantic communication, a knowledge matching technique based on semantic channel equalization has been proposed. Semantic channel equalization is a method of performing preprocessing or postprocessing so that a representation generated from a source can be interpreted as an appropriate intent at the destination. The semantic channel equalizer is designed based on optimal transport theory, which finds a joint distribution that minimizes a distance-based cost function for two different data distributions. The source and destination are trained using a coupling matrix such as Equation 11, which represents the empirical distribution between the two through their respective representation samples.
[0210]
[0211] In mathematical formula 11, is the cost matrix, is the coupling matrix, is an empirical distribution, is the number of training samples corresponding to the i-th index of the source, is the number of training samples corresponding to the j-th index of the destination, and represents the probability mass in the discrete domain.
[0212] Transformation function used in semantic channel equalizers Optimization is performed as shown in Equation 12 so that it can be close to the coupling matrix.
[0213]
[0214] In mathematical formula 12, is a conversion function, is the coupling matrix, represents the number of training samples corresponding to the i-th index of the source.
[0215] In semantic communication, finding a transformation that prevents semantic mismatch is more important than finding an exact transformation function between two distributions. Therefore, when designing a semantic channel equalizer, a process is added as shown in Equation 13 to ensure that the source representation is adjacent to the center of the destination representation space by setting the ball radius parameter. Figure 14 illustrates an example of semantic channel equalization according to the ball radius parameter. Figure 14 shows the ball radius in the semantic channel equalizer design process The matching process between the source representation space and the destination representation space is illustrated accordingly. Referring to FIG. 14, the source representation is matched to the destination representation space according to the ball radius parameter. For example, when the ball radius parameter is 1, the source representation can be matched to the entire representation space of the destination, and when the ball radius parameter is 0, the source representation can be matched to the center point of the representation space of the destination.
[0216]
[0217] In mathematical formula 13, is a function to reduce the distribution of the destination, is the ball radius parameter, represents the center point of the destination distribution.
[0218] An object function that includes all the processes from Equation 11 to Equation 13 above can be represented as Equation 14, and a semantic channel equalizer can be designed through joint optimization.
[0219]
[0220] In mathematical formula 14, is a conversion function, is the coupling matrix, is a function to reduce the distribution of the destination, is the number of training samples corresponding to the i-th index of the source, represents the cost matrix. This is the part for regularization.
[0221] In order to execute the aforementioned semantic channel equalization-based knowledge matching protocol, the relationships between labels existing in different knowledge ( ) must be defined first. Figures 15a and 15b illustrate label relationships between two devices performing different tasks on the MNIST dataset. Figure 15a illustrates the label relationship between the task of distinguishing digits from 0 to 9 and the task of distinguishing even or odd numbers. Figure 15b illustrates the label relationship between the task of determining modulus 3 and the task of distinguishing digits from 0 to 9. Referring to Figures 15a and 15b, for the label relationship between the tasks to be defined, the source and destination must perform the process of sharing the location of the representation space for the reference signal by transmitting and receiving a reference signal based on the original data.
[0222] The aforementioned reference signal is equally required in the background knowledge matching technique based on semantic representation codebook alignment. Figure 16 illustrates a background knowledge matching process using multiple reference signals. Referring to Figure 16, the semantic representation codebook alignment technique performs background knowledge matching by aligning the index order of a representation codebook sequence generated through space-filling vector quantization with respect to the representation spaces held by the source and destination. In order to perform a matching procedure for background knowledge containing multiple labels in the semantic representation codebook alignment technique, reference signals equal to the number of labels required for knowledge matching are required, as illustrated in Figure 16. In the actual representation codebook sequence generated through space-filling vector quantization, interpolation lines are formed for all representation spaces.
[0223] In the aforementioned technique, when a representation codebook sequence is connected from one label representation space to another, it cannot be guaranteed that the source and destination representation codebook sequences are connected identically. In other words, the label representation space to which the source representation codebook sequence is connected may not correspond to the label representation space to which the destination representation codebook sequence is connected. This phenomenon can be referred to as a 'difference in the label unit order of the representation codebook sequences'.
[0224] The reason for the difference in label-unit order of the representation codebook sequences is that the data distributions of the source and destination are different. Fig. 17a illustrates the codebook sequence of the source's representation space. Fig. 17b illustrates the codebook sequence of the destination's representation space. Referring to Figs. 17a and 17b, during the space-fill vector quantization process, interpolation lines between codebook vectors are formed to approximate every point in the representation space. The generated codebook sequences differ due to the difference in data distribution in the region corresponding to the boundary of the label representation space between the source's representation space and the destination's representation space. The data in the boundary region of the source and destination's label representation spaces is different. Due to this difference in data distribution existing in the boundary region of the label representation space, a difference in label-unit order occurs in the codebook sequences generated by the source and destination. For example, in Fig. 17, the source's label representation space is p i , p i+1 , p i+2 It has the order of, but the destination label representation space is q i , q i+2 , q i+1 It has the order of. To solve this problem, the representation codebook sequence must be designed so that the distance between central points of the label representation space representing the global characteristics of the data labels held by the source and destination can be taken into account.
[0225]
[0226] The present disclosure proposes procedures for designing a joint representation codebook sequence to perform more efficient knowledge matching regarding different background knowledge between a source and a destination. The procedures for designing the codebook sequence can be performed by the source and the destination. The procedures for designing the codebook sequence are a ball radius parameter-based transformation function It includes a process of concentrating the label representation spaces of the source and destination into a central point, a process of transmitting and receiving a reference signal based on distance information of each label representation space held by the source and destination in the concentrating representation space, a process of designing a representation codebook sequence in which the source and destination have the same label order by increasing the ball radius parameter of the label representation space corresponding to the shared reference signal through the process, and a semantic layer protocol and procedure according to the procedure associated with the aforementioned processes.
[0227] The semantic representation codebook alignment protocol proposed in this disclosure involves a source and a destination having their respective representation spaces and It is assumed that a representation codebook is possessed by performing vector quantization on [it]. For example, it can be assumed that the source and destination possess a vector-quantized representation space using a model that utilizes representation space quantization, such as a VQ-VAE (vector quantized variational auto-encoder). Additionally, the label relationships between the representation spaces of the source and destination A situation is assumed where is not yet defined.
[0228] FIG. 18a illustrates an example of a source codebook sequence according to one embodiment of the present disclosure. FIG. 18b illustrates an example of a destination codebook sequence according to one embodiment of the present disclosure. FIG. 18a and FIG. 18b represent representation codebook sequences in a representation space condensed around a central point through a transformation matrix. Referring to FIG. 18a and FIG. 18b, the source and destination have a transformation function that condenses each label representation space around a central point based on the semantic representation codebook they possess. The representation space is transformed using [this]. Here, the representation space is transformed before space-fill vector quantization is performed. As shown in Equation 13, the function used in semantic channel equalization can be utilized as the transformation function. Here, the source and destination points in each label representation space become center points by adjusting the radius of inclination parameter (r) according to the magnitude of the variance of each label data distribution. It is controlled to be densely packed. By adjusting the ball radius parameter, the representation codebook sequence by space-fill vector quantization is formed based on data located close to the center of the representation space. In other words, the label order of the representation codebook sequence by space-fill vector quantization is formed according to data-specific characteristics rather than user-specific characteristics. If the ball radius parameter is not adjusted, the codebook sequence may be formed based on user-specific characteristics located at the periphery of the representation space, as illustrated in FIG. 17b. The influence of these user-specific characteristics can be reduced by adjusting the ball radius parameter. For example, in FIG. 18a and FIG. 18b, the codebook sequence is B r (P i ) (1801) and B r (P i+1 ) (1803), B r (P i+2 The distance between ) (1805), and B r (Q i ) (1811) and B r (Q i+1 ) (1813), B r (Q i+2 It can be generated based on the distance between ) (1815). In the example of FIG. 18a, B r (P i ) (1801) and B r (P i+1 The distance between ) (1803) is B r (P i) (1801) and B r (P i+2 It is shorter than the distance between ) (1805). Therefore, B r (P i From ) (1801) B r (P i+1 The codebook sequence is connected to ) (1803). In the example of Fig. 18b, and B r (Q i ) (1811) and B r (Q i+1 The distance between ) (1813) is B r (Q i ) (1811) and B r (Q i+2 Since it is shorter than the distance between ) (1815), B r (Q i From ) (1811) B r (Q i+1 The codebook sequence is connected to ) (1813). In other words, the order of the label representation space by the source and destination codebook sequences is the same.
[0229] The representation codebook sequence generated through the aforementioned transformation process has its label order determined based on the distance between the center points of the label representation spaces. However, if the distance difference between the label representation spaces is small, a difference in label order may occur between the source representation codebook sequence and the destination representation codebook sequence. That is, if the distance difference between the label representation spaces is smaller than a specific value, the label orders of the source and the destination may differ from each other. To resolve this discrepancy in label order, the source and the destination transmit and receive a reference signal corresponding to one of the labels based on the distance information between the label representation spaces they each possess. FIG. 19 illustrates an example of a code sequence generation process based on such a reference signal. FIG. 19a illustrates an example of a source representation codebook sequence based on a reference signal according to an embodiment of the present disclosure. FIG. 19b illustrates an example of a destination representation codebook sequence based on a reference signal according to an embodiment of the present disclosure. Referring to FIG. 19, the source and the destination [are] at a threshold value ( If it is smaller than ), a reference signal is transmitted and received. The source and destination generate a semantic representation in a representation space based on the same reference signal. The representation space where the semantic representation generated from the reference signal is located has a corresponding meaning at the source and destination. The source and destination increase the ball radius parameter for the label representation space containing the reference signal so that the number of data points in the boundary region of the corresponding label representation space increases. In the example of Fig. 19a, B r (P i ) (1901) and B r (P i+1 The distance between ) (1903) and B r (P i ) (1901) and B r (P i+2Since the difference in distance between ) (1905) is smaller than the threshold, the source increases the size of the representation space where the semantic representation of the reference signal is located. Accordingly, B r (P i From ) (1901) B r (P i+1 The codebook sequence is connected to ) (1903). In the example of Fig. 19b, and B r (Q i ) (1911) and B r (Q i+1 The distance between ) (1913) and B r (Q i ) (1911) and B r (Q i+2 Since the difference in distance between ) (1915) is smaller than the threshold, the destination is B, the representation space where the semantic representation of the reference signal is located. r (Q i+1 Increases the size of ) (1913). Accordingly, B r (Q i From ) (1911) B r (Q i+1 A codebook sequence is connected to ) (1913). For the representation space transformed according to the procedure described above, the source and destination can each perform space-fill vector quantization to generate a semantic representation codebook sequence having the same label order.
[0230] FIG. 20 illustrates an example of a procedure for generating an integrated semantic representation codebook sequence according to one embodiment of the present disclosure. The procedure of FIG. 20 is performed by a first device (2000) and a second device (2010). The first device is a device that transmits a reference signal, and the second device is a device that receives a reference signal. For example, the first device may be a source, and the second device may be a destination.
[0231] Referring to FIG. 20, in steps S2001 and S2003, the first device and the second device transform the label representation space. For example, the first device and the second device use a transformation function to concentrate their respective label representation spaces around a center point. The ball radius parameter for the transformation function can be determined according to the magnitude of the variance of each label data distribution.
[0232] In step S2005, the first device transmits a reference signal to the second device. Here, the reference signal may be transmitted based on the distance between label representation spaces and a threshold value. For example, the first device shares the reference signal by transmitting it to the second device when the difference in distance from the reference label representation space is less than the threshold value.
[0233] In step S2007, the first device and the second device control the ball radius of the label representation space. More specifically, the first device and the second device control the size of the representation space by increasing the ball radius parameter of the label representation space to which the reference signal shared in step S2005 belongs. That is, they transform the representation space.
[0234] In step S2009, the first device and the second device generate a representation codebook sequence. For example, the representation codebook sequence may be generated using space-fill vector quantization. In other words, after step S2007, the first device and the second device perform space-fill vector quantization to generate a representation codebook sequence and perform a procedure to restore the transformed representation space to its original size. The order of the label representation space may be determined by the generated representation codebook sequence.
[0235]
[0236] Hereinafter, examples of procedures for generating a codebook sequence for the aforementioned semantic communication are illustrated. The procedures for generating a codebook sequence may be performed by a first device and a second device. The first device may be a source or a destination, and the second device may be a destination or a source. The first device is a device that transmits a reference signal, and the second device is a device that receives a reference signal. The first device and the second device may be devices having representation spaces based on vector quantization. The first device and the second device may generate a semantic representation based on the reference signal. The generated semantic representation may be located in a representation space. The representation spaces where the semantic representations generated by the first device and the second device based on the same reference signal are located may be semantically corresponding.
[0237]
[0238] FIG. 21 illustrates an example of a procedure for performing semantic communication of a terminal according to one embodiment of the present disclosure. FIG. 21 illustrates a method performed by a terminal (e.g., the first device (2000) of FIG. 20) that generates and transmits a semantic representation.
[0239] Referring to FIG. 21, in step S2101, the terminal performs an initial connection procedure. The terminal detects a synchronization signal from a base station, receives system information, and can perform a random access procedure. Specifically, the terminal obtains information related to a random access channel included in the system information and can transmit a random access preamble based on the obtained information. At this time, the terminal can select a random access channel occasion (RO) for transmitting the random access preamble based on the detected synchronization signal.
[0240] In step S2103, the terminal transmits capability information. The capability information includes information indicating the hardware or software capabilities of the terminal. Although not illustrated in FIG. 21, the terminal may receive a request message for capability information from a base station and transmit a message containing capability information in response to the request message. According to one embodiment, the capability information may be information related to semantic communication and may include at least one of information related to whether task-oriented semantic communication is supported, whether background knowledge matching is supported, or whether a codebook vector is possessed. According to another embodiment, information related to semantic communication may be transmitted through a procedure other than capability information. For example, information related to semantic communication may be transmitted through the signaling of step S2105 below.
[0241] In step S2105, the terminal performs signaling for configuration related to communication. For example, the terminal may perform control signaling with a base station for configuration necessary to perform communication. According to one embodiment, the terminal may transmit and / or receive configuration information for generating a codebook sequence for semantic communication and matching background knowledge. Specifically, the terminal may receive from the base station configuration information related to at least one of the following: the number of labels for knowledge matching, the number of codebook vectors included in each label, a ball radius parameter for changing the size of the representation space, a matrix for preprocessing or postprocessing (e.g., a transformation matrix or a coupling matrix), and a parameter for vector quantization (e.g., space-fill vector quantization). That is, the terminal may receive configuration information necessary for semantic communication according to various embodiments of the present disclosure.
[0242] In step S2107, the terminal transmits a reference signal. The reference signal may be transmitted to a base station or another terminal. For example, the base station or another terminal may be a destination for semantic communication. The terminal may transmit the reference signal based on the distance difference between representation spaces. For example, the terminal may transmit the reference signal if the distance difference between representation spaces is smaller than a threshold value.
[0243] In step S2109, the terminal generates a codebook sequence based on the semantic representation of the reference signal. For example, the codebook sequence can be generated using space-fill vector quantization. The codebook sequence can be generated to minimize the value of the distance between the interpolation line and the representation points.
[0244] After generating a codebook sequence, the terminal can perform background knowledge matching by aligning the codebook sequence based on the semantic representation of the reference signal. For example, the terminal can set an initial index based on the position of the semantic representation of the reference signal in the representation space, and perform background knowledge matching by aligning the codebook sequences of the representation spaces based on the initial index.
[0245] Although not illustrated in FIG. 21, after background knowledge matching is performed, the terminal can generate and transmit a semantic expression based on the matched background knowledge. Additionally, the terminal can receive and interpret the semantic expression based on the matched background knowledge.
[0246]
[0247] Hereinafter, a detailed embodiment of the aforementioned background knowledge matching protocol is described. The background knowledge matching protocol is performed by a first device and a second device. The first device may be a source or a destination, and the second device may be a destination or a source. In other words, the first device and the second device may each be a source and a destination, or a destination and a source. The first device and the second device are devices that already possess a semantic representation codebook and can represent a reference signal as a semantic representation by the semantic representation codebook.
[0248]
[0249] FIG. 22 illustrates an example of a communication procedure according to codebook sequence generation according to one embodiment of the present disclosure. FIG. 22 illustrates a procedure performed by a first device (e.g., the first device (2000) of FIG. 20).
[0250] Referring to FIG. 22, in step S2201, the first device controls the size of the representation space. The first device controls the size of the representation spaces based on a viewing radius parameter. Additionally, the first device may increase the viewing radius parameter based on the distance between the representation spaces. For example, the first device may increase the size of at least one of the representation spaces if the difference in distance between the representation spaces is smaller than a threshold value.
[0251] In step S2203, the first device generates a codebook sequence based on representation spaces. For example, the first device may generate a codebook sequence based on the distance between representation spaces. The codebook sequence is generated across multiple representation spaces. By controlling the size of the representation spaces, the codebook sequences of the first device and the second device (e.g., the second device (2010) of FIG. 20) may include representation spaces in the same order. After generating the codebook sequence, the first device may restore the representation spaces to their original size.
[0252] In step S2205, the first device performs background knowledge matching based on a codebook sequence. Background knowledge matching can be performed between the first device and the second device. For example, background knowledge matching can be performed by the first device and the second device aligning the codebook sequence based on the same reference signal and matching the codebook vectors based on an index.
[0253] In step S2207, the first device transmits or receives a signal based on matched background knowledge. Here, the signal can be generated and interpreted based on a semantic representation. The first device can generate and transmit the signal based on the matched background knowledge. The first device can interpret the received signal based on the matched background knowledge. In other words, semantic communication can be performed based on background knowledge matching.
[0254]
[0255] FIG. 23 illustrates an example of a codebook sequence generation procedure according to one embodiment of the present disclosure. FIG. 23 illustrates a procedure performed by a first device (e.g., the first device (2000) of FIG. 20).
[0256] Referring to FIG. 23, in step S2301, the first device controls the size of the representation space. For example, the first device can control the size of the representation space by adjusting the ball radius parameter. For example, the first device can control the size of the representation space by lowering the ball radius parameter to 0.1 or 0.01.
[0257] In step S2303, the first device compares the distances between the representation spaces. For comparison, the first device can calculate the difference in distance between the representation spaces. The difference in distance between the representation spaces can be calculated, and the difference in distance can be compared with a threshold value. The first device can control the size of at least one of the representation spaces based on the comparison result. For example, the first device can control the size of at least one of the representation spaces by increasing the ball radius parameter to 0.5 based on the comparison result.
[0258] In step S2305, the first device may generate a codebook sequence based on a comparison result. The codebook sequence may be generated based on the distance between representation spaces. The codebook sequences of the first device and the second device may include a plurality of codebook vectors. The plurality of codebook vectors may exist on at least one representation space. The order of representation spaces may be determined according to the codebook sequence. The order of corresponding representation spaces of the first device and the second device may be the same.
[0259]
[0260] FIG. 24 illustrates an example of a codebook sequence generation procedure based on the distance between representation spaces according to one embodiment of the present disclosure. The procedure of FIG. 24 can be performed by a first device (e.g., the first device (2000) of FIG. 20).
[0261] Referring to FIG. 24, in step S2401, the first device compares the distance difference between representation spaces with a threshold value. The first device may compare the distance difference between one representation space and other representation spaces with the threshold value. For example, the first device compares one representation space (e.g., B in FIG. 19). r (P i ) (1901)) and other representation spaces (e.g., B in Fig. 19a) r (P i+1 ) (1903), B r (Pi+2 The difference in distance between ) (1905)) can be compared with the threshold value.
[0262] In step S2403, the first device transmits a reference signal based on the comparison result. For example, the first device may transmit the reference signal if the difference in distance between one representation space and other representation spaces is smaller than a threshold value. The reference signal may be transmitted to the second device (e.g., the second device (2010) of FIG. 20). The reference signal may be transmitted to the second device as original data rather than a semantic representation. By transmitting the reference signal, the first device and the second device may possess the same original data. By the reference signal, the first device and the second device may determine semantically corresponding representation spaces.
[0263] In step S2405, the first device generates a semantic representation of a reference signal. The semantic representation of the reference signal may be located in any one of the other representation spaces of step S2403. The representation space of the first device where the semantic representation of the reference signal is located may semantically correspond to the representation space of the second device where the semantic representation of the same reference signal is located.
[0264] In step S2407, the first device controls the size of the representation space based on the semantic representation. For example, the first device can control the size of the representation space where the semantic representation is located. The first device can control the size of the representation space where the semantic representation is located based on a ball radius parameter. For example, the first device can control the size of the representation space by controlling the size of the ball radius parameter of the representation space where the semantic representation is located to 0.5. In other words, the size of the representation space can be increased.
[0265]
[0266] Although the procedures of FIGS. 21 through 24 have been described as being performed by the first device, the same procedures may be performed by the second device. In this case, the second device may receive the reference signal without transmitting it. In other words, the transmission of the reference signal in steps S2107 and S2403 may be changed to the reception of the reference signal.
[0267]
[0268] Hereinafter, examples of wireless device applications to which various embodiments of the present disclosure are applied will be described.
[0269] FIG. 25 illustrates an example of a wireless device applicable to the present disclosure. The wireless device may be implemented in various forms depending on the use—example / service (see FIG. 1).
[0270] Referring to FIG. 25, the wireless device (200) corresponds to the wireless device (200) of FIG. 2 and may be composed of various elements, components, units / parts, and / or modules. For example, the wireless device (200) may include a communication unit (210), a control unit (220), a memory unit (230), and additional elements (240). The communication unit may include a communication circuit (212) and transceiver(s) (214). For example, the communication circuit (212) may include one or more processors (202) and / or one or more memories (204) of FIG. 2. For example, the transceiver(s) (214) may include one or more transceivers (206) and / or one or more antennas (208) of FIG. 2. The control unit (220) is electrically connected to the communication unit (210), the memory unit (230), and additional elements (240) and controls the overall operation of the wireless device. For example, the control unit (220) can control the electrical / mechanical operation of the wireless device based on a program / code / command / information stored in the memory unit (230). Additionally, the control unit (220) can transmit information stored in the memory unit (230) to an external entity (e.g., another communication device) via a wireless / wired interface through the communication unit (210), or store information received from an external entity (e.g., another communication device) via a wireless / wired interface through the communication unit (210) in the memory unit (230).
[0271] The additional element (240) may be configured in various ways depending on the type of wireless device. For example, the additional element (240) may include at least one of a power unit / battery, an input / output unit (I / O unit), a driving unit, and a computing unit. Although not limited thereto, the wireless device may be implemented in the form of a robot (Fig. 1, 100a), a vehicle (Fig. 1, 100b-1, 100b-2), an XR device (Fig. 1, 100c), a portable device (Fig. 1, 100d), a home appliance (Fig. 1, 100e), an IoT device (Fig. 1, 100f), a digital broadcasting terminal, a holographic device, a public safety device, an MTC device, a medical device, a fintech device (or financial device), a security device, a climate / environment device, an AI server / device (Fig. 1, 400), a base station (Fig. 1, 200), a network node, etc. Depending on the use—e.g., service—the wireless device may be movable or used in a fixed location.
[0272] In FIG. 25, various elements, components, units / parts, and / or modules within the wireless device (200) may be entirely interconnected via a wired interface, or at least partially connected via a communication unit (210). For example, within the wireless device (200), the control unit (220) and the communication unit (210) may be connected via a wire, and the control unit (220) and the first unit (e.g., 230, 240) may be connected wirelessly via the communication unit (210). Additionally, each element, component, unit / part, and / or module within the wireless device (200) may include one or more additional elements. For example, the control unit (220) may be composed of one or more sets of processors. For example, the control unit (220) may be composed of a set of a communication control processor, an application processor, an Electronic Control Unit (ECU), a graphics processing processor, a memory control processor, etc. As another example, the memory unit (130) may be composed of RAM (Random Access Memory), DRAM (Dynamic RAM), ROM (Read Only Memory), flash memory, volatile memory, non-volatile memory and / or a combination thereof.
[0273] Hereinafter, an implementation example of FIG. 25 will be described in more detail with reference to the drawings.
[0274] FIG. 26 illustrates an example of a portable device applicable to the present disclosure. The portable device may include a smartphone, a smartpad, a wearable device (e.g., a smartwatch, smart glasses), or a portable computer (e.g., a laptop). The portable device may be referred to as a Mobile Station (MS), a User Terminal (UT), a Mobile Subscriber Station (MSS), a Subscriber Station (SS), an Advanced Mobile Station (AMS), or a Wireless Terminal (WT).
[0275] Referring to FIG. 26, the portable device (200) may include an antenna unit (208), a communication unit (210), a control unit (220), a memory unit (230), a power supply unit (240a), an interface unit (240b), and an input / output unit (240c). The antenna unit (208) may be configured as part of the communication unit (210). Blocks 210 to 230 / 240a to 240c of FIG. 26 correspond to blocks 210 to 230 / 240 of FIG. 25, respectively.
[0276] The communication unit (210) can transmit and receive signals (e.g., data, control signals, etc.) with other wireless devices and base stations. The control unit (220) can control the components of the portable device (200) to perform various operations. The control unit (220) may include an AP (Application Processor). The memory unit (230) can store data / parameters / programs / code / commands required for the operation of the portable device (200). Additionally, the memory unit (230) can store input / output data / information, etc. The power supply unit (240a) supplies power to the portable device (200) and may include wired / wireless charging circuits, batteries, etc. The interface unit (240b) can support the connection between the portable device (200) and other external devices. The interface unit (240b) may include various ports (e.g., audio input / output ports, video input / output ports) for connection with external devices. The input / output unit (240c) can receive or output video information / signals, audio information / signals, data, and / or information input by a user. The input / output unit (240c) may include a camera, a microphone, a user input unit, a display unit (240d), a speaker and / or a haptic module, etc.
[0277] For example, in the case of data communication, the input / output unit (240c) acquires information / signals (e.g., touch, text, voice, image, video) input by the user, and the acquired information / signals can be stored in the memory unit (230). The communication unit (210) converts the information / signals stored in the memory into wireless signals and can directly transmit the converted wireless signals to another wireless device or to a base station. Additionally, the communication unit (210) can receive wireless signals from another wireless device or base station and then restore the received wireless signals to their original information / signals. The restored information / signals are stored in the memory unit (230) and then can be output in various forms (e.g., text, voice, image, video, haptic) through the input / output unit (240c).
[0278] FIG. 27 illustrates an example of a vehicle or autonomous vehicle applicable to the present disclosure. The vehicle or autonomous vehicle may be implemented as a mobile robot, a vehicle, a train, an aerial vehicle (AV), a ship, etc.
[0279] Referring to FIG. 27, a vehicle or autonomous vehicle (200-1) may include an antenna unit (208-1), a communication unit (210-1), a control unit (220-1), a driving unit (240a-1), a power supply unit (240b-1), a sensor unit (240c-1), and an autonomous driving unit (240d-1). The antenna unit (208-1) may be configured as part of the communication unit (210-1). Blocks 210-1 / 230-1 / 240a-1 to 240d-1 of FIG. 27 correspond to blocks 210 / 230 / 240 of FIG. 25, respectively.
[0280] The communication unit (210-1) can transmit and receive signals (e.g., data, control signals, etc.) with external devices such as other vehicles, base stations (e.g., base stations, roadside base stations (Road Side Unit), etc.), and servers. The control unit (220-1) can perform various operations by controlling elements of the vehicle or autonomous vehicle (200-1). The control unit (220-1) may include an Electronic Control Unit (ECU). The driving unit (240a-1) can drive the vehicle or autonomous vehicle (200-1) on the ground. The driving unit (240a-1) may include an engine, motor, power train, wheels, brakes, steering device, etc. The power supply unit (240b-1) supplies power to the vehicle or autonomous vehicle (200-1) and may include wired / wireless charging circuits, batteries, etc. The sensor unit (240c-1) can obtain vehicle status, surrounding environment information, user information, etc. The sensor unit (240c-1) may include an IMU (inertial measurement unit) sensor, a collision sensor, a wheel sensor, a speed sensor, an inclination sensor, a weight detection sensor, a heading sensor, a position module, a vehicle forward / reverse sensor, a battery sensor, a fuel sensor, a tire sensor, a steering sensor, a temperature sensor, a humidity sensor, an ultrasonic sensor, an illuminance sensor, a pedal position sensor, etc. The autonomous driving unit (240d-1) may implement technologies such as maintaining the driving lane, technologies for automatically adjusting speed such as adaptive cruise control, technologies for automatically driving along a predetermined path, and technologies for automatically setting a path and driving when a destination is set.
[0281] For example, the communication unit (210-1) can receive map data, traffic information data, etc. from an external server. The autonomous driving unit (240d-1) can generate an autonomous driving path and a driving plan based on the acquired data. The control unit (220-1) can control the drive unit (240a-1) so that the vehicle or the autonomous vehicle (200-1) moves along the autonomous driving path according to the driving plan (e.g., speed / direction control). During autonomous driving, the communication unit (210-1) can acquire the latest traffic information data from an external server non-periodically and can acquire surrounding traffic information data from surrounding vehicles. Additionally, during autonomous driving, the sensor unit (240c-1) can acquire vehicle status and surrounding environment information. The autonomous driving unit (240d-1) can update the autonomous driving path and the driving plan based on the newly acquired data / information. The communication unit (210-1) can transmit information regarding the vehicle location, autonomous driving path, driving plan, etc. to an external server. An external server can predict traffic information data in advance using AI technology, etc., based on information collected from vehicles or autonomous vehicles, and can provide the predicted traffic information data to vehicles or autonomous vehicles. If the device (220-2) is an autonomous vehicle, it can perform the same procedure as the vehicle or autonomous vehicle (200-1). In addition, if the device (220-2) is a base station or a roadside base station, the device (220-2) can transmit data and control signals to the vehicle or autonomous vehicle (200-1) through the communication unit (210-2).
[0282] FIG. 28 illustrates an example of a vehicle applicable to the present disclosure. The vehicle may be implemented as a means of transport, a train, an aircraft, a ship, etc. Referring to FIG. 28, the vehicle (200) may include a communication unit (210), a control unit (220), a memory unit (230), an input / output unit (240a), and a position measurement unit (240b). Here, blocks 210 to 230 / 240a to 240b correspond to blocks 210 to 230 / 240 of FIG. 25, respectively.
[0283] The communication unit (210) can transmit and receive signals (e.g., data, control signals, etc.) with other vehicles or external devices such as base stations. The control unit (220) can control the components of the vehicle (200) to perform various operations. The memory unit (230) can store data / parameters / programs / codes / commands that support various functions of the vehicle (100). The input / output unit (240a) can output AR / VR objects based on information within the memory unit (230). The input / output unit (240a) may include a HUD. The position measurement unit (240b) can acquire position information of the vehicle (200). The position information may include absolute position information of the vehicle (200), position information within the driving line, acceleration information, position information relative to surrounding vehicles, etc. The position measurement unit (240b) may include GPS and various sensors.
[0284] For example, the communication unit (210) of the vehicle (200) can receive map information, traffic information, etc. from an external server and store it in the memory unit (230). The location measurement unit (240b) can acquire vehicle location information through GPS and various sensors and store it in the memory unit (230). The control unit (220) creates a virtual object based on map information, traffic information, and vehicle location information, etc., and the input / output unit (240a) can display the created virtual object on the glass window inside the vehicle (240a-1, 240a-2). In addition, the control unit (220) can determine whether the vehicle (200) is operating normally within the driving line based on the vehicle location information. If the vehicle (200) deviates abnormally from the driving line, the control unit (220) can display a warning on the glass window inside the vehicle through the input / output unit (240a). Additionally, the control unit (220) can broadcast a warning message regarding a driving abnormality to surrounding vehicles through the communication unit (210). Depending on the situation, the control unit (220) can transmit the vehicle's location information and information regarding the driving / vehicle abnormality to relevant authorities through the communication unit (210).
[0285] FIG. 29 illustrates an example of an XR device applicable to the present disclosure. The XR device may be implemented as an HMD, a Head-Up Display (HUD) equipped in a vehicle, a television, a smartphone, a computer, a wearable device, a home appliance, digital signage, a vehicle, a robot, etc.
[0286] Referring to FIG. 29, the XR device (200a) may include a communication unit (210), a control unit (220), a memory unit (230), an input / output unit (240a), a sensor unit (240b), and a power supply unit (240c). Here, blocks 210 to 230 / 240a to 240c of FIG. 29 correspond to blocks 210 to 230 / 240 of FIG. 25, respectively.
[0287] The communication unit (210) can transmit and receive signals (e.g., media data, control signals, etc.) with external devices such as other wireless devices, mobile devices, or media servers. The media data may include video, images, sound, etc. The control unit (220) can control the components of the XR device (200a) to perform various operations. For example, the control unit (220) may be configured to control and / or perform procedures such as video / image acquisition, (video / image) encoding, metadata generation, and processing. The memory unit (230) may store data / parameters / programs / code / commands required for driving the XR device (200a) or creating an XR object. The input / output unit (240a) acquires control information, data, etc. from the outside and can output the created XR object. The input / output unit (240a) may include a camera, microphone, user input unit, display unit, speaker and / or haptic module, etc. The sensor unit (240b) can obtain XR device status, surrounding environment information, user information, etc. The sensor unit (240b) may include a proximity sensor, an illuminance sensor, an accelerometer, a magnetic sensor, a gyroscope, an inertial sensor, an RGB sensor, an IR sensor, a fingerprint recognition sensor, an ultrasonic sensor, a light sensor, a microphone and / or radar, etc. The power supply unit (240c) supplies power to the XR device (200a) and may include a wired / wireless charging circuit, a battery, etc.
[0288] For example, the memory unit (230) of the XR device (200a) may contain information (e.g., data, etc.) necessary for creating an XR object (e.g., AR / VR / MR object). The input / output unit (240a) may receive a command to operate the XR device (200a) from the user, and the control unit (220) may operate the XR device (200a) according to the user's operation command. For example, if the user intends to watch movies, news, etc. through the XR device (200a), the control unit (220) may transmit content request information to another device (e.g., mobile device (200b)) or a media server through the communication unit (230). The communication unit (230) may download / stream content such as movies, news, etc. from another device (e.g., mobile device (200b)) or a media server to the memory unit (230). The control unit (220) controls and / or performs procedures such as video / image acquisition, (video / image) encoding, and metadata generation / processing for the content, and can generate / output an XR object based on information about the surrounding space or real object acquired through the input / output unit (240a) / sensor unit (240b).
[0289] Additionally, the XR device (200a) is wirelessly connected to the mobile device (200b) through the communication unit (210), and the operation of the XR device (200a) can be controlled by the mobile device (200b). For example, the mobile device (200b) can act as a controller for the XR device (200a). To this end, the XR device (200a) can acquire three-dimensional position information of the mobile device (200b), and then generate and output an XR object corresponding to the mobile device (200b).
[0290] FIG. 30 illustrates an example of a robot applicable to the present disclosure. Robots may be classified into industrial, medical, domestic, military, etc., depending on the purpose or field of use.
[0291] Referring to FIG. 30, the robot (200) may include a communication unit (210), a control unit (220), a memory unit (230), an input / output unit (240a), a sensor unit (240b), and a driving unit (240c). Here, blocks 210 to 230 / 240a to 240c of FIG. 30 correspond to blocks 210 to 230 / 240 of FIG. 25, respectively.
[0292] The communication unit (210) can transmit and receive signals (e.g., driving information, control signals, etc.) with external devices such as other wireless devices, other robots, or control servers. The control unit (220) can control the components of the robot (200) to perform various operations. The memory unit (230) can store data / parameters / programs / codes / commands that support various functions of the robot (200). The input / output unit (240a) can acquire information from outside the robot (200) and output information to outside the robot (200). The input / output unit (240a) may include a camera, microphone, user input unit, display unit, speaker and / or haptic module, etc. The sensor unit (240b) can obtain internal information of the robot (200), surrounding environment information, user information, etc. The sensor unit (240b) may include a proximity sensor, an illuminance sensor, an accelerometer, a magnetic sensor, a gyroscope, an inertial sensor, an IR sensor, a fingerprint recognition sensor, an ultrasonic sensor, a light sensor, a microphone, a radar, etc. The driving unit (240c) may perform various physical movements, such as moving robot joints. Additionally, the driving unit (240c) may enable the robot (200) to travel on the ground or fly in the air. The driving unit (240c) may include an actuator, a motor, a wheel, a brake, a propeller, etc.
[0293] FIG. 31 illustrates an example of an AI device applicable to the present disclosure.
[0294] AI devices can be implemented as stationary devices or mobile devices, such as TVs, projectors, smartphones, PCs, laptops, digital broadcasting terminals, tablet PCs, wearable devices, set-top boxes (STBs), radios, washing machines, refrigerators, digital signage, robots, vehicles, etc.
[0295] Referring to FIG. 31, the AI device (200) may include a communication unit (210), a control unit (220), a memory unit (230), an input / output unit (240a / 240b), a learning processor unit (240c), and a sensor unit (240d). Blocks 210 to 230 / 240a to 240d of FIG. 31 correspond to blocks 210 to 230 / 140 of FIG. 25, respectively.
[0296] The communication unit (210) can transmit and receive wired and wireless signals (e.g., sensor information, user input, learning model, control signal, etc.) with external devices such as other AI devices (e.g., 100a to 100f, 120 in FIG. 1) or AI servers (e.g., 100g in FIG. 1) using wired and wireless communication technology. To this end, the communication unit (210) can transmit information within the memory unit (230) to an external device or transmit signals received from an external device to the memory unit (230).
[0297] The control unit (220) can determine at least one executable operation of the AI device (200) based on information determined or generated using a data analysis algorithm or a machine learning algorithm. The control unit (220) can perform the determined operation by controlling the components of the AI device (200). For example, the control unit (220) can request, search, receive, or utilize data from the learning processor unit (240c) or the memory unit (230), and can control the components of the AI device (200) to execute a predicted operation or an operation determined to be desirable among at least one executable operation. Additionally, the control unit (220) can collect historical information, including the operation content of the AI device (200) or user feedback regarding the operation, and store it in the memory unit (230) or the learning processor unit (240c), or transmit it to an external device such as an AI server (Fig. 1, 100g). The collected historical information can be used to update the learning model.
[0298] The memory unit (230) can store data that supports various functions of the AI device (200). For example, the memory unit (230) can store data obtained from the input unit (240a), data obtained from the communication unit (210), output data from the learning processor unit (240c), and data obtained from the sensing unit (140). Additionally, the memory unit (230) can store control information and / or software code required for the operation / execution of the control unit (220).
[0299] The input unit (240a) can acquire various types of data from outside the AI device (200). For example, the input unit (220) can acquire training data for model training and input data to which the training model is applied. The input unit (240a) may include a camera, a microphone and / or a user input unit, etc. The output unit (240b) can generate output related to visual, auditory, or tactile senses, etc. The output unit (240b) may include a display unit, a speaker and / or a haptic module, etc. The sensing unit (140d) can obtain at least one of internal information of the AI device (200), surrounding environment information of the AI device (200), and user information using various sensors. The sensing unit (140d) may include a proximity sensor, an illuminance sensor, an accelerometer, a magnetic sensor, a gyroscope, an inertial sensor, an RGB sensor, an IR sensor, a fingerprint recognition sensor, an ultrasonic sensor, a light sensor, a microphone and / or radar, etc.
[0300] The learning processor unit (240c) can train a model composed of an artificial neural network using training data. The learning processor unit (240c) can perform AI processing together with the learning processor unit of the AI server (Fig. 1, 100g). The learning processor unit (240c) can process information received from an external device through the communication unit (210) and / or information stored in the memory unit (230). Additionally, the output value of the learning processor unit (240c) can be transmitted to an external device through the communication unit (210) and / or stored in the memory unit (230).
[0301]
[0302] The proposed methods described above may be implemented independently, but they may also be implemented in the form of a combination (or merger) of some of the proposed methods. Rules may be defined so that the base station informs the terminal of the application status of the proposed methods (or information regarding the rules of the proposed methods) through a predefined signal (e.g., a physical layer signal or an upper layer signal).
[0303] The present disclosure may be embodied in other specific forms without departing from the technical ideas and essential features described herein. Accordingly, the above detailed description should not be interpreted restrictively in all respects and should be considered illustrative. The scope of the present disclosure shall be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the present disclosure are included within the scope of the present disclosure. Furthermore, embodiments may be constructed by combining claims that are not explicitly related in the claims, or new claims may be included by amendments made after filing.
[0304] One embodiment can be applied to various wireless access systems. Examples of various wireless access systems include 3GPP (3rd Generation Partnership Standard Signal Chip Project) or 3GPP2 systems.
[0305] One embodiment can be applied not only to the various wireless access systems mentioned above, but also to all technical fields utilizing the various wireless access systems. Furthermore, the proposed method can be applied to mmWave and THz communication systems utilizing the ultra-high frequency band.
[0306] Additionally, some embodiments may be applied to various applications such as autonomous vehicles and drones.
Claims
1. Regarding the method, A step of performing an initial connection procedure by the first device; Step of transmitting capability information; A step of performing signaling for communication-related settings; A step of controlling the size of representation spaces; A step of transmitting a reference signal; A method comprising the step of generating a codebook sequence based on the distance between the above-mentioned representation spaces and the above-mentioned reference signal.
2. In Paragraph 1, The size of the above representation spaces is controlled based on the control of a ball radius parameter.
3. In Paragraph 1, The above-mentioned transmitting step is, A step of comparing the difference in distance between the above-mentioned expression spaces with a threshold value; and A method comprising the step of transmitting the above reference signal based on the comparison result.
4. In Paragraph 1, The above codebook sequence is a method generated using space-fill vector quantization.
5. In Paragraph 1, The step of generating the above codebook sequence is, A step of generating a semantic representation of the above reference signal; A method further comprising the step of controlling the size of the representation space based on the above semantic representation.
6. In Paragraph 5, The above representation space is a method in which the semantic representation of the above reference signal is located in a representation space.
7. In Paragraph 1, A method further comprising the step of performing background knowledge matching based on the above codebook sequence.
8. Regarding the method, A step of performing an initial connection procedure by a second device; Step of transmitting capability information; A step of performing signaling for communication-related settings; A step of controlling the size of the representation spaces; Step of receiving a reference signal; A method comprising the step of generating a codebook sequence based on the distance between the above-mentioned representation spaces and the above-mentioned reference signal.
9. In Paragraph 8, The size of the above representation spaces is controlled based on the control of a ball radius parameter.
10. In Paragraph 8, The above codebook sequence is a method generated using space-fill vector quantization.
11. In Paragraph 8, The step of generating the above codebook sequence is, A step of generating a semantic representation of the above reference signal; A method further comprising the step of controlling the size of the representation space based on the above semantic representation.
12. In Paragraph 11, The above representation space is a method in which the semantic representation of the above reference signal is located in a representation space.
13. In Paragraph 8, A method further comprising the step of performing background knowledge matching based on the above codebook sequence.
14. In the first device, Transmitter / receiver; and It includes a processor coupled to the above-mentioned transmitter and receiver, The above processor is, Perform the initial connection procedure, Transmit capability information, and Performs signaling for communication-related settings, Control the size of the presentation spaces, and Transmitting a reference signal, A first device configured to generate a codebook sequence based on the distance between the above-mentioned representation spaces and the above-mentioned reference signal.
15. In the second device, Transmitter / receiver; and It includes a processor connected to the above-mentioned transmitter and receiver, The above processor is, Perform the initial connection procedure, Transmit capability information, and Performs signaling for communication-related settings, Control the size of the presentation spaces, and Receive a reference signal, A second device configured to generate a codebook sequence based on the distance between the above-mentioned representation spaces and the above-mentioned reference signal.
16. In a communication device, At least one processor; It includes at least one memory connected to the at least one processor and storing instructions that cause the device to perform operations as executed by the at least one processor, and The above operations are, Step of performing the initial connection procedure; Step of transmitting capability information; A step of performing signaling for communication-related settings; A step of controlling the size of the representation spaces; A step of transmitting a reference signal; and A communication device comprising the step of generating a codebook sequence based on the distance between the above-mentioned representation spaces and the above-mentioned reference signal.
17. In a non-transitory computer-readable medium storing at least one program instruction, The above at least one program instruction causes the device to perform operations as it is executed by at least one processor, and The above operations are, Step of performing the initial connection procedure; Step of transmitting capability information; A step of performing signaling for communication-related settings; A step of controlling the size of the representation spaces; A step of transmitting a reference signal; and A computer-readable medium comprising the step of generating a codebook sequence based on the distance between the above-mentioned representation spaces and the above-mentioned reference signal.