Network control method and apparatus for data communication in electronic devices

Abstract

Various embodiments disclose a method and apparatus for controlling a network for low latency and low power data communication in a tethered AR system. An electronic device according to various embodiments can include a wireless communication circuit; and a processor. Wherein the processor can: when an augmented reality (AR) service of an external device is initiated, identify a first service period (SP) based on a data amount of a designated data path; identify a transmission interval based on a frame rate of the external device; identify whether a network connected with the electronic device satisfies a designated transmission requirement condition based on at least the first SP and the transmission interval; determine connection information related to a connection with the external device based on a network satisfying the transmission requirement condition; and perform the connection with the external device based on the connection information. Various embodiments are possible.

Description

Technical Field

[0001] Cross-references to related applications

[0002] This application is based on and claims priority to Korean Patent Application No. 10-2020-0097120, filed on August 4, 2020, with the Korean Intellectual Property Office, the disclosure of which is incorporated herein by reference in its entirety.

[0003] Various embodiments of this disclosure relate to a method and apparatus for controlling a network for data communication with external devices by an electronic device capable of establishing a communication connection with each external device. Background Technology

[0004] Recent electronic devices utilize augmented reality (AR) technology, which overlays three-dimensional virtual objects onto the real world, to provide a variety of services. Electronic devices can include various types of devices, such as mobile communication terminals, smartphones, desktop personal computers (PCs), laptops, wearable devices, and / or AR glasses (or smart glasses). According to embodiments, AR can be provided via wearable glasses devices (e.g., AR glasses), head-mounted devices (e.g., head-mounted displays (HMDs)), or smartphones, where various digital content can be overlaid onto the real world and provided through applications related to AR services. AR content can be generated by the device providing the AR service or can be received and provided from another device.

[0005] For example, recently, external devices (e.g., tethered AR glasses) that connect to electronic devices (e.g., smartphones) to display AR content are being developed, and AR services based on tethered AR systems (or environments) using external devices are being researched and developed. For instance, an electronic device (e.g., a smartphone) can connect to each of the AR glasses and / or servers between the AR glasses and a server (e.g., the cloud), and process data (e.g., images and / or information) obtained from the server (e.g., the cloud), and the tethered AR system can realize an AR environment through AR glasses based on the data processed by the electronic device. Summary of the Invention

[0006] Technical issues

[0007] Typically, low latency and / or ultra-power-saving methods should be used to provide a satisfactory AR experience to users in tethered AR systems. For example, when the image reproduced by AR glasses has a large delay, a disconnected image may be displayed to the user. Therefore, low-latency communication between individual components (e.g., the cloud, electronic devices, and / or AR glasses) is ideal in tethered AR systems. In another example, in AR glasses, since the AR glasses are worn by the user, there may be limitations on battery capacity when reducing their weight, and it is desirable to reduce current consumption (or ultra-power-saving methods may be needed) to provide AR services to the user for extended periods.

[0008] Various embodiments may disclose a method and apparatus for controlling, by electronic devices, a network in a tethered AR system for low-latency and low-power data communication with external devices (e.g., servers and AR glasses).

[0009] Various embodiments may disclose methods and apparatus for adaptively selecting or changing a network (or network bearer) based on transmission requirements between an electronic device and an external device (e.g., AR glasses).

[0010] Technical solution

[0011] An electronic device according to various embodiments of the present disclosure includes: a wireless communication circuit; and a processor operatively connected to the wireless communication circuit. The processor is configured to: identify a first service period (SP) based on the amount of data along a predetermined data path when an augmented reality (AR) service associated with an external device is initiated; identify a transmission interval based on a frame rate displayed on the external device; detect whether a network connected to the electronic device meets predetermined transmission requirements, at least based on the first SP and the transmission interval; determine connection information related to the connection with the external device based on the detection that the network meets the predetermined transmission requirements; and establish a connection with the external device based on the connection information.

[0012] An electronic device according to an embodiment of the present disclosure includes: a wireless communication circuit; and a processor. The processor is configured to: detect a connection to an external device via the wireless communication circuit; acquire data volume of a first link between the electronic device and the external device and data volume of a second link between the electronic device and a network; calculate a first service period (SP) of the first link based on the data volume of the first link, and calculate a second SP of the second link based on the data volume of the second link; determine a network that meets image transmission requirements based on the first SP and the second SP; and establish a connection with the external device by configuring the channel of the first link to be equal to the channel of the second link based on the determined network.

[0013] A method of operating an electronic device according to an embodiment of the present disclosure includes: identifying a first service period (SP) based on the amount of data in a predetermined data path when at least one processor of the electronic device initiates an augmented reality (AR) service utilizing an external device; identifying a transmission interval based on the frame rate for displaying an image on the external device; detecting whether a network connected to the electronic device meets predetermined transmission requirements based at least on the first SP and the transmission interval; determining connection information for connecting to the external device based on the network meeting the predetermined transmission requirements; and establishing a connection with the external device based on the connection information.

[0014] To address the aforementioned problems, various embodiments of this disclosure may include a computer-readable recording medium having a program that causes a processor to execute the method.

[0015] Further applications of this disclosure may become clear from the following detailed description. However, because various modifications and changes within the spirit and scope of this disclosure can be clearly understood by those skilled in the art, the specific embodiments and exemplary embodiments such as those described herein should be understood as examples only.

[0016] Technical effect

[0017] Electronic devices and methods of operation according to various embodiments can perform low-latency and / or low-power data communication with external devices (e.g., cloud servers and AR glasses) in a chained AR system. According to various embodiments, the electronic device controls service periods (SPs) to overlap when the electronic device performs communication using different frequency bands or different types of networks in the first and second time periods, and controls SPs to avoid overlap when the electronic device performs communication using the same frequency band or the same type of network in the first and second time periods. Attached Figure Description

[0018] Regarding the description of the accompanying drawings, the same or similar reference numerals may be used for the same or similar elements.

[0019] Figure 1 This is a block diagram illustrating an electronic device in a network environment according to various embodiments;

[0020] Figure 2a , Figure 2b and Figure 2c Examples of AR systems supporting AR services according to various embodiments are shown;

[0021] Figure 3a The configuration of an electronic device according to various embodiments is schematically shown;

[0022] Figure 3b The configuration of the external device according to various embodiments is schematically shown;

[0023] Figure 4 This is a flowchart illustrating the operation of an electronic device according to various embodiments;

[0024] Figure 5 This is a flowchart illustrating the operation of establishing a connection between an electronic device and an external device according to various embodiments;

[0025] Figure 6 Examples of the operation of an electronic device calculating SP according to various embodiments are shown;

[0026] Figure 7 This is a flowchart illustrating a method of operating an electronic device according to various embodiments;

[0027] Figure 8 Examples are shown where electronic devices perform scheduling based on SP and intervals according to various embodiments;

[0028] Figure 9 Examples of scheduling between links according to various embodiments are shown;

[0029] Figure 10 Examples of scheduling based on the TWT protocol according to various embodiments are shown;

[0030] Figure 11 This illustrates another example of scheduling based on the TWT protocol according to various embodiments;

[0031] Figure 12 This illustrates another example of scheduling between links according to various embodiments;

[0032] Figure 13 This is a flowchart illustrating the operation of an external device according to various embodiments;

[0033] Figure 14 This is a flowchart illustrating the operation of an electronic device according to various embodiments; and

[0034] Figure 15 This is a flowchart illustrating the operation of an electronic device according to various embodiments. Detailed Implementation

[0035] Figure 1 This is a block diagram illustrating an electronic device 101 in a network environment 100 according to various embodiments. (Refer to...) Figure 1 ,

[0036] Electronic device 101 in network environment 100 can communicate with electronic device 102 via a first network 198 (e.g., a short-range wireless communication network), or with at least one of electronic device 104 or server 108 via a second network 199 (e.g., a long-range wireless communication network). According to an embodiment, electronic device 101 can communicate with electronic device 104 via server 108. According to an embodiment, electronic device 101 may include a processor 120, memory 130, input module 150, sound output module 155, display module 160, audio module 170, sensor module 176, interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, user identification module (SIM) 196, or antenna module 197. In some embodiments, at least one of the above components (e.g., connection terminal 178) may be omitted from electronic device 101, or one or more other components may be added to electronic device 101. In some embodiments, some of the components described above (e.g., sensor module 176, camera module 180, or antenna module 197) may be implemented as a single integrated component (e.g., display module 160).

[0037] Processor 120 may run software (e.g., program 140) to control at least one other component (e.g., hardware or software component) of electronic device 101 connected to processor 120, and may perform various data processing or calculations. According to one embodiment, as at least part of the data processing or calculation, processor 120 may store commands or data received from another component (e.g., sensor module 176 or communication module 190) in volatile memory 132, process the commands or data stored in volatile memory 132, and store the result data in non-volatile memory 134. According to an embodiment, processor 120 may include a main processor 121 (e.g., central processing unit (CPU) or application processor (AP)) or an auxiliary processor 123 (e.g., graphics processing unit (GPU), neural processing unit (NPU), image signal processor (ISP), sensor central processor, or communication processor (CP)) that is operationally independent of or combined with the main processor 121. For example, when electronic device 101 includes a main processor 121 and an auxiliary processor 123, the auxiliary processor 123 may be adapted to consume less power than the main processor 121, or to be dedicated to a specific function. The auxiliary processor 123 may be implemented separately from the main processor 121, or may be implemented as part of the main processor 121.

[0038] When the main processor 121 is inactive (e.g., in sleep mode), the auxiliary processor 123 (rather than the main processor 121) can control at least some of the functions or states associated with at least one component of the electronic device 101 (e.g., display module 160, sensor module 176, or communication module 190), or when the main processor 121 is active (e.g., running an application), the auxiliary processor 123 can work with the main processor 121 to control at least some of the functions or states associated with at least one component of the electronic device 101 (e.g., display module 160, sensor module 176, or communication module 190). According to embodiments, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., camera module 180 or communication module 190) functionally associated with the auxiliary processor 123. According to embodiments, the auxiliary processor 123 (e.g., a neural processing unit) may include hardware architecture dedicated to artificial intelligence model processing. Artificial intelligence models can be generated through machine learning. For example, such learning can be performed via electronic device 101 where artificial intelligence is performed or via a separate server (e.g., server 108). The learning algorithm may include, but is not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning. The artificial intelligence model may include multiple layers of artificial neural networks. The artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), or a deep Q-network, or a combination of two or more thereof, but is not limited thereto. Additionally or optionally, the artificial intelligence model may include software structures in addition to hardware structures.

[0039] Memory 130 may store various data used by at least one component of electronic device 101 (e.g., processor 120 or sensor module 176). The various data may include, for example, software (e.g., program 140) and input or output data for commands associated with it. Memory 130 may include volatile memory 132 or non-volatile memory 134.

[0040] The program 140 may be stored as software in the memory 130, and the program 140 may include, for example, an operating system (OS) 142, middleware 144, or application 146.

[0041] The input module 150 can receive commands or data from outside the electronic device 101 (e.g., a user) that will be used by other components of the electronic device 101 (e.g., processor 120). The input module 150 may include, for example, a microphone, mouse, keyboard, keys (e.g., buttons), or digital pen (e.g., stylus).

[0042] The sound output module 155 can output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or playing records. The receiver can be used to receive incoming calls. According to an embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0043] Display module 160 can visually provide information to the outside of electronic device 101 (e.g., to a user). Display device 160 may include, for example, a display, a holographic device, or a projector, and control circuitry for controlling a respective one of the display, holographic device, and projector. According to an embodiment, display module 160 may include a touch sensor adapted to detect touch or a pressure sensor adapted to measure the intensity of the force caused by touch.

[0044] The audio module 170 can convert sound into electrical signals and vice versa. According to an embodiment, the audio module 170 can obtain sound via the input module 150, or output sound via the sound output module 155 or headphones of an external electronic device (e.g., electronic device 102) that is directly (e.g., wired) or wirelessly connected to the electronic device 101.

[0045] Sensor module 176 can detect the operating state of electronic device 101 (e.g., power or temperature) or the environmental state outside electronic device 101 (e.g., user state), and then generate an electrical signal or data value corresponding to the detected state. According to embodiments, sensor module 176 may include, for example, a gesture sensor, gyroscope sensor, atmospheric pressure sensor, magnetic sensor, accelerometer, grip sensor, proximity sensor, color sensor, infrared (IR) sensor, biometric sensor, temperature sensor, humidity sensor, or illuminance sensor.

[0046] Interface 177 may support one or more specific protocols used to enable electronic device 101 to connect directly (e.g., wired) or wirelessly to external electronic devices (e.g., electronic device 102). According to embodiments, interface 177 may include, for example, a High Definition Multimedia Interface (HDMI), a Universal Serial Bus (USB) interface, a Secure Digital Card (SD) interface, or an audio interface.

[0047] Connection end 178 may include a connector, through which electronic device 101 can be physically connected to an external electronic device (e.g., electronic device 102). According to embodiments, connection end 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0048] The tactile module 179 can convert electrical signals into mechanical stimuli (e.g., vibration or motion) or electrical stimuli that can be recognized by a user through his touch or kinesthesia. According to embodiments, the tactile module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.

[0049] Camera module 180 can capture still or moving images. According to an embodiment, camera module 180 may include one or more lenses, an image sensor, an image signal processor, or a flash.

[0050] The power management module 188 manages the power supply to the electronic device 101. According to an embodiment, the power management module 188 may be implemented as at least part of, for example, a power management integrated circuit (PMIC).

[0051] Battery 189 can power at least one component of electronic device 101. According to an embodiment, battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable rechargeable battery, or a fuel cell.

[0052] Communication module 190 can support the establishment of a direct (e.g., wired) or wireless communication channel between electronic device 101 and external electronic devices (e.g., electronic device 102, electronic device 104, or server 108), and perform communication via the established communication channel. Communication module 190 may include one or more communication processors capable of operating independently of processor 120 (e.g., application processor (AP)) and support direct (e.g., wired) or wireless communication. According to embodiments, communication module 190 may include wireless communication module 192 (e.g., cellular communication module, short-range wireless communication module, or Global Navigation Satellite System (GNSS) communication module) or wired communication module 194 (e.g., local area network (LAN) communication module or power line communication (PLC) module). One of these communication modules can communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wi-Fi Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a traditional cellular network, 5G network, next-generation communication network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules can be implemented as a single component (e.g., a single chip) or as multiple components (e.g., multiple chips) that are separate from each other. The wireless communication module 192 can identify and verify the electronic device 101 in the communication network (such as the first network 198 or the second network 199) using user information (e.g., the International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196.

[0053] Wireless communication module 192 can support 5G networks following 4G networks and next-generation communication technologies (such as new radio (NR) access technologies). NR access technologies can support enhanced mobile broadband (eMBB), massive machine-type communication (mMTC), or ultra-reliable low-latency communication (URLLC). Wireless communication module 192 can support high-frequency bands (e.g., millimeter-wave bands) to achieve, for example, high data transmission rates. Wireless communication module 192 can support various technologies used to ensure performance in high-frequency bands, such as, for example, beamforming, massive MIMO, full-dimensional MIMO (FD-MIMO), array antennas, analog beamforming, or massive antennas. Wireless communication module 192 can support various requirements specified in electronic device 101, external electronic devices (e.g., electronic device 104), or network systems (e.g., second network 199). According to an embodiment, the wireless communication module 192 may support peak data rates (e.g., 20 Gbps or greater) for implementing eMBB, lost coverage (e.g., 164 dB or less) for implementing mMTC, or U-plane latency (e.g., 0.5 ms or less for each of the downlink (DL) and uplink (UL), or 1 ms or less round trip) for implementing URLLC.

[0054] Antenna module 197 can transmit or receive signals or power to or from the exterior of electronic device 101 (e.g., external electronic device). According to an embodiment, antenna module 197 may include an antenna comprising a radiating element formed of a conductive material or conductive pattern formed in or on a substrate (e.g., a printed circuit board (PCB)). According to an embodiment, antenna module 197 may include multiple antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication scheme used in a communication network (such as a first network 198 or a second network 199) can be selected from the multiple antennas by, for example, communication module 190 (e.g., wireless communication module 192). Signals or power can then be transmitted or received between communication module 190 and the external electronic device via the selected at least one antenna. According to an embodiment, additional components besides the radiating element (e.g., a radio frequency integrated circuit (RFIC)) may be additionally incorporated into antenna module 197.

[0055] According to various embodiments, antenna module 197 may form a millimeter-wave antenna module. According to embodiments, the millimeter-wave antenna module may include a printed circuit board, a radio frequency integrated circuit (RFIC), and multiple antennas (e.g., an array antenna), wherein the RFIC is disposed on or adjacent to a first surface (e.g., a bottom surface) of the printed circuit board and is capable of supporting a specified high-frequency band (e.g., a millimeter-wave band), and the multiple antennas are disposed on or adjacent to a second surface (e.g., a top surface or a side surface) of the printed circuit board and are capable of transmitting or receiving signals in the specified high-frequency band.

[0056] At least some of the aforementioned components can be interconnected and communicate signals (e.g., commands or data) between them via an inter-peripheral communication scheme (e.g., bus, general purpose input / output (GPIO), serial peripheral interface (SPI), or mobile industrial processor interface (MIPI)).

[0057] According to an embodiment, commands or data can be sent or received between electronic device 101 and external electronic device 104 via server 108 connected to a second network 199. Each of electronic device 102 or electronic device 104 can be a device of the same type as electronic device 101, or a device of a different type. According to an embodiment, all or some operations that would be performed on electronic device 101 can be performed on one or more of external electronic devices 102, external electronic devices 104, or server 108. For example, if electronic device 101 is required to automatically perform a function or service, or is required to perform a function or service in response to a request from a user or another device, electronic device 101 may request the one or more external electronic devices to perform at least a portion of the function or service, instead of running the function or service, or electronic device 101 may request the one or more external electronic devices to perform at least a portion of the function or service in addition to running the function or service. Upon receiving the request, the one or more external electronic devices may perform at least a portion of the requested function or service, or perform additional functions or services related to the request, and transmit the result of the execution to electronic device 101. Electronic device 101 may provide the result as at least a partial response to the request, with or without further processing of the result. For this purpose, technologies such as cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing may be used. Electronic device 101 may use, for example, distributed computing or mobile edge computing to provide ultra-low latency services. In another embodiment, external electronic device 104 may include an Internet of Things (IoT) device. Server 108 may be an intelligent server using machine learning and / or neural networks. According to embodiments, external electronic device 104 or server 108 may be included in a second network 199. Electronic device 101 may be applied to intelligent services based on 5G communication technology or IoT-related technologies (e.g., smart homes, smart cities, smart cars, or healthcare).

[0058] The electronic device according to various embodiments can be one of a variety of types of electronic devices. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. According to embodiments of this disclosure, the electronic device is not limited to those described above.

[0059] It should be understood that the various embodiments of this disclosure and the terminology used therein are not intended to limit the technical features set forth herein to the specific embodiments, but rather to include various changes, equivalents, or substitutions to the respective embodiments. In the description of the drawings, similar reference numerals may be used to refer to similar or related elements. It will be understood that nouns in the singular form corresponding to terms may include one or more things unless the relevant context clearly indicates otherwise. As used herein, each of the phrases such as “A or B,” “at least one of A and B,” “at least one of A or B,” “A, B, or C,” “at least one of A, B, and C,” and “at least one of A, B, or C” may include any one or all possible combinations of the items enumerated together with the corresponding phrase among the plurality of phrases. As used herein, terms such as “first” and “second” or “first” and “second” may be used to simply distinguish the respective component from another component and do not limit the component in other respects (e.g., importance or order). It will be understood that, whether the terms “operably” or “communically” are used or not, if an element (e.g., a first element) is referred to as “combined with another element (e.g., a second element),” “combined to another element (e.g., a second element),” “connected to another element (e.g., a second element),” or “attached to another element (e.g., a second element)”, it means that the first element can be directly (e.g., wiredly) connected to the second element, wirelessly connected to the second element, or connected to the second element via a third element.

[0060] As used in connection with various embodiments of this disclosure, the term "module" may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "part," or "circuit"). A module may be a single integrated component adapted to perform one or more functions, or the smallest unit or part of such a single integrated component. For example, according to embodiments, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0061] The various embodiments set forth herein can be implemented as software (e.g., program 140) containing one or more instructions readable by a machine (e.g., electronic device 101) stored in a storage medium (e.g., internal memory 136 or external memory 138). For example, under the control of a processor, the processor (e.g., processor 120) of the machine (e.g., electronic device 101) can invoke and execute at least one of the one or more instructions stored in the storage medium, with or without the use of one or more other components. This enables the machine to operate to perform at least one function according to the invoked at least one instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. Machine-readable storage media may be provided in the form of non-transitory storage media. The term "non-transitory" means only that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but this term does not distinguish between data being stored semi-permanently in the storage medium and data being temporarily stored in the storage medium.

[0062] According to embodiments, methods according to various embodiments of this disclosure may be included and provided in a computer program product. The computer program product can be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)) or via an app store (e.g., the Play Store). TM The computer program product may be published online (e.g., downloaded or uploaded), or may be distributed directly between two user devices (e.g., smartphones) (e.g., downloaded or uploaded). If published online, at least a portion of the computer program product may be temporarily generated, or at least a portion of the computer program product may be temporarily stored in a machine-readable storage medium (such as the memory of a manufacturer's server, an app store's server, or a forwarding server).

[0063] According to various embodiments, each of the above-described components (e.g., a module or program) may include a single entity or multiple entities, and some of the multiple entities may be separately disposed in different components. According to various embodiments, one or more of the above-described components may be omitted, or one or more other components may be added. Optionally or additionally, multiple components (e.g., modules or programs) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform the one or more functions of each of the multiple components in the same or similar manner as the corresponding component of the multiple components performed one or more functions before integration. According to various embodiments, the operations performed by a module, program, or other component may be performed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations may be run in a different order or omitted, or one or more other operations may be added.

[0064] Figure 2a , Figure 2b and Figure 2c Examples of AR systems supporting AR services are shown according to various embodiments.

[0065] According to an embodiment, Figure 2a , Figure 2b and Figure 2c Electronic device 101 and external device 201 (e.g., can be shown) can be illustrated. Figure 1 Electronic device 102) and server 301 (e.g., Figure 1 An example of servers 108 communicating with each other to support augmented reality (AR) services.

[0066] like Figure 2a , Figure 2b and Figure 2c As shown, an AR system (e.g., a chained AR system) for supporting AR services according to an embodiment may include an electronic device 101 (e.g., a smartphone), an external device 201 (e.g., AR glasses, smart glasses, or a display device), a server 301 (e.g., a cloud), a first network 210 (e.g., a Wi-Fi network) including an access point (AP) 215 (e.g., a Wi-Fi AP or a Wi-Fi router), and a second network 220 (e.g., a cellular network) including a base station 225.

[0067] According to an embodiment, electronic device 101 may include, for example, reference... Figure 1The description corresponds to the elements. According to an embodiment, electronic device 101 can perform the following operations of a computing host: directly generating relevant data (e.g., AR images) for AR services (e.g., generated based on stored or processed data) or obtaining relevant data from server 301 and providing it to external device 201. For example, electronic device 101 can be an electronic device such as a smartphone, capable of processing images and performing wireless communication with server 301 via a first network 210 including AP 215 and / or a second network 220 including base station 225. According to an embodiment, electronic device 101 can obtain (e.g., receive) at least one of scene information (e.g., image data), sensor information, and / or location information from external device 201 through a communication connection with external device 201.

[0068] According to an embodiment, the external device 201 may include an electronic device capable of receiving data (e.g., AR images or AR image frames) from the electronic device 101 and providing (e.g., displaying) the received data and real-world data through the display of the external device 201. For example, the external device 201 may include wearable devices such as AR glasses and / or smart glasses or a display for supporting display functions. According to an embodiment, the external device 201 may provide (e.g., transmit) at least one of scene information, sensor information, and / or location information to the electronic device 101 through a communication connection with the electronic device 101.

[0069] According to an embodiment, electronic device 101 and external device 201 can send and receive data via wireless local area network (WLAN) communication such as Wi-Fi and / or Wi-Gig.

[0070] According to an embodiment, server 301 may include a server (or cloud) for providing AR content (e.g., a cloud server, content server, or web server).

[0071] According to an embodiment, the first network 210 may include, for example, an access point (AP) 215 (e.g., a Wi-Fi AP or a Wi-Fi router). According to an embodiment, the first network 210 may provide a first data path 230 (or a first network path) (e.g., a Wi-Fi path) between the electronic device 101 and the server 301. For example, as... Figure 2b As shown, the first data path 230 may include a path between electronic device 101, AP 215, and server 301, and electronic device 101 and server 301 may establish the first data path 230 to communicate with each other via a first network 210 including AP 215. For example, the first network 210 may provide data from server 301 to electronic device 101 via the first data path 230.

[0072] According to an embodiment, the second network 220 may include, for example, a base station 225 for a traditional network (e.g., a 3G or 4G network) and / or a 5G network. According to an embodiment, the second network 220 may provide a second data path 240 (or a second network path) (e.g., a cellular path) between the electronic device 101 and the server 301. For example, as... Figure 2c As shown, the second data path 240 may include a path between electronic device 101, base station 225, and server 301, and electronic device 101 and server 301 may establish the second data path 240 to communicate with each other via a second network 220 including base station 225. For example, the second network 220 may provide data from server 301 to electronic device 101 via the second data path 240.

[0073] According to an embodiment, electronic device 101 can send data to and receive data from server 301 via a first network 210 or a second network 220. According to an embodiment, the data sent by electronic device 101 to server 301 may be scene information, sensor information, and / or location information received by electronic device 101 from external device 201, or may include data generated (e.g., processed) based on such information. According to an embodiment, the data received by electronic device 101 from server 301 may include, for example, information (or elements) included in data (e.g., AR images or AR image frames) provided by electronic device 101 to external device 201 (e.g., graphic object information, coordinate information, distance information, and / or text information). In another example, the data received by electronic device 101 from server 301 may include response data to the data sent by electronic device 101 based on data received from external device 201. According to an embodiment, the sending and receiving of data (e.g., sending data and / or receiving data) may vary depending on the AR service or AR application. For example, the sending and receiving of data can vary depending on the conditions required by the AR service or AR application (e.g., resolution or speed).

[0074] According to various embodiments, AR services can be provided based on system configuration, such as Figure 2a , Figure 2b and Figure 2c As shown in the image.

[0075] According to an embodiment, when providing AR services, electronic device 101 can determine a data transmission period (or data transmission time) (e.g., service period (SP)) based on the data volume (or traffic volume) of each link according to the data path (or network path) (e.g., first data path 230 or second data path 240). According to an embodiment, referring to the following figures (e.g., Figure 6To describe in detail the operation of determining SP.

[0076] According to an embodiment, electronic device 101 can determine the image frame transmission period (interval) based on the frame rate (or refresh rate) or scan rate (e.g., 30fps, 60fps, or 12fps) of external device 201. For example, electronic device 101 can determine a first image frame transmission interval (e.g., approximately 33.3ms) for a first frame rate (e.g., approximately 30fps) (e.g., frame rate = 30fps → interval = 33.3ms). In another example, electronic device 101 can determine a second image frame transmission interval (e.g., approximately 16.6ms) for a second frame rate (e.g., approximately 60fps) (e.g., frame rate = 60fps → interval = 16.6ms). In yet another example, electronic device 101 can determine a third image frame transmission interval (e.g., approximately 8.3ms) for a third frame rate (e.g., approximately 120fps) (e.g., frame rate = 120fps → interval = 8.3ms).

[0077] According to an embodiment, electronic device 101 can determine whether the network currently connected to electronic device 101 (e.g., first network 210 or second network 220) meets predetermined transmission requirements (or AR image transmission requirements) based on at least one of SP and / or image frame transmission interval. For example, predetermined transmission requirements may include at least some of the frame rate, resolution, transmission rate, and / or data transmission amount required by the network connected in the AR service or AR application (e.g., first network 210 or second network 220). According to an embodiment, electronic device 101 can determine whether to change the network based on the determination result. According to an embodiment, electronic device 101 can determine whether to change the connection from the first network 210 including AP 215 to the second network 220 including base station 225 or from the second network 220 to the first network 210. According to an embodiment, the network currently connected between electronic device 101 and server 301 (e.g., first network 210 or second network 220) can be a communication connection between electronic device 101 and server 301 via an AP 215 supporting the first network 210 or via a base station 225 supporting the second network 220. For example, electronic device 101 can determine whether to change from the currently connected network (e.g., first network 210 or second network 220) to another network, such as whether to change the network bearer (e.g., first data path 230 or second data path 240). According to an embodiment, the operation of determining whether to change the network is described in detail with reference to the following drawings.

[0078] According to an embodiment, electronic device 101 can identify whether the type of network between electronic device 101 and server 301 is the same as the type of network between electronic device 101 and external device 201, and determine whether SPs overlap. According to an embodiment, the operation of determining whether SPs overlap is described in detail with reference to the following drawings.

[0079] Figure 3a The configuration of an electronic device according to various embodiments is illustrated schematically.

[0080] Figure 3a Examples of configurations related to electronic device 101 supporting AR services according to various embodiments are shown. According to embodiments, electronic device 101 may include various types of devices including the functions of: establishing a wireless connection with external device 201 via a predetermined first network (e.g., first network 210 (e.g., a Wi-Fi network)), establishing a wireless connection with server 301 via a predetermined second network (e.g., first network 210 or second network 220 (e.g., a cellular network)), and providing data related to AR services to external device 201. For example, electronic device 101 may include a computing host such as a mobile communication terminal, a smartphone, a desktop personal computer (PC), and / or a laptop.

[0081] refer to Figure 3a The electronic device 101 according to the embodiment may include a wireless communication circuit 310, a memory 130, and a processor 120.

[0082] According to an embodiment, the wireless communication circuit 310 (e.g., Figure 1 The wireless communication module 192 can support traditional networks (e.g., 3G and / or 4G networks), 5G networks, out-of-band (OOB) and / or next-generation communication technologies (e.g., new radio (NR) technologies). The wireless communication circuit 310 can be used with, for example... Figure 1Corresponding to the wireless communication module 192 shown. The wireless communication circuit 310 according to an embodiment may include: a first communication circuit 310A configured to support wireless communication of electronic device 101 via a first network 210 (e.g., a Wi-Fi network), a second communication circuit 310B configured to support wireless communication of electronic device 101 via a second network 220 (e.g., a cellular network), and a third communication circuit 310C configured to support wireless communication of electronic device 101 based on OOB (e.g., NFC, BLE, and / or Wi-Fi 2.4GHz). According to an embodiment, electronic device 101 can use the first communication circuit 310A to communicate with external device 201 and / or server 301 via the first network 210. According to an embodiment, electronic device 101 can use the second communication circuit 310B to communicate with server 301 via the second network 210. According to an embodiment, electronic device 101 can use a third communication circuit 310C to communicate with external device 201 through a network different from the first network 210 (e.g., a short-range communication network such as Bluetooth, WiFi passthrough, or Infrared Data Association).

[0083] According to an embodiment, the memory 130 can be connected to a reference. Figure 1 Corresponding to the described memory 130, according to an embodiment, when providing AR services, memory 130 may store various data used by electronic device 101. The data may include, for example, software (e.g., program 140) and input or output data for commands associated with it. According to an embodiment, when executed, memory 130 may store instructions that cause processor 120 to operate.

[0084] According to an embodiment, the processor 120 can be connected to a reference... Figure 1 Corresponding to the described processor 120. According to an embodiment, processor 120 can control an external device 201 connected to electronic device 101 and perform various data processing or calculations related to AR services by executing, for example, an application (e.g., an AR application). According to an embodiment, as at least part of the data processing or calculation, processor 120 can store data received via wireless communication circuit 310 in memory 130, process the data stored in memory 130, store the resulting data in memory 130, and / or transmit it to external device 201 via wireless communication circuit 310.

[0085] According to an embodiment, processor 120 can send and receive required data from server 301 via wireless communication circuit 310 in a chained AR system, receive at least one piece of information (e.g., scene information, sensor information, location information, and / or frame rate) related to components (e.g., cameras, sensors, and / or displays) installed on external device 201, and send processed data (e.g., AR images) to external device 201 based on the received information. According to an embodiment, when sending and receiving data to and from external device 201 in the AR system, processor 120 can control (or select) the network for low-latency and / or low-power communication.

[0086] According to an embodiment, the processor 120 can control the transmission of data to and reception of data from the server 301 via a first communication circuit 310A supporting a first network 210 or a second communication circuit 310B supporting a second network 220. According to an embodiment, the processor 120 can configure the transmitted data based on scene information, sensor information, location information, and / or frame rate information received from the external device 201. According to an embodiment, the transmitted data may include, for example, elements for configuring AR images (or AR image frames).

[0087] According to an embodiment, processor 120 may include an SP calculation module 320 and a condition determination module 330, configured to perform operations related to network control in data communication with each of server 301 and external device 201 for AR services, for low latency and / or low power communication. According to an embodiment, the elements included in processor 120 (e.g., SP calculation module 320 and condition determination module 330) can be understood as, for example, hardware modules (e.g., circuitry), but various embodiments are not limited thereto. For example, additionally or alternatively, the elements included in processor 120 (e.g., SP calculation module 320 and condition determination module 330) may include both software and hardware structures. According to an embodiment, the elements included in processor 120 (e.g., SP calculation module 320 and condition determination module 330) may be implemented as software (e.g., ...) including one or more instructions stored in a storage medium (e.g., memory 130) that can be read by processor 120. Figure 1 (Program 140). According to an embodiment, the operations performed by the SP calculation module 320 and the condition determination module 330 can be stored in the memory 130 and executed by the instructions executed by the processor 120 when executing instructions.

[0088] According to embodiments, the SP calculation module 320 can perform operations to determine the SP based on, for example, the amount of data, and to determine the image frame transmission interval based on the frame rate of the external device 201. According to embodiments, the processor 120 can calculate the required transmission amount (e.g., the amount of data per frame) based on each link in the communication between the external device 201 and the server 301 via the first network 210, and determine the SP and image frame transmission interval accordingly. According to various embodiments, the processor 120 may include... Figure 1 The main processor 121 (e.g., a central processing unit (CPU) or application processor (AP)) or auxiliary processor 123 (e.g., a communication processor (CP)). According to embodiments, some of the SP calculation module 320 and / or condition determination module 330 may be included in the wireless communication circuit 310.

[0089] According to an embodiment, the condition determination module 330 can perform an operation to determine whether the current network (or data path) connected to the electronic device 101 meets predetermined transmission requirements (or AR image transmission requirements) based on the determined SP and the determined image frame transmission interval. According to an embodiment, the predetermined transmission requirements may include at least some of the frame rate, resolution, transmission rate, and / or data transmission amount required by the network (e.g., the first network 210 or the second network 220) connected in the AR service or AR application.

[0090] According to an embodiment, processor 120 can determine whether to change the current network based on whether transmission requirements are met. For example, when communication based on the current network does not meet transmission requirements, processor 120 can determine to change the network. In another example, when communication based on the current network meets transmission requirements, processor 120 can determine not to change the network.

[0091] According to an embodiment, when the network is a first network 210 including AP 215 (e.g., a Wi-Fi network), the processor 120 can identify at least one of the following information: the channel of the first network 210 (e.g., a Wi-Fi channel), bandwidth, and / or link speed. According to an embodiment, when the first network 210 (e.g., based on the communication state of AP 215) meets image transmission requirements based on at least one of the following information, the processor 120 can control the wireless communication circuit 310 (e.g., the first communication circuit 310A) to establish a communication (e.g., Wi-Fi) connection with the external device 201 through the same channel connected to the first network 210 (e.g., AP 215). For example, the processor 120 can identify the channel (e.g., Wi-Fi channel), bandwidth, and / or link speed of the external device 201 through a third communication circuit 310 that supports out-of-band (OOB) communication (e.g., NFC, BLE, and / or Wi-Fi 2.4 GHz), and determine whether communication between the electronic device 101 and the external device 201, as well as communication between the electronic device 101 and the AP 215 via the first network 210, are supported.

[0092] According to another embodiment, when the first network 210 (e.g., based on the communication state of AP 215) does not meet the image transmission requirements based on at least one piece of information, the processor 120 can control the wireless communication circuit 310 (e.g., the first communication circuit 310A) to search for another AP that can establish another connection (or roam) for communication through the first network 210. According to the embodiment, when performing the operation of searching for another AP, the processor 120 can first search for another AP in a bandwidth of 160MHz in, for example, a frequency band of approximately 6GHz, and when the found AP meets the image transmission requirements, establish a connection with the found AP.

[0093] According to some embodiments, when no AP meets the image transmission requirements, the processor 120 may perform an operation to switch to a second network 220 (e.g., a cellular network) (or change the data path).

[0094] According to an embodiment, the processor 120 may make the network between the server 301 and the electronic device 101 the same as or different from the network between the electronic device 101 and the external device 201 based on control of the network.

[0095] According to an embodiment, when electronic device 101 is connected to server 301 via a second network 220 including base station 225, for the connection between electronic device 101 and external device 201, processor 120 can select a channel (e.g., channel 3) in approximately 6 GHz of a frequency band (e.g., multiple channels in a 160 MHz frequency band) among multiple channels (e.g., channels 1-5) supporting the first network 210 to calculate channel congestion. According to an embodiment, processor 120 can connect electronic device 101 to external device 201 based on the channel selected from the multiple channels supporting the first network 210, negotiate SP and image frame transmission interval (hereinafter referred to as "interval") between electronic device 101 and external device 201, and determine the SP and interval for communication with server 301 via the second network 220 based on the negotiation result.

[0096] According to some embodiments, the processor 120 may search for access points (APs) on the first network 210 that meet the transmission requirements of the external device 201 when communicating with the server 301 via the second network 220. According to an embodiment, when an AP that meets the transmission requirements of the external device 201 is found, the processor 120 may establish a connection (or roam) with the corresponding AP.

[0097] According to an embodiment, the processor 120 can determine whether SPs overlap based on whether the network type between the electronic device 101 and the server 301 in a first time period is the same as the network type between the same electronic device 101 and the external device 201 in a second time period, and control the network based on the determination result. According to an embodiment, the operation of determining whether SPs overlap is described in detail with reference to the following drawings.

[0098] Figure 3b The configuration of the external device according to various embodiments is schematically shown.

[0099] According to an embodiment, Figure 3b Examples of configurations related to external device 201 supporting AR services are shown according to various embodiments. According to embodiments, Figure 3b The external device 201 shown may include a reference Figure 1 All or at least some of the elements of the described electronic device 101. According to an embodiment, Figure 3b An example of an external device 201 being an AR device (e.g., AR glasses, smart glasses, or a display device) is shown.

[0100] refer to Figure 3b External device 201 may include processor 380 (e.g., Figure 1 The processor 120), and the display module 340 (e.g., Figure 1The display module 160), sensor module 345 (e.g., Figure 1 Sensor module 176), glasses 350, battery 355 (e.g., Figure 1 Battery 189), camera module 360 ​​(e.g., Figure 1 Camera module 180), communication module 365 (e.g., Figure 1 The communication module 190), and the memory 370 (e.g., Figure 1 The memory 130), and the audio module 375 (e.g., Figure 1 (Audio module 170).

[0101] According to an embodiment, the elements included in the external device 201 can be understood as, for example, hardware modules (e.g., circuits). According to an embodiment, the elements included in the external device 201 are not limited to... Figure 3b The components shown (e.g., display module 340, sensor module 345, glasses 350, battery 355, camera module 360, communication module 365, memory 370, and / or audio module 375). For example, Figure 3b The components shown may be omitted or replaced with other components, or additional components may be added to the external device 201. For example, when the external device 201 is AR glasses and / or smart glasses, it may include glasses 350, and when the external device 201 is a smartphone, glasses 350 may not be included.

[0102] According to an embodiment, the communication module 365 may include an antenna module (e.g., Figure 1 The antenna module 197 can support various techniques (e.g., beamforming, multiple input and output (MIMO), and / or array antennas) to ensure performance in a predetermined frequency band. According to embodiments, the communication module 365 can transmit or receive signals or power to or from an external source (e.g., electronic device 101). According to embodiments, the communication module 365 may include: communication circuitry configured to support wireless communication of the external device 201 via a first network 210; and / or communication circuitry configured to support wireless communication of the external device 201 based on an OOB (Out-of-Band) architecture.

[0103] According to an embodiment, the memory 370 can be connected to a reference. Figure 1 Corresponding to the described memory 130, according to an embodiment, when the external device 201 provides AR services, the memory 370 may store various data used by the external device 201. The data may include, for example, software (e.g., program 140) and input or output data for commands associated with it.

[0104] According to an embodiment, the processor 380 can be connected to a reference... Figure 1Corresponding to the described processor 120. According to an embodiment, processor 380 can execute, for example, an application (e.g., an AR application) and provide (e.g., send) at least one of the following information such as scene information, sensor information, and / or location information to electronic device 101 via a communication connection with electronic device 101. According to an embodiment, processor 380 can control display module 340 to display an image (e.g., an AR screen) by overlaying various digital contents (e.g., AR images) onto the real world provided by display module 340. According to an embodiment, external device 201 may include various sensors (e.g., sensor module 345 or camera module 360), and processor 380 may use at least one sensor to acquire at least one of the following information such as scene information (e.g., image data), sensor information, and / or location information based on sensing information.

[0105] According to an embodiment, processor 120 can perform various data processing or calculations related to AR services. For example, as at least part of the data processing or calculations, processor 380 can store data received via communication module 365 in memory 370, process the data stored in memory 370, and store the result data in memory 370 and / or transmit it to electronic device 101 via communication module 365.

[0106] According to an embodiment, when performing AR services, the processor 380 can control the communication module 365 to send frame rate information of the external device 201 to the electronic device 101. According to an embodiment, the processor 120 can negotiate the target wake-up time (TWT) when establishing a connection with the electronic device 101. According to an embodiment, the processor 380 can send data to and receive data from the electronic device 101 based on the TWT setting, and display the sent and received data through the display module 340.

[0107] Electronic device 101 according to various embodiments of the present disclosure may include wireless communication circuitry 310 (e.g., Figure 1 The wireless communication module 192) and the processor 120 operatively connected to the wireless communication circuit 310, wherein the processor 120 can be configured to identify a first service period (SP) based on the amount of data in a predetermined data path when the augmented reality (AR) service of the external device 201 is activated, identify a transmission interval based on the frame rate of the external device 201, identify whether the network connected to the electronic device 101 meets predetermined transmission requirements based on at least the first SP and the transmission interval, determine connection information related to the connection with the external device 201 based on the network that meets the transmission requirements, and establish a connection with the external device 201 based on the connection information.

[0108] According to various embodiments of the present disclosure, processor 120 may be configured to configure a first TWT associated with the first link based on the target wake-up time (TWT) element of the first link between electronic device 101 and external device 201, and to configure a second TWT associated with the second link between electronic device and network based on at least the first TWT and TWT elements of the first link, wherein the TWT element includes TWT wake-up interval, TWT wake-up duration and TWT.

[0109] According to various embodiments of this disclosure, processor 120 may be configured to calculate a first SP based on the data volume of a first link, calculate a second SP based on the data volume of a second link, and determine that the network meets transmission requirements when the sum of the first SP and the second SP is included in a transmission interval according to the frame rate.

[0110] According to various embodiments of this disclosure, the first SP includes the required time calculated by dividing the amount of data required to transmit a frame in a first link between electronic device 101 and external device 201 by the link bandwidth of the first link.

[0111] According to various embodiments of this disclosure, the second SP includes the required time calculated by dividing the amount of data required to transmit a frame in a second link between the electronic device 101 and the network by the link bandwidth of the second link.

[0112] According to various embodiments of this disclosure, processor 120 can be configured to determine whether to change the network based on whether the network meets transmission requirements.

[0113] According to various embodiments of the present disclosure, the processor 120 may be configured to search for another AP supporting the first network 210 when the network is an access point (AP) 215 supported by the first network 210 and the AP 215 does not meet the transmission requirements, and when searching for another AP, it may preferably search for APs in a predetermined frequency band.

[0114] According to various embodiments of this disclosure, when a search for another AP that meets the transmission requirements fails, the processor 120 can be configured to change the network from the first network 210 to the second network 220.

[0115] According to various embodiments of this disclosure, processor 120 may be configured to determine a network that meets transmission requirements, determine connection information related to the connection with external device 201 based on the determined network, and send the determined connection information to external device 201 via out-of-band (OOB) communication.

[0116] According to various embodiments of the present disclosure, processor 120 may be configured to determine that the channel through which electronic device 101 is connected to the network is the channel between electronic device 101 and external device 201.

[0117] According to various embodiments of the present disclosure, processor 120 may be configured to determine that a first channel, which is equal to a channel configured using the network, is connection information when the determined network is a first network 210, and to determine that a second channel, which is different from the first channel, is connection information when the determined network is a second network 220.

[0118] According to various embodiments of this disclosure, processor 120 may be configured to determine connection information based on the channel busy level of the first network 210 when the network is the first network 210.

[0119] According to various embodiments of the present disclosure, the processor 120 may be configured to preferably measure the channel busyness based on channels in a predetermined frequency band in the first network 210, and determine, based on the measurement results, that a channel with a low channel busyness is a channel for connection to the external device 201.

[0120] According to various embodiments of the present disclosure, processor 120 may be configured to determine whether SPs overlap based on whether the network type of the first link between electronic device 101 and external device 201 is equal to the network type of the second link between electronic device 101 and the network.

[0121] According to various embodiments of the present disclosure, the processor 120 can be configured to control the first SP and the second SP to not overlap when the network types of the first link and the second link are equal, and to control the first SP and the second SP to at least partially overlap when the network types of the first link and the second link are different.

[0122] Electronic device 101 according to various embodiments of the present disclosure may include wireless communication circuitry 310 (e.g., Figure 1 The wireless communication module 192) and processor 120 are configured to detect a connection with an external device 201 via a wireless communication circuit 310, acquire the data volume of a first link between the electronic device 101 and the external device 201 and the data volume of a second link between the electronic device 101 and the network, calculate a first service period (SP) of the first link based on the data volume of the first link, calculate a second SP of the second link based on the data volume of the second link, determine a network that meets the image transmission requirements based on the first SP and the second SP, and connect to the external device 201 by configuring the channel of the first link to be equal to the channel of the second link based on the determined network.

[0123] Hereinafter, methods of operating electronic device 101 according to various embodiments are described. According to embodiments, the operations performed by electronic device 101 as described below can be performed by processor 120 of electronic device 101, which includes at least one processing circuit. According to embodiments, the operations performed by electronic device 101 can be stored in memory 130 and can be executed by instructions executed by processor 120 when executing instructions.

[0124] Figure 4 This is a flowchart illustrating the operation of an electronic device according to various embodiments.

[0125] refer to Figure 4 In operation 401, the processor 120 of the electronic device 101 can detect the launch of the AR service. According to an embodiment, the processor 120 can detect the launch of the AR service based on the execution of an AR service-related application (e.g., an AR application) in the electronic device 101 and / or the detection of a request for connection to the external device 201.

[0126] In operation 403, processor 120 may determine (or calculate) the SP based on the data volume of a predetermined data path (e.g., a first data path 230 or a second data path 240) in response to detecting the initiation of the AR service. According to an embodiment, processor 120 may determine the SP based on the data volume (or traffic) of each link. For example, processor 120 may determine the SP based on the data volume associated with the first link between electronic device 101 and external device 201, the data volume associated with the second link between electronic device 101 and a network (e.g., a first network 210 or a second network 220), and / or the bandwidth of each link. The operation of determining the SP according to an embodiment is described in detail below with reference to the accompanying drawings.

[0127] In operation 405, processor 120 can identify the image frame transmission interval based on the frame rate (or refresh rate or scan rate) of external device 201. According to one embodiment, when external device 201 provides a first frame rate (e.g., approximately 30 fps), processor 120 can determine a first image frame transmission interval (e.g., approximately 33.3 ms) based on the first frame rate (e.g., frame rate = 30 fps → interval = 33.3 ms). According to another embodiment, when external device 201 provides a second frame rate (e.g., approximately 60 fps), processor 120 can determine a second image frame transmission interval (e.g., approximately 16.6 ms) based on the second frame rate (e.g., frame rate = 60 fps → interval = 16.6 ms). According to another embodiment, when external device 201 provides a third frame rate (e.g., approximately 120 fps), processor 120 can determine a third image frame transmission interval (e.g., approximately 8.3 ms) based on the third frame rate (e.g., frame rate = 120 fps → interval = 8.3 ms). According to an embodiment, operations 403 and 405 are not limited to the order shown, and may be performed sequentially, in parallel, or in reverse order. According to an embodiment, processor 120 may receive information about the frame rate of external device 201 via out-of-band (OOB) communication, or identify information about the frame rate of external device 201 related to AR services based on connection history.

[0128] In operation 407, processor 120 may determine the transmission requirement (e.g., AR image transmission requirement) based on at least one of SP and / or image frame transmission interval. According to an embodiment, processor 120 may determine whether the network currently connected to both electronic device 101 and server 301 (e.g., first network 210 or second network 220) meets the AR image transmission requirement based on at least one of SP and / or image frame transmission interval. For example, the network currently connected between electronic device 101 and server 301 may be a communication connection between electronic device 101 and server 301 via AP 215 supporting first network 210 or a communication connection between electronic device 101 and server 301 via base station 225 supporting second network 220.

[0129] In operation 409, processor 120 may determine connection information (e.g., channel information) related to the connection with external device 201 (or for AR services with external device 201). According to an embodiment, processor 120 may determine whether to change the network between electronic device 101 and server 301 based on the result of determining transmission requirements. According to an embodiment, the operation of determining whether to change the network is described in detail with reference to the following figures. According to an embodiment, processor 120 may determine the relevant connection information based on the determined network (e.g., first network 210 or second network 220). For example, processor 120 may determine the channel between external device 201 and electronic device 101 based on the channel connected between the determined network and electronic device 101. According to an embodiment, processor 120 may transmit the connection information (e.g., channel information) related to the determined channel to external device 201 via OOB (e.g., BLE).

[0130] In operation 411, processor 120 can establish a connection with external device 201. According to an embodiment, processor 120 can configure the communication connection with external device 201 differently based on a determined network. For example, processor 120 can perform low-latency or low-power communication by controlling SP to overlap when communicating using different frequency bands or different types of networks during a first time period between electronic device 101 and server 301 and a second time period between electronic device 101 and external device 201 (e.g., communicating via second network 220 in the second data path 240), and by controlling SP to avoid overlap when communicating using the same frequency band or the same network during the first and second segments (e.g., communicating via first network 210 in the second data path 240). The operation of establishing a connection between electronic device 101 and external device 201 according to an embodiment is described in detail below with reference to the accompanying drawings.

[0131] Figure 5 This is a flowchart illustrating the operation of establishing a connection between an electronic device and an external device according to various embodiments.

[0132] According to an embodiment, Figure 5 An example is shown of electronic device 101 performing network selection and network control operations. For example, Figure 5 An example is shown of the operation of electronic device 101 determining whether to change the network and performing the connection between electronic device 101 and external device 201 based on the determination indicating whether the network has been changed.

[0133] refer to Figure 5In operation 501, the processor 120 of the electronic device 101 can detect the external device 201. According to an embodiment, the processor 120 can detect the connectable external device 201 via out-of-band (OOB) communication. According to an embodiment, OOB can use various communication schemes, such as NFC, BLE, and / or Wi-Fi 2.4GHz communication. According to an embodiment, the processor 120 can detect the external device 201 via BLE as OOB and establish a connection with the external device 201 via a specific channel using a Wi-Fi passthrough protocol. For example, the external device 201 can periodically broadcast BLE announcement messages. The external device 201 can include information indicating that the external device 201 is a device for AR services via the BLE announcement message. The electronic device 101 can perform periodic BLE scanning and, upon receiving a BLE announcement message from the external device 201, perform an operation to determine a channel (e.g., a WLAN channel) to establish a connection with the external device 201. According to an embodiment, when determining a channel for establishing a wireless (e.g., WLAN) connection between electronic device 101 and external device 201, the processor 120 can determine the channel for establishing the wireless (e.g., WLAN) connection between electronic device 101 and external device 201 using different methods, depending on whether the network is a first network 210 (e.g., a Wi-Fi network) or a second network 220 (e.g., a cellular network). The method for determining the channel according to an embodiment is described below.

[0134] In operation 503, processor 120 can identify, via OOB, a network (e.g., first network 210 or second network 220) to be connected to electronic device 101 based on the detection of an externally accessible device 201. According to embodiments, the network can indicate a path supporting data transmission and reception between electronic device 101 and server 301. For example, network identification can mean whether communication with server 301 is performed via a Wi-Fi AP supporting first network 210 (e.g., AP 215 of FIG. 2) and whether communication with server 301 is performed via a base station supporting second network 220 (e.g., base station 225 of FIG. 2).

[0135] In operation 505, the processor 120 can identify whether the network currently connected to the electronic device 101 corresponds to the first network 210 based on the result of the network identification.

[0136] When it is identified that the network is a first network 210 including an AP (e.g., AP 215 of FIG. 2) (e.g., "Yes" in operation 505), in operation 507, the processor 120 can identify first information related to the first network 210 connected to the electronic device 101. For example, when the network is the first network 210, the processor 120 can identify information such as the Wi-Fi channel, bandwidth, and / or link speed of the AP of the first network 210.

[0137] In operation 509, processor 120 can determine whether the first network 210 (and / or AP-based communication status) meets the image transmission requirements of external device 201 based on the identified first information. According to an embodiment, processor 120 can determine whether the image transmission requirements are met throughout the AR system. According to an embodiment, processor 120 can determine whether the image transmission requirements are met based on the time occupied by the first SP and the second SP, and the interval according to the frame rate. According to an embodiment, the first SP can indicate the time required to transmit one frame by electronic device 101 and external device 201 (e.g., uplink (UL) / downlink (DL) data) divided by the link bandwidth (e.g., the first network 210). According to an embodiment, the second SP can indicate the time required to transmit one frame by electronic device 101 and server 301 (e.g., UL / DL data) divided by the link bandwidth (e.g., the link bandwidth of the second network 220). The following describes the operation of identifying whether the image transmission requirements are met according to an embodiment.

[0138] When the first network 210 meets the image transmission requirements (e.g., "Yes" in operation 509), in operation 511, the processor 120 can send connection information (e.g., channel information) to the external device 201. According to an embodiment, when the sum of the calculated first SP and second SP is included in a predetermined interval (e.g., when the sum of the first SP and second SP is less than the interval based on the frame rate of the external device 201), the processor 120 can determine that the corresponding network (e.g., the AP of the first network 210) meets the image transmission requirements. According to an embodiment, when the image transmission requirements are met, the processor 120 can determine that the channel connecting the AP of the first network and the electronic device 101 is the channel between the external device 201 and the electronic device 101. According to an embodiment, the processor 120 can transmit channel information related to the determined channel to the external device 201 based on OOB (e.g., BLE).

[0139] In operation 513, processor 120 can establish a wireless connection (e.g., WLAN connection) with external device 201 based on the determined channel.

[0140] In operation 515, processor 120 can negotiate a link (e.g., a first link between electronic device 101 and external device 201, or a second link between electronic device 101 and the AP supporting the first network 210) with each of these. According to an embodiment, processor 120 can perform negotiation by configuring SP duration, SP start time, and / or SP interval for each link (e.g., the first link between electronic device 101 and external device 201, or the second link between electronic device 101 and the AP) based on the first network 210. The following describes the operation of negotiating SP and interval for each link according to an embodiment.

[0141] When the network is the first network 210 and the first network 210 does not meet the image transmission requirements of the external device 201 (e.g., "No" in operation 509), in operation 521, the processor 120 may search for another AP on the first network 210. According to an embodiment, when it is determined that the current connection between the electronic device 101 and the AP on the first network 210 does not meet the image transmission requirements between the electronic device 101 and the external device 201, the processor 120 may perform an operation to search for another AP that supports the first network 210 and can be connected to (or roam). According to an embodiment, when performing the operation to search for another AP that can be connected, the processor 120 may preferably search for another AP with a bandwidth of approximately 160 MHz in an approximately 6 GHz band supporting WLAN. In AR systems, latency performance may be important, and, for example, the approximately 6 GHz band may also be immune to interference from wide bandwidths (e.g., approximately 160 MHz). Therefore, the processor 120 may operate to first search for WLAN in the approximately 6 GHz band.

[0142] In operation 523, processor 120 can identify whether another AP that meets the image transmission requirements has been found based on the search results for another AP.

[0143] When another AP that meets the image transmission requirements is found (e.g., "Yes" in operation 523), processor 120 can proceed to operation 525 and execute the operations following operation 525. When no other AP that meets the image transmission requirements is found (e.g., "No" in operation 523), for example, when the search for an AP that meets the image transmission requirements fails, processor 120 can proceed to operation 531 and execute the operations following operation 531.

[0144] In operation 525, processor 120 may perform operations for establishing a connection with another found AP. According to an embodiment, when another AP that meets the image transmission requirements is found, processor 120 may establish a connection with the other AP, proceed to operation 513, and perform operations for establishing a connection with external device 201 through the same channel as the channel connected to the other AP, as well as scheduling intervals or SPs.

[0145] When the network is not the first network 210 in operation 505 (e.g., "No" in operation 505) or when no other AP that meets the image transmission requirements is found in operation 523 (e.g., "No" in operation 523), the processor 120 may continue to operation 531.

[0146] In operation 531, processor 120 can identify whether the network currently connected to electronic device 101 corresponds to a second network 220 that includes a base station (e.g., base station 225 in FIG. 2). For example, when there is no connection to the first network 210 or when no AP that meets the image transmission requirements is found, processor 120 can identify whether the network corresponds to the second network 220.

[0147] When no network is currently connected to electronic device 101 (e.g., "No" in operation 531), in operation 541, processor 120 may provide network-related status information to external device 201. According to an embodiment, external device 201 may display the current status in display module 340 based on the status information received from electronic device 101. According to an embodiment, when there is no connection between the first network 210 and the second network 220, processor 120 may transmit information indicating the absence of a network connection between electronic device 101 and external device 201 via OOB to external device 201 and notify the user of the absence of a network connection based on each user interface of electronic device 101 and / or external device 201 (e.g., display on a monitor or provide an alarm sound).

[0148] When, based on the result of network identification, the network connected to electronic device 101 is identified as a second network 220 including a base station (e.g., base station 225 of FIG. 2) (e.g., "Yes" in operation 531), in operation 533, processor 120 can identify second information related to the second network 220 connected to electronic device 101. For example, when the network is the second network 220, processor 120 can perform the operation of identifying second information regarding the WLAN channel used to establish a connection between electronic device 101 and external device 201. For example, the second information may include the channel busy level of at least one of a plurality of channels of the first network 210. For example, processor 120 can measure the channel busy level of a plurality of channels supporting the first network 210 in a bandwidth of approximately 160 MHz in an approximately 6 GHz frequency band. According to an embodiment, processor 120 can perform the operation of measuring the channel busy level. For example, the channel busy level can be calculated as the ratio of the time that wireless packets from other electronic devices occupy the wireless channel to a predetermined time.

[0149] In operation 535, processor 120 may send connection information (e.g., channel information) to external device 201. According to an embodiment, processor 120 may select a channel with the lowest "busyness" based on measured channel busyness and determine that the selected channel has connection information (e.g., channel information) related to the first network 210 between external device 201 and electronic device 101. According to an embodiment, processor 120 may transmit the channel information related to the determined channel to external device 201 based on OOB (e.g., BLE).

[0150] In operation 537, processor 120 can establish a wireless connection (e.g., WLAN connection) with external device 201 based on the determined channel.

[0151] In operation 539, processor 120 may negotiate links with external device 201 (e.g., a first link between electronic device 101 and external device 201). According to an embodiment, processor 120 may perform negotiation by configuring the SP duration, SP start time and / or SP interval for each link (e.g., the first link between electronic device 101 and external device 201 and the second link between electronic device 101 and the second network 220).

[0152] Figure 6 Examples of the operation of an electronic device calculating SP according to various embodiments are shown.

[0153] According to an embodiment, Figure 6An example is shown of a first SP relating to a first link 610 between electronic device 101 and external device 201, and a second SP relating to a second link 620 between electronic device 101 and first network 210 (e.g., AP 215).

[0154] refer to Figure 6 It can be assumed that the amount of data per frame for each link (e.g., first link 610 and second link 620) is predetermined. For example, the amount of data per frame required for each link can be determined based on the AR application or AR service executed in electronic device 101 and / or external device 201. For example, the amount of data per frame (or transmission requirements) required for each link can vary depending on the conditions required by the AR application or AR service (e.g., resolution or speed). According to an embodiment, a first data amount between electronic device 101 and external device 201 (e.g., first link 610) can indicate the amount of data per frame (e.g., the number of data bits) (e.g., bits / frame) required for the downlink (DL) 611 (e.g., DL path) for electronic device 101 to transmit data to external device 201. A second data amount between electronic device 101 and external device 201 (e.g., first link 610) can indicate the amount of data per frame required for the uplink 613 (e.g., UL path) for external device 201 to transmit data to electronic device 101. According to an embodiment, a third data volume (e.g., second link 620) between electronic device 101 and the first network 210 may indicate the amount of data per frame required for the downlink (DL) 621 of electronic device 101 to receive data from the first network 210 (e.g., AP 215). According to an embodiment, a fourth data volume (e.g., second link 620) between electronic device 101 and the first network 210 may indicate the amount of data per frame required for the uplink (UL) 623 of electronic device 101 to transmit data to the first network 210 (e.g., AP 215). According to an embodiment, the first, second, third, and fourth data volumes may include specific values ​​that can be determined based on services and / or applications performed by external device 201.

[0155] According to an embodiment, electronic device 101 can determine SPs (e.g., first SPs and second SPs) associated with corresponding links 610 and 620 based on the data volume and bandwidth of corresponding links 610 and 620, as shown in the following example.

[0156] [Formula 1]

[0157]

[0158] [Equation 2]

[0159]

[0160] [Formula 3]

[0161]

[0162] As shown in [Equation 1], electronic device 101 can determine that SP is a value obtained by dividing the data volume of each link by the bandwidth value of each link (e.g., the first link 610 and the second link 620). According to an embodiment, electronic device 101 can determine that the first SP between electronic device 101 and external device 201 is a value obtained by dividing the sum of the downlink and uplink data volumes (e.g., the first data volume and the second data volume) between electronic device 101 and external device 201 by the bandwidth of the first link 610 (e.g., the wireless link bandwidth), as shown in Equation 2. According to an embodiment, electronic device 101 can determine that the second SP between electronic device 101 and the first network 210 is a value obtained by dividing the sum of the downlink and uplink data volumes (e.g., the third data volume and the fourth data volume) between electronic device 101 and the first network 210 by the bandwidth of the second link 620 (e.g., the network link bandwidth), as shown in [Equation 3]. According to an embodiment, the bandwidth of each link (e.g., wireless link bandwidth or network link bandwidth) can be determined based on the spatial flow used by at least the electronic device 101 and / or the modulation and coding scheme (MCS) index specified for the communication (e.g., MCS 11).

[0163] For example, electronic device 101 can exchange frames for communication connections with external device 201 and / or AP 215, such as association requests and association responses. Frames for connection may include information about standards that can be used for wireless communication, channel bandwidth, and / or the maximum number of spatial streams. Furthermore, electronic device 101 can measure the signal quality of received signals and can estimate, for example, the maximum modulation method, channel coding rate, and / or maximum MCS index that can be used in wireless communication by comparing the minimum input level sensitivity value of the receiver defined in each standard with the received signal quality. The maximum data rate defined in the standard can be calculated based on the standard, channel bandwidth, maximum number of spatial streams, maximum modulation method, channel coding rate, and / or maximum MCS index based on the received signal quality, and can be based on values ​​defined as the bandwidth of the link between electronic device 101 and external device 201 (e.g., first link 610) and the bandwidth of the link between electronic device 101 and AP 215 (e.g., second link 620).

[0164] According to an embodiment, when calculating SP as shown in [Equation 1], if the link bandwidths of the UL path and the DL path are the same, the electronic device 101 can calculate SP based on the link bandwidth. According to some embodiments, if the link bandwidths of the UL path and the DL path are different when calculating SP, the electronic device 101 can calculate SP by adding the link bandwidths corresponding to the DL path and the UL path, as shown in [Equation 2] and / or [Equation 3].

[0165] Figure 7 This is a flowchart illustrating a method of operating an electronic device according to various embodiments. Figure 8 Examples are shown where electronic devices perform scheduling based on SP and intervals according to various embodiments.

[0166] According to various embodiments, when the network through which electronic device 101 and server 301 communicate is a first network 210, electronic device 101 can determine whether the image transmission requirements for transmitting AR images to external device 201 (e.g., tethered AR glasses) are met. According to embodiments, electronic device 101 can determine whether the image transmission requirements are met based on whether the sum of a first SP and a second SP calculated according to [Equations 1] to [Equations 3] is included in the interval according to the frame rate of external device 201. For example, Figure 7 and Figure 8 An example is shown where electronic device 101 uses first network 210 as a network to server 301 to determine SP and interval (which are used to determine whether image transmission requirements are met).

[0167] refer to Figure 7 In operation 701, the processor 120 of the electronic device 101 can identify the frame rate for displaying content related to the external device 201. According to an embodiment, the processor 120 can use OOB (e.g., NFC, BLE, and / or Wi-Fi 2.4GHz) communication to search for the external device 201 to which it can connect. For example, the external device 201 can periodically perform BLE announcements (e.g., connection request broadcasts) and can include information indicating a device for supporting AR services, information related to the frame rate of the external device 201, and information related to elements including the external device 201 (e.g., camera module and sensors) in the BLE announcements. According to an embodiment, the processor 120 can perform periodic BLE scans via wireless communication circuitry 310 and receive BLE announcements from the external device 201 based on the BLE scans. According to an embodiment, the processor 120 can identify the frame rate of the external device 201 based on information obtained through OOB communication with the external device 201.

[0168] In operation 703, processor 120 can determine the repetition interval based on the frame rate of external device 201. For example, processor 120 can determine the image frame transmission interval 811 based on the frame rate of external device 201, such as... Figure 8 As shown in the illustration. According to an embodiment, processor 120 can determine a first interval (e.g., 33.3ms) for a first frame rate (e.g., 30fps), a second interval (e.g., 16.6ms) for a second frame rate (e.g., 60fps), or a third interval (e.g., 8.3ms) for a third frame rate (e.g., 120fps). According to an embodiment, refer to... Figure 8 Assuming the frame rate of external device 201 is 60 frames per second (e.g., 60 fps), data corresponding to one frame can be transmitted at least every 16.6 ms in the wireless link segment between electronic device 101 and external device 201. For example, in Figure 8 In this process, data corresponding to at least one frame can be sent and received every 16.6 ms during SP 813, calculated based on the data volume, and can re-enter sleep mode 815. According to an embodiment, processor 120 can determine the time required to send one frame of data based on the frame rate used for the image, and can, as shown... Figure 8 The diagram shows the time it takes to send one frame of data, based on the frame rate used for the image. For example, at approximately 60 fps, at least one image frame should be sent within approximately 16.6 ms. That is, at 60 fps, the interval between each frame can be approximately 16.6 ms.

[0169] In operation 705, processor 120 may calculate the amount of data associated with the first link 610 (e.g., the link between electronic device 101 and external device 201) and the second link 620 (e.g., the link between electronic device 101 and AP 215). According to an embodiment, as described above, the amount of data per frame required for each link (e.g., the first link 610 or the second link 620) may be predetermined. For example, the amount of data associated with the first link 610 may include the amount of data per frame (e.g., bits / frame) required in the downlink (DL) where external device 201 receives data from electronic device 101 and the amount of data per frame required in the uplink (UL) where external device 201 transmits data to electronic device 101. According to an embodiment, the amount of data associated with the second link 620 may include the amount of data per frame required in the DL where electronic device 101 receives data from first network 210 (e.g., AP 215) and the amount of data per frame required in the UL where electronic device 101 transmits data to first network 210 (e.g., AP 215). According to an embodiment, the amount of data per link can vary depending on the services and / or applications performed by the external device 201.

[0170] According to the embodiments, refer to Figure 8 It can be assumed that the frame rate is 60fps and SP 813 is determined to be 1ms. For example, SP 813 can be determined by network bandwidth, the amount of data per frame, and the allocation time for retransmission. For example, when electronic device 101 and external device 201 have a wireless connection in a 160MHz bandwidth using the IEEE 802.11ax-based WLAN standard and can support two spatial streams using a MIMO scheme (e.g., when assuming sufficient signal quality in a short range), a maximum physical layer link speed of 2400Mbps can be provided. When assuming that data frames are sent based on the Transmission Control Protocol (TCP) and that the efficiency of TCP communication is 75% of the physical layer link speed, the network bandwidth can be assumed to be 1800Mbps (2400Mbps * 0.75). When assuming that each frame sent from electronic device 101 to display device 201 requires a data transmission amount of 1.8Mbit, SP 813 (e.g., minimum service period) can be determined to be 1ms (1.8Mbit / 1800Mbps).

[0171] In operation 707, processor 120 can calculate a first SP related to the first link 610 and a second SP related to the second link 620. According to an embodiment, processor 120 can calculate the first SP and the second SP based on the description made with reference to [Equations 1] to [Equations 3]. For example, processor 120 can determine the SP based on the data volume of each link. According to an embodiment, the operation of determining the SP based on the data volume and the operation of determining the interval based on the frame rate are not limited to... Figure 7 The order shown can be reversed, performed in parallel, or heuristically.

[0172] In operation 709, processor 120 can identify whether image transmission requirements are met based on the sum of the first SP and the second SP. According to an embodiment, processor 120 can determine whether the current network (e.g., first network 210) meets image transmission requirements based on the determined image frame transmission interval and SP. For example, when the sum of the first SP and the second SP is included in a predetermined interval (e.g., when the sum of the first SP and the second SP is less than the interval according to the frame rate of external device 201), processor 120 can identify that the corresponding link (e.g., AP 215 of first network 210) meets the image transmission requirements. In another example, when the sum of the first SP and the second SP is not included in a predetermined interval, processor 120 can identify that the corresponding link (e.g., AP 215 of first network 210) does not meet the image transmission requirements.

[0173] In operation 711, processor 120 can allocate SPs. According to an embodiment, when image transmission requirements are identified as being met, processor 120 can configure SPs to guarantee each required SP. For example, processor 120 can negotiate each link (e.g., the first link 610 between electronic device 101 and external device 201, or the second link 620 between electronic device 101 and AP 215 supporting the first network 210) with external device 201. According to an embodiment, processor 120 can negotiate the SP duration, SP start time, and / or SP interval for each link (e.g., the first link 610 between electronic device 101 and external device 201, or the second link 620 between electronic device 101 and AP 215) based on the first network 210. For example, electronic device 101 and external device 201 can negotiate the SP duration, SP start time, and / or SP interval for the first link 610, and electronic device 101 and AP 215 can negotiate the SP duration, SP start time, and / or SP interval for the second link 620. According to an embodiment, electronic device 101 can negotiate a second link 620 with AP215 based on the negotiation result with external device 201 regarding the first link 610.

[0174] According to various embodiments, when the sum of the first SP and the second SP calculated as described above is included in the image frame transmission interval, electronic device 101 can determine that the corresponding network (e.g., AP 215 of the first network 210) satisfies the image transmission conditions. According to another embodiment, when the sum of the first SP and the second SP is less than the image frame transmission interval according to the frame rate of external device 201, electronic device 101 can reserve additional retransmission time considering the ratio of each SP. For example, when the values ​​(e.g., the sum) of the first SP, the first retransmission time, the second SP, and the second retransmission time are included in the image frame transmission interval, taking into account the reserved retransmission time, electronic device 101 can determine that the corresponding network (e.g., AP 215 of the first network 210) satisfies the image transmission conditions. Examples are shown in... Figure 9 As shown in the image.

[0175] Figure 9 Examples of scheduling between links are shown according to various embodiments. Figure 10 Examples of scheduling based on the TWT protocol according to various embodiments are shown.

[0176] According to an embodiment, Figure 9 An example is shown of controlling sleep and wake-up between a Wi-Fi AP 901 (e.g., AP 215 of FIG. 2), electronic device 101, and external device 201 in the first network 210 based on the image frame transmission interval and SP, which are determined by the frame rate. According to an embodiment, Figure 10This illustrates an example of how electronic device 101 performs TWT setting operations when it is operating as a Target Wake Time (TWT) request station (hereinafter referred to as a "TWT Request STA") for Wi-Fi AP 901 and external device 201. According to an embodiment, in order to schedule a first link between electronic device 101 and external device 201 and / or second SP920 (e.g., ...), Figure 6 The first link 610) first SP 910 and first retransmission time 915 and the second link (e.g., between electronic device 101 and Wi-Fi AP 901) Figure 6 The second retransmission time of the second link (620) is 925, for example, it can be used as follows: Figure 10 The method shown is based on the TWT protocol to perform scheduling.

[0177] refer to Figure 9 The sleep / wake-up time protocol can be used to negotiate each link (e.g., first link and second link) based on the TWT protocol defined in, for example, the 802.11ax standard and / or similar non-standards, to process the first SP 910 and the second SP 920 within a given interval. According to an embodiment, Figure 9 An example is shown where image transmission requirements are configured, for example, within an interval of approximately 16.6 ms at a frame rate of approximately 60 fps, using a first SP 910 or a first retransmission time 915 of a first link between the electronic device 101 of the first network 210 and the external device 201, and a second SP 920 or a second retransmission time 925 of a second link between the electronic device 101 of the first network 210 and the Wi-Fi AP 901. Figure 9 In this process, the first retransmission time 915 and the second retransmission time 925 can be determined based on the first SP 910 and the second SP 920. For example, when assuming a retransmission rate of 100%, the first retransmission time 915 can be configured to the same value as the first SP 910, and the second retransmission time 925 can be configured to the same value as the second SP 920. For example, when the first SP 910 of the first link between the electronic device 101 and the external device 201 is 1 ms, the second SP 920, the first retransmission time 915, and / or the second retransmission time 925 can be configured to 1 ms.

[0178] According to an embodiment, Figure 9 and Figure 10An example is shown where the first SP910 and the second SP920 are configured to not overlap when the network is the first network 210 (e.g., Wi-Fi AP901). According to an embodiment, when the type of network between server 301 and electronic device 101 is the same as the type of network between electronic device 101 and external device 201 (e.g., the first network 210), the transmission intervals are configured to not overlap.

[0179] For example, Figure 10 This illustrates an example of operation (or configuration) where the first SP 910 and the second SP 920 do not overlap when the electronic device 101 operates as a TWT request STA for Wi-Fi AP 901 and external device 201. For example, Figure 10 An example is shown where electronic device 101 operates as a STA and is connected to Wi-Fi AP 901, and operates in group client (GC) mode of a Wi-Fi peer-to-peer (P2P) group and is connected to external device 201 operating in group owner (OG) mode of a Wi-Fi P2P group (or soft AP mode).

[0180] Reference to the embodiments Figure 9 and Figure 10 In operation 1001, external device 201 can send a TWT request to electronic device 101. According to an embodiment, external device 201 can configure values ​​corresponding to each of the fields for configuring the TWT wake-up interval (or target wake-up interval) 930, TWT wake-up duration (or minimum wake-up duration) 935, and first TWT 955 included in the TWT element, and make a request to control the network when sending the TWT request. For example, external device 201 can configure the first TWT 955 based on the start time (or service start time) of the first SP 910, configure the TWT wake-up duration 935 based on the first SP 910 and the first retransmission time 915, configure the TWT wake-up interval 930 based on the image frame transmission interval 900, and send it to electronic device 101. For example, as... Figure 9 As shown, external device 201 can use image frame transmission interval 900 as wake-up interval 930, and use the first SP 910 or the sum of the first SP 910 and the first retransmission time 915 as TWT wake-up duration 935. For example, electronic device 101 can use the sum of the first SP 910 and the first retransmission time 915 as TWT wake-up duration 935 in the TWT setting operation of electronic device 101 and external device 201.

[0181] In operation 1003, electronic device 101 can receive a TWT request from external device 201 and send an acknowledgment (ACK) of receipt of the TWT request to external device 201.

[0182] In operation 1005, electronic device 101 may send a TWT response to external device 201 in response to a TWT request from external device 201. According to an embodiment, external device 201, having received a TWT response from electronic device 101, may operate in a woken-up state for the TWT wake-up duration 935 configured in the TWT request. For example, external device 201 may enter a sleep state after the first SP910 and enter a woken-up state in the next TWT wake-up interval 930. According to an embodiment, external device 201 may add (or configure) the service start time in the TWT field of the TWT request.

[0183] In operation 1007, external device 201 can receive a TWT response from electronic device 101 and send an ACK for the received TWT response to electronic device 101.

[0184] According to an embodiment, electronic device 101 and external device 201 can determine the configuration of the TWT wake-up interval 930, TWT wake-up duration 935, and first TWT 955 included in the TWT elements through TWT negotiation. For example, when external device 201 configures the TWT elements (e.g., TWT wake-up interval 930, TWT wake-up duration 935, and first TWT 955) and sends them to electronic device 101, electronic device 101 can approve the TWT request from external device 201 based on the channel busy level and the status information of electronic device 101 and send the TWT elements to external device 201 (e.g., send a TWT response).

[0185] In operation 1009, electronic device 101 may send a TWT request to Wi-Fi AP 901. According to an embodiment, when sending a TWT request, electronic device 101 may configure a value corresponding to each of the fields used to configure the TWT wake-up interval 940, TWT wake-up duration 945, and second TWT 965 included in the TWT element to control the network. For example, electronic device 101 may configure a first TWT 955 (or the TWT of a first link) based on the start time (or service start time) of a first SP 910, the first SP 910, and a first retransmission time 915; configure a second TWT 965 (or the TWT of a second link) based on a second SP 920 and a second retransmission time 925; and configure the TWT wake-up interval 940 based on the image frame transmission interval 900. According to an embodiment, the first TWT 955 and the second TWT 965 can be configured to have different values, and the electronic device 101 can control the first SP 910 and the second SP 920 to not overlap based on the different configuration of the first TWT 955 and the second TWT 965.

[0186] For example, such as Figure 9 As shown, electronic device 101 can use image frame transmission interval 900 as TWT wake-up interval 940, and use the second SP 920 or the sum of the second SP 920 and the second retransmission time 925 as TWT wake-up duration 945. For example, electronic device 101 can use the sum of the second SP 920 and the second retransmission time 925 as TWT wake-up duration 945 in the TWT setting operation of Wi-Fi AP 901 for the connection between electronic device 101 and server 301. According to some embodiments, electronic device 101 can also use a time value that takes into account the first SP 910 and the first retransmission time 915 of external device 201 as the second TWT 965 in the TWT setting operation of Wi-Fi AP 901. For example, electronic device 101 can use the value obtained by adding the sum of the first SP 910 and the first retransmission time 915 to the first TWT 955 configured using external device 201 as the second TWT 965 for Wi-Fi AP 901. For example, electronic device 101 may configure second TWT 965 in consideration of the end of first SP 910 or first retransmission time 915.

[0187] In operation 1011, Wi-Fi AP 901 can receive TWT requests from electronic device 101 and send an ACK to electronic device 101 for receiving the TWT requests.

[0188] In operation 1013, Wi-Fi AP 901 can send a TWT response to electronic device 101 in response to a TWT request from electronic device 101. According to an embodiment, Wi-Fi AP 901 can send data corresponding to third data 621 and fourth data (i.e., uplink UL) 623 to electronic device 101 and receive data corresponding to third data 621 and fourth data (i.e., uplink UL) 623 from electronic device 101 during a period of TWT wake-up duration 945 configured in the TWT request. According to an embodiment, Wi-Fi AP 901 can determine the configuration of the TWT wake-up interval 940, TWT wake-up duration 945, and second TWT 965 included in the TWT elements configured by electronic device 101 by negotiation. For example, Wi-Fi AP 901 can identify whether SPs for at least one other electronic device (not shown) with a communication connection to Wi-Fi AP 901 do not overlap.

[0189] In operation 1015, electronic device 101 can receive a TWT response from Wi-Fi AP 901 and send an ACK for the received TWT response to Wi-Fi AP 901.

[0190] As described above, according to various embodiments, electronic device 101 can configure TWT in the TWT setting operation of each link so that when the network is the first network 210, the first SP 910 and the second SP 920 do not overlap with each other.

[0191] According to an embodiment, electronic device 101 can re-perform the TWT configuration operation with external device 201 based on the TWT settings with Wi-Fi AP 901. For example, when electronic device 101 sends a TWT request to Wi-Fi AP 901 based on the TWT configuration with external device 201 and Wi-Fi AP 901 requests (or refuses) to change the TWT settings, electronic device 101 can reconfigure some TWT settings (e.g., a first TWT) with external device 201 based on the TWT configuration with Wi-Fi AP 901.

[0192] Figure 11 Another example of scheduling based on the TWT protocol according to various embodiments is shown.

[0193] According to an embodiment, Figure 11 An example is shown of the operation of performing TWT settings when electronic device 101 is running as a TWT request STA for Wi-Fi AP 901 and as a TWT response STA for external device 201.

[0194] According to an embodiment, Figure 11 An example is shown where the first SP 910 and the second SP 920 are configured not to overlap when the network is the first network 210 (e.g., Wi-Fi AP 901). According to an embodiment, the SPs are configured not to overlap when the type of network between the server 301 and the electronic device 101 is the same as the type of network between the electronic device 101 and the external device 201 (e.g., the first network 210).

[0195] For example, Figure 11 This illustrates an example of the operation (or configuration) of the first SP 910 and the second SP 920 without overlap when the electronic device 101 operates as a TWT request STA for Wi-Fi AP 901 and as a TWT response STA for external device 201. For example, Figure 11 An example is shown where electronic device 101 operates as a STA and is connected to Wi-Fi AP 901 and operates in GO mode (or soft AP mode) of Wi-Fi P2P group with external device 201 and is connected to external device 201 operating in GC mode (or STA mode) of Wi-Fi P2P group.

[0196] like Figure 11 As shown, Figure 11 and Figure 10 The difference is that electronic device 101 uses TWT response to perform TWT settings with external device 201.

[0197] Reference to the embodiments Figure 9 and Figure 11 In operation 1101, electronic device 101 can send a TWT response to external device 201. According to an embodiment, electronic device 101 can configure values ​​corresponding to each of the fields for configuring the TWT wake-up interval 930, TWT wake-up duration 935, and first TWT 955 included in the TWT element, and control the network when sending the TWT response. For example, electronic device 101 can configure the first TWT 955 based on the start time (or service start time) of the first SP 910, configure the TWT wake-up duration 935 based on the first SP 910 and the first retransmission time 915, configure the TWT wake-up interval 930 based on the image frame transmission interval 900, and send it to external device 201. For example, as... Figure 9 As shown, electronic device 101 can use image frame transmission interval 900 as wake-up interval 930, and use the first SP 910 or the sum of the first SP 910 and the first retransmission time 915 as TWT wake-up duration 935. For example, electronic device 101 can use the sum of the first SP 910 and the first retransmission time 915 as TWT wake-up duration 935 in the TWT setting operation between electronic device 101 and external device 201.

[0198] In operation 1103, external device 201 can receive a TWT response from electronic device 101 and send an ACK for the received TWT response to electronic device 101. According to an embodiment, as... Figure 11As shown, when electronic device 101 operates in GO mode for a Wi-Fi P2P group for external device 201, electronic device 101 can directly send a TWT response and directly perform TWT setup operations for Wi-Fi AP 901 based on receiving an ACK for the TWT response from external device 201. For example, if electronic device 101 does not receive a TWT teardown from external device 201 after sending a TWT response, electronic device 101 can determine that the TWT setup with external device 201 has been successfully completed and perform the TWT setup operation for Wi-Fi AP 901. According to an embodiment, when external device 201 determines that the TWT setup information included in the TWT response received from electronic device 101 (e.g., TWT wake-up interval 930, TWT wake-up duration 935, and / or first TWT 955) does not meet the frame rate of external device 201, external device 201 can send a TWT teardown to end the TWT setup. When the electronic device 101 does not receive a TWT removal notification from the external device 201, the electronic device 101 can determine that the TWT setup with the external device 201 has been completed normally.

[0199] In operations 1105, 1107, 1109, and 1111, electronic device 101 and Wi-Fi AP 901 can perform operations related to... Figure 10 The operations described in operations 1009, 1011, 1013 and 1015 correspond to the operations described in the text.

[0200] Figure 12 Another example of scheduling between links according to various embodiments is shown.

[0201] According to an embodiment, Figure 12 An example is shown of controlling sleep and wake-up based on the image frame transmission interval and SP between base station 1201 (e.g., base station 225 of FIG2), electronic device 101, and external device 201 in the second network 220. According to an embodiment, Figure 12 An example of operation (or configuration) in which the first SP 1210 and the second SP 1220 overlap when the network connected to electronic device 101 is a base station 1201 of the second network 220. According to an embodiment, when the type of the network between server 301 and electronic device 101 (e.g., the second network 220) is different from the type of the network between electronic device 101 and external device 201 (e.g., the first network 210), the transmission intervals can be configured to overlap.

[0202] refer to Figure 12Electronic device 101 can negotiate the TWT wake-up duration, TWT wake-up interval, and image frame transmission interval with external device 201. According to an embodiment, in order to process the first SP1210 and the second SP1220 within a given interval, electronic device 101 can perform negotiation for each link using a TWT protocol defined in, for example, the 802.11ax standard or based on a similar non-standard sleep / wake-up time protocol. According to an embodiment, Figure 12 An example is shown where image transmission requirements are configured, for example, at a frame rate of approximately 60 fps, using a first SP 1210 and a first retransmission time 1215 between the electronic device 101 of the first network 210 and the external device 201, and / or a second SP 1220 and a second retransmission time 1225 between the base station 1201 of the second network 220 and the electronic device 101.

[0203] According to an embodiment, in order to schedule the first SP 1210, the first retransmission time 1215, the second SP 1220, and the second retransmission time 1225 between corresponding links, the electronic device 101 can use, as shown in the example... Figure 10 or Figure 11 The example shown is a scheduling method based on the TWT protocol.

[0204] According to an embodiment, Figure 12 An example is shown where the first SP 1210 and the second SP 1220 are configured to at least partially overlap (or overlap) when the network is a second network 220 (e.g., cellular base station 1201). For example, as Figure 12 As shown, when the network is the second network 220, the second SP 1220 and the second retransmission time 1225 can be at least partially the same as the first SP 1210 and the second retransmission time 1225, but this is not the case when the network is the first network 210.

[0205] According to an embodiment, electronic device 101 and external device 201 can communicate with each other using a WLAN protocol, and electronic device 101 and server 301 can communicate with each other through a second network 220 (e.g., cellular base station 1201). Therefore, even if the first SP 1210 and the second SP 1220 are used simultaneously, there is no interference. According to an embodiment, electronic device 101 can switch to a wake-up state and send and receive data to and from external device 201 via the first network 210, and send and receive data to and from server 301 (or cellular base station 1201) via the second network 220. For example, when the transmission and reception of the two links end normally, electronic device 101 can enter a sleep mode, thus benefiting in terms of power consumption.

[0206] Figure 13 This is a flowchart illustrating the operation of an external device according to various embodiments.

[0207] According to an embodiment, Figure 13 An example is shown where an external device 201 provides AR services based on TWT negotiation with electronic device 101.

[0208] refer to Figure 13 In operation 1301, the processor 380 of the external device 201 can execute AR services. According to an embodiment, the processor 380 can execute AR services (or AR applications related to AR services) in the external device 201 based on a request from a user or electronic device 101. According to an embodiment, when executing AR services, the processor 380 can detect connectable electronic devices 101 via OOB communication. For example, the processor 380 can detect electronic devices 101 via BLE as an OOB and connect to electronic devices 101 via a specific channel (e.g., a WLAN channel) using a Wi-Fi passthrough protocol.

[0209] In operation 1303, processor 380 can send frame rate information of external device 201 to electronic device 101 via communication module 365 based on the execution of AR service. According to an embodiment, processor 380 can send frame rate information to electronic device 101 after detecting operation of electronic device 101 via OOB communication, before connecting to electronic device 101, or after connecting to electronic device 101.

[0210] In operation 1305, processor 380 can perform TWT negotiation with electronic device 101. According to an embodiment, processor 380 can, based on reference... Figure 10 and / or Figure 11 The description is made to perform TWT negotiation with electronic device 101.

[0211] In operation 1307, processor 380 can configure sending and receiving data from and to electronic device 101 based on TWT. According to an embodiment, processor 120 can send data (e.g., image information captured by camera module 360) to electronic device 101 based on TWT parameters.

[0212] In operation 1309, processor 120 can display AR data (e.g., AR images) via display module 340. According to an embodiment, processor 120 can receive AR images from electronic device 101 via communication module 365 and display the received AR images via display module 340.

[0213] Figure 14 This is a flowchart illustrating the operation of an electronic device according to various embodiments.

[0214] According to an embodiment, Figure 14 An example is shown where the network changes from the second network 220 (e.g., a cellular network) to the first network 210 (e.g., a Wi-Fi network) when the network currently connected to the electronic device 101 is the second network 220.

[0215] refer to Figure 14 In operation 1401, the processor 120 of electronic device 101 can perform AR services based on a connection to the second network 220. For example, electronic device 101 can perform AR services while having a communication connection with external device 201 based on the first network 210 and a communication connection with server 301 via the second network 220.

[0216] In operation 1403, processor 120 may search for access points (APs) of the first network 210 (e.g., AP 215 of FIG. 2) that can be connected to (or roam) during AR service based on the second network 220. According to an embodiment, when electronic device 101 performs data communication related to AR service based on the second network 220, the electronic device may periodically monitor the first network 210 and perform the operation of searching for access points (e.g., Wi-Fi APs) of the first network 210 that can be connected to or roam based on the monitoring results. For example, the operation of searching for access points of the first network 210 that can be connected to (or roam) during AR service based on the second network 220 may be performed based on a user request or because the first network 210 is configured to have a higher priority than the second network 220.

[0217] In operation 1405, processor 120 can identify whether an AP that meets the transmission requirements has been found based on the search results. According to an embodiment, when an AP is found based on the AP search results, processor 120 can determine whether the found AP meets the transmission requirements. For example, processor 120 can determine whether the found AP meets the image transmission requirements taking into account the first SP and the second SP and / or the first retransmission time and the second retransmission time. According to an embodiment, electronic device 101 can calculate the first SP and the first retransmission time based on the frame rate of external device 201, and determine whether the found AP supports the second SP and the second retransmission time (whether the sum of the first SP, the second SP, the first retransmission time, and the second retransmission time is shorter than the interval based on the frame rate of external device 201) based on the first SP and the first retransmission time.

[0218] When no AP that meets the transmission requirements is found (e.g., "No" in operation 1405), the processor 120 may initiate a predetermined time delay (e.g., T, where T>0) in operation 1407 and return to operation 1403 to re-execute the search for a suitable AP.

[0219] When an AP that meets the transmission requirements is found (e.g., "Yes" in operation 1405), in operation 1409, the processor 120 can establish a connection (or roam) with the corresponding AP.

[0220] After establishing a connection (or roaming) with the corresponding AP, in operation 1411, the network used for AR services can be changed from the second network 220 to the first network 210 (e.g., the data path can be changed, or for example, from the second data path 240 to the first data path 230). According to an embodiment, when the network changes to the first network 210, the processor 120 can provide AR services based on a scheduling that takes into account the first SP and the second SP and / or the first retransmission time and the second retransmission time. For example, the processor 120 can perform a scheduling such that the first SP and / or the first retransmission time and the second SP and / or the second retransmission time at least partially overlap with each other.

[0221] Figure 15 This is a flowchart illustrating the operation of an electronic device according to various embodiments.

[0222] According to the embodiment, it can be assumed that the electronic device 101 is communicating with the AP 215 supporting the first network 210, and has already been based on... Figure 15 Another application (or service) executing in electronic device 101 makes a TWT configuration between AP 215 and electronic device 101. According to an embodiment, in Figure 15 In this state, electronic device 101 can search for external device 201 via OOB (or receive AR service requests from external device 201), perform a new TWT configuration with AP 215 based on the AR service conditions (or transmission requirements (e.g., frame rate)) of external device 201, or change the first network 210 connected to electronic device 101 via AP 215 to a second network 220 including base station 225.

[0223] refer to Figure 15 In operation 1501, the processor 120 of the electronic device 101 can perform TWT negotiation with the AP 215 supporting the first network 210. According to an embodiment, the processor 120 can be configured according to reference... Figure 10 and / or Figure 11 The description made is to perform in accordance with AP 215 (e.g., Figure 10 or Figure 11 TWT negotiation for the Wi-Fi AP 901.

[0224] In operation 1503, processor 120 can detect the initiation of the AR service when electronic device 101 is connected to AP 215. According to an embodiment, processor 120 can detect the initiation of the AR service based on the execution of an AR service-related application (e.g., an AR application) in electronic device 101 and / or the detection of a request for connection to external device 201. For example, while electronic device 101 is communicating with AP 215 via first network 210, processor 120 can establish a communication connection with external device 201 and execute the AR service through first network 210.

[0225] In operation 1505, processor 120 can identify AR service conditions of external device 201 (e.g., transmission requirements such as frame rate). According to an embodiment, processor 120 can receive information about the frame rate of external device 201 via OOB communication, and identify information about the frame rate of external device 201 related to AR services based on connection history.

[0226] In operation 1507, processor 120 can determine whether AP 215 meets AR service conditions based on AR service conditions. According to an embodiment, processor 120 can determine whether the first network 210 currently connected between electronic device 101 and AP 215 meets AR service conditions and therefore has the transmission capability to provide a satisfactory AR experience. According to an embodiment, the first network 210 currently connected between electronic device 101 and AP 215 can be a communication connection between electronic device 101 and server 301 via AP 215 supporting the first network 210.

[0227] When AP 215 meets the AR service conditions (e.g., "Yes" in operation 1507), in operation 1509, processor 120 can reconfigure the TWT. For example, processor 120 can re-perform the TWT configuration operation with electronic device 101 based on the TWT configuration with external device 201. According to an embodiment, processor 120 can perform multiple TWT configurations with AP 215 based on an application (or service) running in electronic device 101. For example, multiple TWTs may be included between electronic device 101 and AP 215. According to an embodiment, in the state where a TWT has been configured with AP 215, processor 120 can configure a first AP with external device 201 and a second SP with AP 215 based on another application running in electronic device 101 (e.g., AR service), taking into account the existing TWT. According to an embodiment, processor 120 can provide AR services based on scheduling that takes into account the first SP and the second SP and / or the first retransmission time and the second retransmission time. For example, processor 120 can perform scheduling such that the first SP and / or the first retransmission time and the second SP and / or the second retransmission time at least partially overlap with each other.

[0228] When AP 215 does not meet the AR service conditions (e.g., "No" in operation 1507), in operation 1511, processor 120 can change the network to another network. According to an embodiment, processor 120 can change the network used for AR services from the first network 210 to a second network 220 that includes base station 225. For example, when AR services have high priority, processor 120 can change the network used for the connection between electronic device 101 and AP 215 from the first network 210 to the second network 220 to provide AR services.

[0229] According to various embodiments, the external device 201 may include a rollable, foldable, or slidable display (e.g., Figure 1 The external device 201 may have different required data amounts per frame based on the display state (e.g., at least a portion is folded, rolled, or unfolded). For example, the amount of data required per frame by the external device 201 may vary depending on the resolution of the display. According to an embodiment, the external device 201 may renegotiate the TWT wake-up duration, TWT wake-up interval, and image frame transmission interval with the electronic device 101 based on changes in the display state.

[0230] An operation method performed by an electronic device 101 according to various embodiments of the present disclosure may include: identifying a first service period (SP) based on the amount of data along a predetermined data path when activating an augmented reality (AR) service using an external device 201; identifying a transmission interval based on the frame rate of the external device 201; identifying whether a network connected to the electronic device 101 meets predetermined transmission requirements based at least on the first SP and the transmission interval; determining connection information related to the connection with the external device 201 based on the network meeting the transmission requirements; and establishing a connection with the external device 201 based on the connection information.

[0231] According to various embodiments of this disclosure, the operation of identifying the first SP may include: configuring the operation of the first TWT related to the first link based on the target wake-up time (TWT) element of the first link between the electronic device 101 and the external device 201, and configuring the operation of the second TWT related to the second link between the electronic device 101 and the network based at least on the first TWT and TWT elements of the first link, wherein the TWT element may include the TWT wake-up interval, the TWT wake-up duration and the TWT.

[0232] According to various embodiments of this disclosure, the operations performed by the electronic device 101 may include calculating a first SP based on the amount of data on a first link and calculating a second SP based on the amount of data on a second link.

[0233] According to various embodiments of this disclosure, the operation of identifying whether a network meets transmission requirements may include determining that the network meets transmission requirements when the sum of the first SP and the second SP is included in a transmission interval based on the frame rate.

[0234] According to various embodiments of this disclosure, the first SP includes the required time calculated by dividing the amount of data required to transmit a frame in a first link between electronic device 101 and external device 201 by the link bandwidth of the first link.

[0235] According to various embodiments of this disclosure, the second SP includes the required time calculated by dividing the amount of data required to transmit a frame in a second link between the electronic device 101 and the network by the link bandwidth of the second link.

[0236] According to various embodiments of this disclosure, the operation of determining connection information may include determining that the channel through which the electronic device 101 is connected to the network is the channel between the electronic device 101 and the external device 201.

[0237] The various embodiments of this disclosure shown in the specification and accompanying drawings are merely specific examples to readily describe the technical content of this disclosure and aid in understanding it, and do not limit the scope of this disclosure. Therefore, the scope of this disclosure should be interpreted as including all modifications or variations derived from the technical concept of this disclosure.

Claims

1. An electronic device, the electronic device comprising: Wireless communication circuits; as well as A processor, operatively connected to the wireless communication circuit, The processor is configured as follows: When an augmented reality (AR) service associated with an external device is activated, the first service period (SP) is identified based on the amount of data along a predetermined data path. The transmission interval is identified based on the frame rate displayed on the external device. Based at least on the first SP and the transmission interval, it is determined whether the network connected to the electronic device meets the predetermined transmission requirements. Based on the detection that the network meets the predetermined transmission requirements, connection information related to the connection with the external device is determined, and A connection with the external device is established based on the connection information.

2. The electronic device according to claim 1, wherein, The processor is configured to: Based on the target wake-up time (TWT) element of the first link between the electronic device and the external device, configure the first TWT related to the first link, and At least based on the first TWT and the TWT element of the first link, a second TWT related to the second link between the electronic device and the network is configured, and The TWT element includes the TWT wake-up interval, the TWT wake-up duration, and the TWT.

3. The electronic device according to claim 2, wherein, The processor is configured to: The first SP is calculated based on the data volume of the first link. The second SP is calculated based on the data volume of the second link, and When the sum of the first SP and the second SP is included in the transmission interval according to the frame rate, it is determined that the network meets the predetermined transmission requirements.

4. The electronic device according to claim 3, in, The first SP includes a first time calculated through the following operations: Divide the amount of data used to transmit one frame via the first link between the electronic device and the external device by the link bandwidth of the first link, and The second SP includes a second time calculated through the following operations: Divide the amount of data used to transmit one frame through the second link between the electronic device and the network by the link bandwidth of the second link.

5. The electronic device according to claim 1, wherein, The processor is configured to determine whether to change the network based on whether the network meets the predetermined transmission requirements.

6. The electronic device according to claim 5, wherein, The processor is configured to: When the network is an access point (AP) supporting the first network and the AP does not meet the transmission requirements, search for another AP that supports the first network. If the search for another AP that meets the transmission requirements fails, the network will be changed from the first network to the second network. When searching for another AP, it is preferable to search for APs in a predetermined frequency band.

7. The electronic device according to claim 2, wherein, The processor is configured to: Identify a network that meets the transmission requirements. Based on the determined network, connection information related to the connection with the external device is determined, and The determined connection information is sent to the external device using out-of-band (OOB) communication.

8. The electronic device according to claim 7, wherein, The processor is configured to: The channel through which the electronic device connects to the network is determined as the channel between the electronic device and the external device. When the determined network is the first network, the first channel, which is equal to the channel configured using the network, is determined as the connection information. When the determined network is the second network, the second channel, which is different from the first channel, is determined as the connection information.

9. The electronic device according to claim 8, wherein, When the network is the first network, the processor is configured to determine the connection information based on the channel busy level of the first network.

10. The electronic device according to claim 9, wherein, The processor is configured to preferably measure the channel busyness based on channels in a predetermined frequency band in the first network, and determine, based on the measurement results, that channels with low busyness are channels used for connection to the external device.

11. The electronic device according to claim 3, wherein, The processor is configured to: Whether the first SP and the second SP overlap is determined based on whether the network types of the first link and the second link are the same. When the network types of the first link and the second link are the same, the first SP and the second SP are set to avoid overlap, and When the network types of the first link and the second link are different from each other, the first SP and the second SP are controlled to overlap at least partially.

12. A method of operating an electronic device, the method comprising: When launching an augmented reality (AR) service utilizing an external device, at least one processor of the electronic device identifies a first service period SP based on the amount of data along a predetermined data path. The transmission interval is identified based on the frame rate used to display the image on the external device; At least based on the first SP and the transmission interval, it is determined whether the network connected to the electronic device meets the predetermined transmission requirements; Based on the network meeting the predetermined transmission requirements, the connection information for the connection with the external device is determined; as well as A connection with the external device is established based on the connection information.

13. The method of claim 12, wherein, Identifying the first SP includes: Configure a first TWT related to the first link based on the target wake-up time (TWT) element of the first link between the electronic device and the external device; and At least based on the first TWT and the TWT element of the first link, a second TWT related to the second link between the electronic device and the network is configured, and The TWT element includes the TWT wake-up interval, the TWT wake-up duration, and the TWT.

14. The method of claim 13, further comprising: The first SP is calculated based on the data volume of the first link; as well as The second SP is calculated based on the data volume of the second link, and The step of identifying whether the network meets the transmission requirements includes: determining that the network meets the transmission requirements when the sum of the first SP and the second SP is included within a transmission interval based on the frame rate. The first SP includes a first time calculated through the following operations: Divide the amount of data used to transmit one frame via the first link between the electronic device and the external device by the link bandwidth of the first link, and The second SP includes a second time calculated through the following operations: Divide the amount of data used to transmit one frame through the second link between the electronic device and the network by the link bandwidth of the second link.

Images