Electronic device, method, and non-transitory computer-readable storage medium for establishing communication link with external electronic device

Abstract

This electronic device comprises: at least one processor including processing circuitry; a display; at least one camera; a communication circuit; and a memory storing one or more programs configured to be individually or collectively executed by the at least one processor and including one or more storage media, wherein the one or more programs may include instructions that cause the electronic device to: on the basis of detecting an event related to establishment of a communication link, identify, while displaying a preview image, an external electronic device by using the at least one camera; on the basis of the type of the external electronic device, identify a first user input to be received for establishing the communication link with the external electronic device; identify a second user input received with respect to the external electronic device; display information for guiding the first user input, on the basis of the second user input that is different from the first user input; and establish the communication link on the basis of the second user input corresponding to the first user input.

Description

Electronic device, method, and non-transient computer-readable storage medium for establishing a communication link with an external electronic device

[0001] The present disclosure relates to an electronic device, a method, and a non-transient computer-readable storage medium for establishing a communication link with an external electronic device.

[0002] Bluetooth® (or legacy Bluetooth®) (or classic Bluetooth) is a short-range wireless technology standard used for data exchange between electronic devices. Bluetooth can be provided over the ISM (industrial, scientific, and medical) radio band. For example, Bluetooth can be used to exchange text information, voice information, and / or audio information via wireless communication between electronic devices.

[0003] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.

[0004] An electronic device is described. The electronic device may include at least one processor comprising a processing circuit, a display, at least one camera, a communication circuit, and a memory comprising one or more storage media for storing one or more programs configured to be executed individually or collectively by the at least one processor. The one or more programs may include instructions that cause the electronic device to detect an event related to establishing a communication link using the at least one camera. The one or more programs may include instructions that cause the electronic device to display a preview image using the at least one camera activated based on the event, via the display, based on the detection. The one or more programs may include instructions that cause the electronic device to identify an external electronic device located within the field of view (FOV) of the at least one camera while displaying the preview image. The above one or more programs may include instructions that cause the electronic device to identify a first user input to be received regarding the external electronic device in order to establish a communication link with the external electronic device based on the type of the external electronic device. The above one or more programs may include instructions that cause the electronic device to identify a second user input received regarding the external electronic device using the at least one camera while displaying the preview image. The above one or more programs may include instructions that cause the electronic device to determine whether the second user input identified using the at least one camera while displaying the preview image corresponds to the first user input identified based on the type of the external electronic device.The above one or more programs may include instructions that cause the electronic device to display information guiding the first user input, along with the preview image, through the display, based on determining the second user input which is different from the first user input. The above one or more programs may include instructions that cause the electronic device to establish the communication link with the external electronic device, based on determining the second user input which corresponds to the first user input.

[0005] A method is described. The method may be performed within an electronic device comprising a display, at least one camera, and a communication circuit. The method may include an operation of detecting an event related to establishing a communication link using the at least one camera. Based on the detection, the method may include an operation of displaying a preview image through the display using the at least one camera activated based on the event. While displaying the preview image, the method may include an operation of identifying an external electronic device located within the field of view (FOV) of the at least one camera. Based on the type of the external electronic device, the method may include an operation of identifying a first user input to be received regarding the external electronic device in order to establish a communication link with the external electronic device. While displaying the preview image, the method may include an operation of identifying a second user input received regarding the external electronic device using the at least one camera. The method may include an operation of determining whether the second user input identified using the at least one camera while displaying the preview image corresponds to the first user input identified based on the type of the external electronic device. The above method may include an operation of displaying information guiding the first user input, along with the preview image, through the display, based on determining the second user input which is different from the first user input. The above method may include an operation of establishing the communication link with the external electronic device based on determining the second user input corresponding to the first user input.

[0006] A non-transient computer-readable storage medium is described. The non-transient computer-readable storage medium may store one or more programs. The one or more programs may include instructions that cause the electronic device to detect an event related to establishing a communication link using the at least one camera when executed by the electronic device, the electronic device comprising a display, at least one camera, and a communication circuit. The one or more programs may include instructions that cause the electronic device to display a preview image using the at least one camera activated based on the event through the display based on the detection when executed by the electronic device. The one or more programs may include instructions that cause the electronic device to identify an external electronic device located within the field of view (FOV) of the at least one camera while displaying the preview image when executed by the electronic device. The above one or more programs may include instructions that cause the electronic device to identify a first user input to be received regarding the external electronic device in order to establish a communication link with the external electronic device, based on the type of the external electronic device when executed by the electronic device. The above one or more programs may include instructions that cause the electronic device to identify a second user input received regarding the external electronic device using the at least one camera while displaying the preview image when executed by the electronic device.The above one or more programs may include instructions that cause the electronic device to determine, when executed by the electronic device, whether the second user input identified using the at least one camera while displaying the preview image corresponds to the first user input identified based on the type of the external electronic device. The above one or more programs may include instructions that cause the electronic device to display information guiding the first user input along with the preview image through the display, based on determining the second user input different from the first user input when executed by the electronic device. The above one or more programs may include instructions that cause the electronic device to establish the communication link with the external electronic device based on determining the second user input corresponding to the first user input when executed by the electronic device.

[0007] Figure 1 illustrates examples of user inputs received with respect to an external electronic device.

[0008] Figure 2 is a simplified block diagram of an exemplary electronic device and an external electronic device.

[0009] FIG. 3 is a flowchart illustrating exemplary operations of an electronic device for identifying the state of an electronic device capable of establishing a communication link with an external electronic device.

[0010] FIG. 4 illustrates an example of detecting events related to establishing a communication link using at least one camera.

[0011] FIG. 5 illustrates an example of identifying an external electronic device located within the field of view (FOV) of at least one camera.

[0012] FIG. 6 is a flowchart illustrating exemplary operations of an electronic device for identifying user input to be received with respect to an external electronic device in order to establish a communication link with an external electronic device based on the state of the electronic device capable of establishing a communication link with an external electronic device.

[0013] FIG. 7 illustrates an example of information guiding the state of an electronic device capable of establishing a communication link with an external electronic device.

[0014] FIG. 8 is a flowchart illustrating exemplary operations of an electronic device for displaying information to guide user input to be received regarding an external electronic device in order to establish a communication link with an external electronic device.

[0015] FIG. 9 illustrates an example of information for guiding user input to be received regarding an external electronic device in order to establish a communication link with the external electronic device.

[0016] FIG. 10 is a flowchart illustrating exemplary operations of an electronic device for displaying information to guide changes to user input to be received regarding an external electronic device in order to establish a communication link with an external electronic device.

[0017] FIG. 11 illustrates an example of information for guiding changes to user input to be received regarding an external electronic device in order to establish a communication link with an external electronic device.

[0018] FIG. 12 is a signal flow diagram between an exemplary electronic device and an external electronic device for establishing a communication link.

[0019] FIG. 13 illustrates an example of establishing a communication link with an external electronic device using an external electronic device identified using at least one camera and an advertising packet advertised from the external electronic device.

[0020] FIG. 14 is a block diagram of an electronic device in a network environment according to various embodiments.

[0021] FIG. 15 illustrates an example of a generative artificial intelligence system according to one embodiment.

[0022] Hereinafter, embodiments of the present disclosure are described in detail with reference to the drawings so that those skilled in the art can easily practice them. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein. In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and brevity.

[0023] Figure 1 illustrates examples of user inputs received with respect to an external electronic device.

[0024] Referring to FIG. 1, the electronic device (100) may be described as a device available for establishing a communication link with an external electronic device (105). For example, the electronic device (100) may be one of various types of mobile devices such as smartphones having various form factors (e.g., bar-type smartphones, foldable-type smartphones, or rollable-type smartphones), tablets, wearable devices, cellular phones, personal computers (PCs) (e.g., laptops and / or desktops), and / or other similar computing devices that include circuits (or circuitry) for establishing a communication link with the external electronic device (105).

[0025] For example, the external electronic device (105) may be composed of audio sink devices, such as earbuds or earphones, and a case device that provides space for housing said audio sink devices. For example, said case device of the external electronic device (105) may include a cradle (115). For example, said case device of the external electronic device (105) may provide a first state (110) in which at least a portion of said audio sink devices of the external electronic device (105) is exposed (e.g., the housing of said case device of the external electronic device (105) is open) by opening the cradle (115). For example, said case device of the external electronic device (105) may provide a second state (130) in which said audio sink devices are covered (e.g., the housing of said case device of the external electronic device (105) is closed) by closing the cradle (115).

[0026] For example, the electronic device (100) and the external electronic device (105) may include a communication circuit (e.g., the communication circuit (230, 235) of FIG. 2). In the first state (110), the external electronic device (105) may advertise an advertising packet (120) using the communication circuit. For example, the electronic device (100) may receive an advertised advertising packet from the external electronic device (105) using the communication circuit. For example, the electronic device (100) may receive user input to establish a communication connection with the external electronic device (105) based on receiving an advertised advertising packet from the external electronic device (105). For example, the electronic device (100) may transmit a connection request to the external electronic device (105) using a communication circuit based on user input for establishing a communication connection with the external electronic device (105). For example, the electronic device (100) may establish a communication link (125) with the external electronic device (105) based on transmitting the connection request. For example, the communication link (125) may include wireless communication based on a short-range communication network (e.g., Bluetooth, BLE (Bluetooth low energy), Wi-Fi, Wi-Fi direct, UWB (ultra-wide band), and / or IrDA (infrared data association)).

[0027] In the second state (130), the external electronic device (105) may refrain from (or stop, or not transmit) advertising packets. For example, the electronic device (100) may not be able to establish a communication link (125) with the external electronic device (105) as it does not receive advertising packets advertised from the external electronic device (105). For example, it may be required to receive user input regarding the external electronic device (105) in order for the communication link (125) to be established. For example, the user input to be received regarding the external electronic device (105) in order for the communication link (125) to be established may include user input that switches the external electronic device (105) to the first state (110) (e.g., user input that opens the cradle (115) of the external electronic device (105). For example, the user may experience inconvenience due to not knowing the user input to be received regarding the external electronic device (105) in order to establish a communication link (125). A method may be required to resolve the inconvenience caused by not recognizing that user input to be received regarding the external electronic device (105) in order to establish a communication link (125).

[0028] To resolve this inconvenience, the electronic device (100) may guide the user input to be received regarding the external electronic device (105) in order to establish a communication link (125). For example, the user input to be received regarding the external electronic device (105) in order to establish a communication link (125) may vary depending on the type of the external electronic device (105). For example, the electronic device (100) may identify the type of the external electronic device (105) in order to guide the user input to be received regarding the external electronic device (105) in order to establish a communication link (125).

[0029] The electronic device (100) may perform operations illustrated in the description of FIGS. 3 through 13 to guide user input to be received by the user regarding the external electronic device (105) in order to establish a communication link (125). The electronic device (100) may include components for performing said operations. said components may be illustrated in the description of FIG. 2.

[0030] Figure 2 is a simplified block diagram of an exemplary electronic device and an external electronic device.

[0031] Referring to FIG. 2, the electronic device (200) may be one of various types of mobile devices, such as smartphones having various form factors (e.g., bar-type smartphones, foldable-type smartphones, or rollable-type smartphones), tablets, wearable devices, cellular phones, personal computers (PCs) (e.g., laptops and / or desktops), and / or other similar computing devices. For example, the electronic device (200) may include or correspond to the electronic device (100) of FIG. 1. For example, the electronic device (200) may include at least a part of the electronic device (1401) of FIG. 14 or correspond to at least a part of the electronic device (1401) of FIG. 14. For example, the electronic device (200) may include at least one processor (210) (e.g., processor (1420) of FIG. 14), memory (220) (e.g., memory (1430) of FIG. 14), communication circuit (230) (e.g., communication module (1490) of FIG. 14), display (240) (e.g., display module (1460) of FIG. 14), and / or at least one camera (250) (e.g., camera module (1480) of FIG. 14).

[0032] At least one processor (210) may include a processing circuit. For example, at least one processor (210) may include a CPU (central processing unit) (e.g., including a processing circuit). For example, at least one processor (210) may include a GPU (graphic processing unit) (e.g., including a processing circuit) and / or a NPU (neural processing unit) (e.g., including a processing circuit). For example, at least one processor (210) may be described as an application processor. For example, at least one processor (210) may be configured to control a memory (220), a communication circuit (230), a display (240), and / or at least one camera (250). At least one processor (210) may be configured to execute instructions stored in the memory (220) individually or collectively to cause the electronic device (200) to perform at least some of the operations illustrated in the description of FIG. 1. At least one processor (210) may be configured to execute instructions stored in memory (220) to cause the electronic device (200) to perform at least some of the operations illustrated in the description of FIGS. 3 through 13.

[0033] For example, the term “processor” as used herein, including in the claims, may include various processing circuits comprising at least one processor, and one or more of said at least one processor may be configured to perform the various functions described below in a distributed manner, individually and / or collectively. As used below, where “processor,” “at least one processor,” and “one or more processors” are described as being configured to perform various functions, these terms encompass, for example, but not limited to, situations where one processor performs some of the cited functions and another processor(s) perform other parts of the cited functions, and also situations where one processor can perform all of the cited functions. Additionally, said at least one processor may include a combination of processors that perform the enumerated / disclosed various functions, for example, in a distributed manner. At least one processor may execute program instructions to achieve or perform the various functions.

[0034] The memory (220) may include one or more storage media. For example, the memory (220) may store various data used by at least one component of the electronic device (200) (e.g., at least one processor (210), communication circuit (230), display (240), and / or at least one camera (250)). For example, the data may include input data or output data for software and related commands. The memory (220) may include volatile memory or non-volatile memory.

[0035] The communication circuit (230) may include hardware components to support the transmission and / or reception of signals between the electronic device (200) and the external electronic device (205). For example, the communication circuit (230) may include at least one of a modem, an antenna, and an O / E (optic / electronic) converter. The communication circuit (230) may support wireless communication such as cellular communication. The communication circuit (230) may support the transmission and / or reception of electrical signals based on various types of protocols such as Ethernet, LAN (local area network), WAN (wide area network), Wi-Fi (wireless-fidelity), Bluetooth, BLE (Bluetooth low energy), Zigbee, LTE (long term evolution), and 5G NR (new radio). For example, the communication circuit (230) may be used to receive advertised advertising packets from the external electronic device (205). For example, the communication circuit (230) may be used to transmit a connection request to an external electronic device (205). For example, the communication circuit (230) may be used to establish a communication link with the external electronic device (205).

[0036] The display (240) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by the touch. For example, the display (240) may be configured to display an image (or preview image) and / or information. For example, the display (240) may be configured to receive user input. For example, a display (240) that supports touch functions may be referred to as a touchscreen.

[0037] At least one camera (250) may be configured to acquire an image (or preview image). For example, at least one camera (250) may include a camera located on one side of the electronic device (100) and a camera located on the other side of the electronic device (100). For example, at least one camera (250) may include a wide-angle camera, an ultrawide-angle camera, and / or a telephoto camera. For example, at least one camera (250) may have a field of view (FOV). For example, at least one camera (250) may be used to identify an external electronic device (205) contained within the field of view.

[0038] The external electronic device (205) may be one of various types of mobile devices, such as smartphones having various form factors (e.g., bar-type smartphones, foldable-type smartphones, or rollable-type smartphones), tablets, wearable devices, cellular phones, personal computers (PCs) (e.g., laptops and / or desktops), and / or other similar computing devices. For example, the external electronic device (205) may be referred to as a peripheral device, a secondary device, and / or a sub device. For example, the external electronic device (205) may include or correspond to the external electronic device (105) of FIG. 1. For example, the external electronic device (205) may include at least a part of the electronic device (1404) of FIG. 14 or correspond to at least a part of the electronic device (1404) of FIG. 14. For example, the external electronic device (105) may include at least one processor (215), memory (225), and / or communication circuit (235).

[0039] At least one processor (215) may include a processing circuit. For example, at least one processor (215) may include a CPU (central processing unit) (e.g., including a processing circuit). For example, at least one processor (215) may include a GPU (graphic processing unit) (e.g., including a processing circuit) and / or an NPU (neural processing unit) (e.g., including a processing circuit). For example, at least one processor (215) may be described as an application processor. For example, at least one processor (215) may be configured to control memory (225) and / or communication circuit (235). At least one processor (215) may be configured to execute instructions stored in memory (225) individually or collectively to cause an external electronic device (205) to perform at least some of the operations illustrated in the description of FIG. 1. At least one processor (215) may be configured to execute instructions stored in memory (225) to cause an external electronic device (205) to perform at least some of the operations illustrated in the description of FIGS. 3 through 13.

[0040] The memory (225) may include one or more storage media. For example, the memory (225) may store various data used by at least one component of the external electronic device (205) (e.g., at least one processor (215) and / or communication circuit (235)). For example, the data may include input data or output data for software and related instructions. The memory (225) may include volatile memory or non-volatile memory.

[0041] The communication circuit (235) may include hardware components to support the transmission and / or reception of signals between the electronic device (200) and the external electronic device (205). For example, the communication circuit (235) may include at least one of a modem, an antenna, and an O / E (optic / electronic) converter. The communication circuit (235) may support wireless communication such as cellular communication. The communication circuit (235) may support the transmission and / or reception of electrical signals based on various types of protocols such as Ethernet, LAN (local area network), WAN (wide area network), Wi-Fi (wireless-fidelity), Bluetooth, BLE (Bluetooth low energy), Zigbee, LTE (long term evolution), and 5G NR (new radio). For example, the communication circuit (235) may be used to advertise advertising packets. For example, the communication circuit (235) may be used to receive a connection request from the electronic device (200). For example, the communication circuit (235) may be used to establish a communication link between the electronic device (200) and an external electronic device (205).

[0042] The electronic device (200) can be connected to an external electronic device (205) via direct wireless communication (260). For example, direct wireless communication (260) may include wireless communication based on a short-range communication network (or, for example, a first network (e.g., the first network (1498) of FIG. 14) (e.g., Bluetooth, BLE (Bluetooth low energy), Wi-Fi, Wi-Fi direct, UWB (ultra-wide band), and / or IrDA (infrared data association))). For example, direct wireless communication (260) may be described as wireless communication in which the wireless signal between the electronic device (200) and the external electronic device (205) does not pass through another device (e.g., a server and / or an access point). For example, the electronic device (200) may be connected to the external electronic device (205) via direct wireless communication (260) by establishing a communication link with the external electronic device (205) using a communication circuit (230).

[0043] The electronic device (200) and external electronic device (205) illustrated in the description of FIG. 2 may perform at least some of the operations illustrated in the descriptions of FIG. 3 through 13. For example, the operations illustrated in the descriptions of FIG. 3 through 13 may be caused by (or within) the electronic device (200) (or external electronic device (205)) under the control of at least one processor (210) (or at least one processor (215)).

[0044] FIG. 3 is a flowchart illustrating exemplary operations of an electronic device for identifying the state of an electronic device capable of establishing a communication link with an external electronic device.

[0045] Referring to FIG. 3, in operation 300, at least one processor (210) can detect an event related to establishing a communication link using at least one camera (250). For example, an event related to establishing a communication link using at least one camera (250) can be described as an event related to establishing a communication link between an electronic device (200) and another electronic device (e.g., an external electronic device (205)). For example, an event related to establishing a communication link using at least one camera (250) can be detected based on receiving user input or by identifying (or scanning, or reading) a visual identifier (e.g., a QR (quick response) code) using at least one camera (250). Detecting an event related to establishing a communication link using at least one camera (250) is exemplified in the description of FIG. 4.

[0046] FIG. 4 illustrates an example of detecting events related to establishing a communication link using at least one camera.

[0047] Referring to FIG. 4, the state (400) can be described as a state in which user input (415) related to establishing a communication link using at least one camera (250) is received. In the state (400), at least one processor (210) can run (or run in the foreground) a camera application. For example, based on running the camera application, at least one processor (210) can display a user interface (UI) (405) of the camera application.

[0048] For example, the UI (405) may include an executable object (410). For example, at least one processor (210) may receive user input (415) for the executable object (410). For example, the user input (415) may include a touch input (or tap input) having a contact point on the executable object (410). For example, the user input (415) may be received via a display (240) (e.g., a touchscreen). For example, the user input (415) may be described as a user input for establishing a communication link using at least one camera (250).

[0049] For example, in operation 300 of FIG. 3, detecting an event related to establishing a communication link using at least one camera (250) may include receiving user input (415). For example, at least one processor (210) may perform operation 310 of FIG. 3 based on receiving user input (415).

[0050] A state (420) can be described as a state in which a visual identifier (e.g., QR code) (406) is identified (or scanned, or read). In a state (420), at least one processor (210) can use at least one camera (250) to identify (or scan, or read) a visual identifier (406) located within the FOV of at least one camera (250). For example, the visual identifier (406) may be created to establish a communication link between an electronic device (200) and another electronic device (e.g., an external electronic device (205)). For example, the visual identifier (406) may be set (or created) with respect to an external electronic device (205) to establish a communication link with the external electronic device (205).

[0051] For example, at least one processor (210) can detect an event related to establishing a communication link using at least one camera (250) by identifying (or scanning, or reading) a visual identifier (406). For example, at least one processor (210) can perform operation 310 of FIG. 3 based on identifying (or scanning, or reading) the visual identifier (406).

[0052] Referring again to FIG. 3, in operation 310, at least one processor (210) may execute a mode to establish a communication link with another electronic device (e.g., external electronic device (205)) using at least one camera (250) based on the detection of an event. For example, at least one processor (210) may activate at least one camera (250) to identify the other electronic device (e.g., external electronic device (205)) to which the communication link is to be established. For example, at least one processor (210) may display a preview image using at least one camera (250) activated based on the event. For example, the preview image may represent an external environment located within the FOV (e.g., FOV (505) of FIG. 5) of at least one camera (250).

[0053] For example, the external electronic device (205) may be located within the external environment of the electronic device (200). For example, at least one processor (210) may display information (e.g., text such as “Photograph the electronic device to be connected”) along with a preview image through a display (240) to change the posture of at least one camera (250) (or move the external electronic device (205)) so that the external electronic device (205) is located within the FOV of at least one camera (250) to establish a communication link. For example, at least one processor (210) may cause the user to photograph the external electronic device (205) using at least one camera (250) by displaying information to move the external electronic device (205) into the FOV of at least one camera (250).

[0054] In operation 320, at least one processor (210) can identify an external electronic device (205) located within the FOV of at least one camera (250) while displaying a preview image. For example, the external electronic device (205) may be represented within the preview image. For example, the preview image may include a visual object corresponding to the external electronic device (205). For example, at least one processor (210) may use an image analysis model to identify the external electronic device (205) located within the FOV of at least one camera (250). Identifying the external electronic device (205) located within the FOV of at least one camera (250) is illustrated in the description of FIG. 5.

[0055] FIG. 5 illustrates an example of identifying an external electronic device located within the field of view (FOV) of at least one camera.

[0056] Referring to FIG. 5, the state (500) can be described as a state in which an external electronic device (205) is located within the FOV (505) of at least one camera (250). In the state (500), at least one processor (210) can display a preview image (510) using at least one camera (250) through a display (240). For example, the preview image (510) can represent an external environment within the FOV (505) of at least one camera (250). For example, as the external electronic device (205) is located within the FOV (505) of at least one camera (250), the preview image (510) may include a visual object (515) corresponding to the external electronic device (205).

[0057] For example, at least one processor (210) can identify an external electronic device (205) located within the FOV (505) of at least one camera (250) using at least one camera (250). For example, an image analysis model may be used to identify the external electronic device (205). For example, the image analysis model may be described as a contrastive language-image pretraining (CLIP) model. For example, the image analysis model may include an object recognition model and / or an object classification model. For example, the image analysis model may include a deep learning model and / or a machine learning model. As an example, but not limited to, at least one processor (210) may identify the external electronic device (205) by extracting features of a visual object corresponding to the external electronic device (205) within a preview image. However, it is not limited thereto.

[0058] For example, at least one processor (210) may extract a visual object (515) contained within a preview image (510) and generate text describing (or explaining) the visual object (515). For example, at least one processor (210) may identify (or classify) an external electronic device (205) using the text describing (or explaining) the visual object (515). For example, at least one processor (210) may identify the type of the external electronic device (205) based on the model names of the electronic devices that have been pre-trained. For example, the type of the external electronic device (205) may include the category of the external electronic device (205) (e.g., tablet, smartphone, wearable device, laptop, and / or desktop) and / or the specific model name of the external electronic device (205).

[0059] For example, at least one processor (210) may display text (520) through a display (240) along with (or on the preview image (510) a preview image (510) indicating that a mode for establishing a communication link with an external electronic device (205) is being executed. For example, the text (520) may include the type of the external electronic device (205) (e.g., buds). For example, the text (520) may be displayed adjacent to an area where a visual object (515) corresponding to the external electronic device (205) is displayed. For example, by displaying the text (520), at least one processor (210) may inform the user that the external electronic device (205) is identified and / or inform the user that a mode for establishing a communication link with the external electronic device (205) is being executed.

[0060] Referring again to FIG. 3, in operation 330, at least one processor (210) can identify a first state of an electronic device (200) capable of establishing a communication link with an external electronic device (205) based on the type of the identified external electronic device (205). For example, the first state of an electronic device (200) capable of establishing a communication link with an external electronic device (205) may vary depending on the type of the external electronic device (205). As an example without limitation, if the external electronic device (205) is a type of electronic device that can be connected via direct wireless communication based on Bluetooth (or BLE (Bluetooth low energy)) (e.g., direct wireless communication (260) of FIG. 2), the first state of the electronic device (200) may be described as a state in which the Bluetooth function of the electronic device (200) is enabled. As a non-limiting example, if the external electronic device (205) is a type of electronic device that can be connected via direct wireless communication based on Wi-Fi (or Wi-Fi Direct), the first state of the electronic device (200) may be described as a state in which the Wi-Fi function of the electronic device (200) is enabled. However, it is not limited thereto.

[0061] In operation 340, at least one processor (210) can identify a second state of the electronic device (200) regarding the establishment of a communication link while displaying a preview image. For example, the second state of the electronic device (200) may include whether a function regarding the communication link is enabled. As an example without limitation, the second state of the electronic device (200) may be described as a state in which a function regarding Bluetooth of the electronic device (200) is enabled (or disabled) and / or a state in which a function regarding Wi-Fi is enabled (or disabled). However, it is not limited thereto.

[0062] For example, at least one processor (210) may perform operation 330 and operation 340 sequentially or simultaneously. For example, operation 340 may be performed after operation 330 is performed, or operation 330 may be performed after operation 340 is performed. For example, operation 340 may be performed while operation 330 is performed, or operation 330 may be performed while operation 340 is performed. Operations to be performed according to a first state of the electronic device (200) and a second state of the electronic device (200) are exemplified in the description of FIG. 6.

[0063] FIG. 6 is a flowchart illustrating exemplary operations of an electronic device for identifying user input to be received with respect to an external electronic device in order to establish a communication link with an external electronic device based on the state of the electronic device capable of establishing a communication link with an external electronic device.

[0064] Referring to FIG. 6, in operation 600, at least one processor (210) can identify a first state of the electronic device (200) and a second state of the electronic device (200). For example, operation 600 may correspond to operations 330 and 340 of FIG. 3.

[0065] In operation 610, at least one processor (210) can determine whether a second state of the electronic device (200) corresponds to a first state of the electronic device (200). For example, at least one processor (210) can compare the second state of the electronic device (200) identified while a preview image is displayed with the first state of the electronic device (200) identified based on the type of the external electronic device (205) to determine whether the electronic device (200) is configured to be connected to an external electronic device (205).

[0066] In operation 620, at least one processor (210) may obtain first information guiding the first state of the electronic device (200) based on determining the first state of the electronic device (200) and the second state of the other electronic device (200). For example, the first state of the electronic device (200) and the second state of the other electronic device (200) may be described as a state of the electronic device (200) in which a communication connection with an external electronic device (205) cannot be established. For example, the first state of the electronic device (200) and the second state of the other electronic device (200) may be described as a state in which the Bluetooth function (or Wi-Fi function) of the electronic device (200) is disabled.

[0067] For example, the first information may guide the activation of a Bluetooth function (or a Wi-Fi function) of the electronic device (200). For example, the first information may include text, images, and / or videos. For example, at least one processor (210) may obtain the first information using a trained model. For example, the trained model may include a machine learning model, a deep learning model, and / or a generative AI (artificial intelligence) model. For example, the trained model may correspond to the generative AI model (1530) of FIG. 15. For example, at least one processor (210) may generate a prompt for obtaining the first information based on determining a first state of the electronic device (200) and a second state of another electronic device (200). For example, the prompt may include text requesting the first information (e.g., text such as “Generate an image that guides Bluetooth activation”). For example, at least one processor (210) can obtain the first information by providing (or inputting) the prompt to the trained model.

[0068] According to another embodiment, at least one processor (210) can identify first information corresponding to a first state of an electronic device (200) among the information stored in memory (220). For example, at least one processor (210) can retrieve first information guiding the first state of an electronic device (200) stored in memory (220) based on determining a second state of an electronic device (200) different from the first state of the electronic device (200).

[0069] In operation 630, at least one processor (210) may display the first information through the display (240). For example, at least one processor (210) may display the first information together with a preview image or on the preview image. Displaying the first information is exemplified in the description of FIG. 7.

[0070] FIG. 7 illustrates an example of information guiding the state of an electronic device capable of establishing a communication link with an external electronic device.

[0071] Referring to FIG. 7, the state (700) can be described as a state in which a first state of the electronic device (200) and a second state of the electronic device (200) are determined. In the state (700), at least one processor (210) can obtain first information (705) that guides the first state of the electronic device (200) based on determining the first state of the electronic device (200) and the second state of the electronic device (200).

[0072] For example, the first information (705) may include an indicator (710) that guides user input for displaying a quick panel screen. For example, the quick panel screen may be displayed based on a drag input on a status bar (or top bar). For example, the indicator (710) may have a shape (e.g., an arrow shape) that indicates the direction of the drag input to guide user input (e.g., a drag input) for displaying the quick panel screen. For example, the quick panel screen may include a plurality of executable objects (or buttons, or icons). For example, the first information (705) may include an indicator (715) that indicates an executable object among the plurality of executable objects regarding the establishment of a communication link with an external electronic device (205) (e.g., an executable object for Bluetooth settings and / or an executable object for Wi-Fi settings).

[0073] For example, at least one processor (210) may display first information (705) through a display (240). For example, at least one processor (210) may display text (720) that guides the first state of the electronic device (200) along with the first information (705) (e.g., text such as “Please pull down the top quick panel to turn on Bluetooth mode as in the guide.”). For example, at least one processor (210) may guide the first state of the electronic device (200) to establish a communication link with an external electronic device (205) by displaying the first information (705) (and / or text (720)). For example, at least one processor (210) may cause the user to perform user input to change (or switch) the second state of the electronic device (200) to the first state of the electronic device (200) by displaying the first information (705).

[0074] For example, at least one processor (210) may receive user input directed by an indicator (710) (e.g., drag input on a status bar). For example, user input directed by the indicator (710) may include receiving a touch input having a contact point on the status bar, receiving a drag input in a downward direction, and releasing the touch input. For example, user input directed by the indicator (710) may be received via a display (240) (e.g., a touchscreen). For example, at least one processor (210) may display a quick panel screen via the display (240) based on user input directed by the indicator (710). For example, while displaying the quick panel screen, at least one processor (210) may receive user input directed by the indicator (715) (e.g., touch input on an object for Bluetooth settings and / or touch input on an object for Wi-Fi settings). For example, user input indicated by the indicator (715) may include a touch input (or tap input) having a contact point on an executable object for Bluetooth settings (or an executable object for Wi-Fi settings). For example, user input indicated by the indicator (715) may be received through a display (240) (e.g., a touchscreen).

[0075] For example, at least one processor (210) can activate a Bluetooth function (or Wi-Fi function) of the electronic device (200) based on user input indicated by the indicator (715). For example, at least one processor (210) can switch a second state of the electronic device (200) to a first state of the electronic device (200) capable of establishing a communication link with an external electronic device (205) based on user input indicated by the indicator (715). For example, the electronic device (200) can switch to a first state capable of establishing a communication link with an external electronic device (205) by the user performing user input according to the first information (705). For example, at least one processor (210) can perform operation 640 based on the switched first state of the electronic device (200).

[0076] Referring again to FIG. 6, in operation 640, at least one processor (210) can determine a second state of the electronic device (200) corresponding to a first state of the electronic device (200). For example, the second state of the electronic device (200) corresponding to the first state of the electronic device (200) can be described as a state of the electronic device (200) capable of establishing a communication connection with an external electronic device (205). For example, the second state of the electronic device (200) corresponding to the first state of the electronic device (200) can be described as a state in which a Bluetooth function (or a Wi-Fi function) of the electronic device (200) is enabled. For example, within the second state of the electronic device (200) corresponding to the first state of the electronic device (200), it may not be required to change the state (or setting) of the electronic device (200) in order to establish a communication connection with an external electronic device (205).

[0077] For example, at least one processor (210) may identify a first user input to be received regarding the external electronic device (205) to establish a communication link with the external electronic device (205) based on the type of the external electronic device (205). For example, the first user input may be described as a user input that causes the external electronic device (205) to execute an advertising mode. For example, the external electronic device (205) may advertise an advertising packet using the communication circuit (235) based on receiving the first user input. For example, the first user input may vary depending on the type of the external electronic device (205). For example, the first user input may be predetermined based on the type of the external electronic device (205), or may be identified by providing (or inputting) the identified type of the external electronic device (205) to a trained model.

[0078] In a non-limiting example, where the external electronic device (205) is composed of audio sink devices such as earbuds or earphones and a case device that provides space for housing said audio sink devices, the first user input may be described as an input to open the cradle of the external electronic device (205) (e.g., the cradle (115) of FIG. 1) to open the housing of the case device of the external electronic device (205). In a non-limiting example, where the external electronic device (205) is composed of an electronic device wearable by the user, such as a smartwatch, the first user input may be described as an input to press a button included on the lateral side of the external electronic device (205). However, it is not limited thereto.

[0079] In operation 650, at least one processor (210) can identify a second user input received with respect to an external electronic device (205) using at least one camera (250) while a preview image is displayed. For example, the second user input may include a user gesture performed with respect to the external electronic device (205). For example, at least one camera (250) may include a first camera (e.g., a rear camera) positioned facing a first direction on one side of the electronic device (200) and a second camera (e.g., a front camera) positioned facing a second direction opposite to the first direction on the other side of the electronic device (200). For example, at least one processor (210) can identify the external electronic device (205) and a part of the user's body using the first camera and / or the second camera. For example, at least one processor (210) can identify a second user input received with respect to an external electronic device (205) using a first camera and / or a second camera.

[0080] In a non-limiting example, where the external electronic device (205) is composed of audio sink devices such as earbuds or earphones and a case device that provides space for housing said audio sink devices, the second user input may be described as an input to open the cradle of the external electronic device (205) to open the housing of the case device of the external electronic device (205) and / or an input to close the cradle of the external electronic device (205) to close the housing of the case device of the external electronic device (205). In a non-limiting example, where the external electronic device (205) is composed of an electronic device wearable by the user such as a smartwatch, the second user input may be described as an input to press a button included on the side of the external electronic device (205) and / or an input to press another button included on the side of the external electronic device (205). However, it is not limited thereto.

[0081] For example, the second user input may be identified based on an external electronic device (205) and / or a part of the user's body located within the FOV of at least one camera (250). For example, the external electronic device (205) and / or a part of the user's body located within the FOV of at least one camera (250) may be represented in a preview image. For example, an image analysis model may be used to identify the second user input. For example, at least one processor (210) may extract a visual object corresponding to the external electronic device (205) and / or a visual object corresponding to a part of the user's body from the preview image, and generate text that describes (or explains) the visual object corresponding to the external electronic device (205) and / or a part of the user's body. For example, at least one processor (210) may identify the second user input received regarding the external electronic device (205) based on the generated text.

[0082] For example, at least one processor (210) may perform operation 640 and operation 650 sequentially or simultaneously. For example, operation 650 may be performed after operation 640 is performed, or operation 640 may be performed after operation 650 is performed. For example, operation 650 may be performed while operation 640 is performed, or operation 640 may be performed while operation 650 is performed. The operations to be performed according to the first user input and the second user input are exemplified in the description of FIG. 8.

[0083] FIG. 8 is a flowchart illustrating exemplary operations of an electronic device for displaying information to guide user input to be received regarding an external electronic device in order to establish a communication link with an external electronic device.

[0084] Referring to FIG. 8, in operation 800, at least one processor (210) can identify a first user input identified based on the type of external electronic device (205) and a second user input identified while displaying a preview image. For example, operation 800 may correspond to operations 630 and 640 of FIG. 6.

[0085] In operation 810, at least one processor (210) can determine whether the second user input corresponds to the first user input. For example, at least one processor (210) can compare the second user input with the first user input to determine whether the external electronic device (205) is required to receive the user input in order to be connected to the electronic device (200). For example, at least one processor (210) can determine whether the second user input corresponds to the first user input by comparing a preview image representing the second user input with the first user input, or by comparing text describing (or depicting) the preview image representing the second user input with the first user input.

[0086] In operation 820, at least one processor (210) may establish a communication link with an external electronic device (205) based on determining a second user input corresponding to a first user input. For example, the second user input corresponding to the first user input may be described as a user input that causes the external electronic device (205) to execute an advertise mode. By example, without limitation, the second user input corresponding to the first user input may include an input to open the cradle of the external electronic device (205) to open the housing of the case device of the external electronic device (205) and / or an input to press a button included on the side of the external electronic device (205). Establishing a communication link with the external electronic device (205) will be illustrated in the description of FIG. 12.

[0087] In operation 830, at least one processor (210) may obtain second information guiding the first user input based on determining a second user input different from the first user input. For example, the second user input different from the first user input may be distinguished from a user input for executing an advertise mode of the external electronic device (205). As an example, but not limited to, the second user input different from the first user input may include an input to close the cradle of the external electronic device (205) to close the housing of the case device of the external electronic device (205) and / or an input to press another button included on the side of the external electronic device (205). However, it is not limited thereto.

[0088] For example, the second information may guide the execution of the advertising mode of the external electronic device (205). As an example, without limitation, the second information may guide user input to open the cradle of the external electronic device (205) to open the housing of the case device of the external electronic device (205), or guide user input to press a button included on the side of the external electronic device (205). However, it is not limited thereto. For example, the second information may include text, images, and / or video. For example, at least one processor (210) may obtain the second information using a trained model. For example, the trained model may include a machine learning model, a deep learning model, and / or a generative AI model. For example, the trained model may correspond to the generative AI model (1530) of FIG. 15.

[0089] For example, at least one processor (210) may generate a prompt for obtaining second information based on determining a second user input different from a first user input. For example, the prompt for obtaining second information may indicate the type of external electronic device (205), the first user input, and / or the second user input. For example, the prompt for obtaining second information may include text requesting second information (e.g., text such as “Generate an image guiding how to open the Buds cradle”). For example, at least one processor (210) may obtain second information by providing (or inputting) the prompt for obtaining second information to a trained model.

[0090] In operation 840, at least one processor (210) may display second information along with a preview image through a display (240). For example, at least one processor (210) may display the second information and the preview image simultaneously in a split view, or may display the second information superimposed on the preview image. Displaying the second information is exemplified in the description of FIG. 9.

[0091] FIG. 9 illustrates an example of information for guiding user input to be received regarding an external electronic device in order to establish a communication link with the external electronic device.

[0092] Referring to FIG. 9, the state (900) may be described as a state in which a second user input different from the first user input is received with respect to an external electronic device (205). In the state (900), at least one processor (210) may obtain second information (905) that guides the first user input based on determining the second user input different from the first user input. For example, the second information (905) may include a visual object (915) having the shape of the external electronic device (205) in the state in which the first user input is received (e.g., the shape of the external electronic device (205) with the cradle of the external electronic device (205) open). For example, the second information (905) may include an indicator (920) that guides the first user input. For example, the indicator (920) may have a shape (e.g., an arrow shape) indicating a first user input to be received with respect to an external electronic device (205).

[0093] For example, at least one processor (210) can display the second information (905) through the display (240). For example, at least one processor (210) can simultaneously display the second information (905) and a preview image in a split view. For example, at least one processor (210) can display the second information (905) superimposed on the preview image.

[0094] According to another embodiment, an electronic device (200), which is a foldable type smartphone, may include a first housing part, a second housing part, and a flexible display. For example, the flexible display may include a display area configured to be partially bent according to a second housing part that is rotated relative to the first housing part. For example, the flexible display may be disposed within the first housing part and the second housing part. For example, at least one processor (210) may display second information (905) through a display area of ​​a flexible display disposed within the second housing part while displaying a preview image through a display area of ​​a flexible display disposed within the first housing part. For example, at least one processor (210) may display second information (905) through a display area of ​​a flexible display disposed within the first housing part while displaying a preview image through a display area of ​​a flexible display disposed within the second housing part.

[0095] For example, an indicator (920) may be displayed alongside (or adjacent to) a visual object (915). For example, at least one processor (210) may display text (910) that guides the first user input along with the second information (905) (e.g., text such as “Please open the Buzz Cradle as instructed.”). For example, at least one processor (210) may guide the first user input to be received regarding the external electronic device (205) to establish a communication link with the external electronic device (205) by displaying the second information (905) (and / or text (910)). For example, at least one processor (210) may cause the user to perform the first user input regarding the external electronic device (205) by displaying the second information (905). For example, even if the user does not know the first user input, the user can perform the first user input according to the second information (905).

[0096] For example, while the second information (905) is displayed, the external electronic device (205) may receive a first user input guided by the second information (905) (e.g., an input to open the cradle of the external electronic device (205). For example, the external electronic device (205) may execute an advertising mode based on the first user input. For example, at least one processor (210) may perform operation 820 of FIG. 8 based on identifying the first user input received regarding the external electronic device.

[0097] According to another embodiment, at least one processor (215) of an external electronic device (205) may advertise or broadcast a preset (or predetermined) signal based on being turned on in an initial setting state (or OOTB (out of the box) state) using a communication circuit (235). For example, the preset (or predetermined) signal may include information indicating the type of the external electronic device (205). For example, at least one processor (210) may receive the advertised (or broadcast) signal from the external electronic device (205) using a communication circuit (230). For example, at least one processor (210) may, based on receiving the signal from the external electronic device (205), use the display (240) to display a notification (or pop-up notification) inquiring whether to display information guiding the establishment of a communication link with the external electronic device (205).

[0098] For example, at least one processor (210) may identify a first user input to be received by an external electronic device (205) to establish a communication link with the external electronic device (205) according to the type of external electronic device (205) indicated by the signal, based on input for the notification. For example, at least one processor (210) may generate second information (905) guiding the first user input within the electronic device (200) or receive it from a server using a communication circuit (230). For example, at least one processor (210) may display the second information (905) and an indicator (920) using a display (230). For example, at least one processor (210) may guide the user to perform the first user input regarding the external electronic device (205) by displaying the second information (905) and an indicator (920) using a display (230).

[0099] For example, while the second information (905) is displayed, the external electronic device (205) may receive a third user input different from the first user input. For example, based on determining the third user input different from the first user input received with respect to the external electronic device (205) despite the second information (905) guiding the first user input being displayed, at least one processor (210) may guide the third user input to change to the first user input. Guiding to change to the first user input is exemplified in the description of FIG. 10.

[0100] FIG. 10 is a flowchart illustrating exemplary operations of an electronic device for displaying information to guide changes to user input to be received regarding an external electronic device in order to establish a communication link with an external electronic device.

[0101] Referring to FIG. 10, in operation 1000, at least one processor (210) can identify a third user input received with respect to an external electronic device (205) while displaying second information. For example, the third user input may be described as a user input received with respect to an external electronic device (205) after the second user input with respect to the external electronic device (205) has been received. For example, the third user input may be described as a user input performed by the user with respect to the external electronic device (205) after viewing the second information. For example, the third user input and the identification of the third user input may be referred to as operation 650 of FIG. 6.

[0102] In operation 1010, at least one processor (210) can determine whether the third user input corresponds to the first user input. For example, operation 1010 may refer to operation 810 of FIG. 8.

[0103] In operation 1020, at least one processor (210) may establish a communication link with an external electronic device (205) based on determining a third user input corresponding to a first user input. For example, the third user input corresponding to the first user input may be described as a user input that causes the external electronic device (205) to execute an advertise mode. For example, operation 1020 may refer to operation 820 of FIG. 8. Establishing a communication link with the external electronic device (205) will be exemplified in the description of FIG. 12.

[0104] In operation 1030, at least one processor (210) may obtain third information that guides a change to the first user input based on determining a third user input different from the first user input. For example, the third user input different from the first user input may be distinguished from a user input for executing the advertise mode of the external electronic device (205). As an example, but not limited to, the third user input different from the first user input may include an input to close the cradle of the external electronic device (205) to close the housing of the case device of the external electronic device (205) and / or an input to press another button included on the side of the external electronic device (205). However, it is not limited thereto.

[0105] For example, the third information may guide a change from the third user input to the first user input to execute the advertising mode of the external electronic device (205). As a non-limiting example, the third information may guide a change from a user input pressing another button included on the side of the external electronic device (205) to a user input pressing a button included on the side of the external electronic device (205). However, it is not limited thereto. For example, the third information may include text, images, and / or video. For example, at least one processor (210) may acquire the third information using a trained model.

[0106] For example, at least one processor (210) may generate a prompt for obtaining third information based on determining a third user input different from a first user input. For example, the prompt for obtaining third information may indicate the type of external electronic device (205), the first user input, and / or the third user input. For example, the prompt for obtaining third information may include text requesting third information (e.g., text such as “Generate an image guiding the pressing of the top button, not the bottom button of the watch”). For example, at least one processor (210) may obtain third information by providing (or inputting) the prompt for obtaining third information to a trained model.

[0107] In operation 1040, at least one processor (210) may display third information along with a preview image through a display (240). For example, at least one processor (210) may display the third information and the preview image simultaneously in a split view, or may display the third information superimposed on the preview image. Displaying the third information is exemplified in the description of FIG. 11.

[0108] FIG. 11 illustrates an example of information for guiding changes to user input to be received regarding an external electronic device in order to establish a communication link with an external electronic device.

[0109] Referring to FIG. 11, the state (1100) may be described as a state in which a third user input, different from the first user input, is received with respect to an external electronic device (205). For example, the external electronic device (205) may be described as an electronic device wearable by a user, such as a smart watch. For example, a side of the external electronic device (205) may include a button (1105) and another button (1110). In the state (1100), the external electronic device (205) may receive a third user input pressing the other button (1110).

[0110] For example, at least one processor (210) can identify a third user input received regarding an external electronic device (205) located within the FOV (505) of at least one camera (250) while displaying the second information using at least one camera (250). For example, identifying the third user input may refer to operation 650 of FIG. 6.

[0111] For example, a first user input to be received with respect to an external electronic device (205) to establish a communication link with the external electronic device (205) may be defined as an input pressing a button (1105) of the external electronic device (205). For example, a third user input pressing another button (1110) of the external electronic device (205) may be different from the first user input pressing a button (1105) of the external electronic device (205). For example, at least one processor (210) may determine whether the third user input corresponds to the first user input by comparing the third user input with the first user input. For example, at least one processor (210) may obtain third information (1115) that guides a change to the first user input based on determining the third user input which is different from the first user input.

[0112] For example, the third information (1115) may include a visual object (1120) corresponding to the external electronic device (205). For example, the third information (1115) may include an indicator (1125) that guides a change from a third user input (e.g., user input pressing another button (1110) of the external electronic device (205)) to a first user input (e.g., user input pressing a button (1105) of the external electronic device (205). For example, the indicator (1125) may have a shape (e.g., an arrow shape) that indicates a change from the third user input to the first user input.

[0113] For example, at least one processor (210) can display the third information (1115) through the display (240). For example, at least one processor (210) can simultaneously display the third information (1115) and the preview image as a split view. For example, at least one processor (210) can display the third information (1115) superimposed on the preview image.

[0114] According to another embodiment, the electronic device (200) may be a foldable type smartphone. For example, at least one processor (210) may display third information (1115) through a display area of ​​a flexible display placed in a second housing part while displaying a preview image through a display area of ​​a flexible display placed in a first housing part. For example, at least one processor (210) may display third information (1115) through a display area of ​​a flexible display placed in a first housing part while displaying a preview image through a display area of ​​a flexible display placed in a second housing part.

[0115] For example, an indicator (1125) may be displayed alongside (or adjacent to) a visual object (1120). For example, at least one processor (210) may display text (1130) that guides a change from a third user input to a first user input, along with third information (1115) (e.g., text such as “Please press the top button, not the bottom button, as in the guide.”). For example, at least one processor (210) may guide a first user input (e.g., a user input pressing a button (1105) of the external electronic device (205) to be received regarding the external electronic device (205) in order to establish a communication link with the external electronic device (205) by displaying the third information (1115) (and / or text (1130)). For example, at least one processor (210) may cause the user to perform a first user input rather than a third user input regarding the external electronic device (205) by displaying the third information (1115). For example, the user may stop performing the third user input and perform the first user input in accordance with the third information (1115). For example, at least one processor (210) may provide real-time feedback to the user on how to establish a communication link with the external electronic device (205) by displaying the third information (1115).

[0116] For example, while the third information (1115) is being displayed, the external electronic device (205) may receive a first user input guided by the third information (1115). For example, the external electronic device (205) may execute an advertising mode based on the first user input. For example, at least one processor (210) may perform the operation 1020 of FIG. 10 based on identifying the first user input received with respect to the external electronic device (205). Establishing a communication connection with the external electronic device (205) is illustrated in the description of FIG. 12.

[0117] FIG. 12 is a signal flow diagram between an exemplary electronic device and an external electronic device for establishing a communication link.

[0118] Referring to FIG. 12, in operation 1200, at least one processor (215) of an external electronic device (205) can advertise an advertising packet using a communication circuit (235) based on receiving a first user input. For example, the first user input may be received while a preview image is displayed through the display (240) of the electronic device (200) (or while second information (or third information) is displayed through the display (240) of the electronic device (200). For example, at least one processor (210) can receive an advertised advertising packet from the external electronic device (205) using a communication circuit (230). For example, the advertising packet may indicate a first time point in time when the advertising packet was advertised. For example, the advertising packet may indicate the type of the external electronic device (205).

[0119] In operation 1210, at least one processor (210) can identify an external electronic device (205) using a received advertising packet. For example, at least one processor (210) can identify a second time point when a first user input is received regarding an external electronic device (205) using at least one camera (250). For example, at least one processor (210) can identify whether the external electronic device (205) that advertised the advertising packet corresponds to the external electronic device (205) identified using at least one camera (250) by comparing the second time point when the first user input is received regarding an external electronic device (205) identified using at least one camera (250) with the first time point when the advertising packet indicated by the received advertising packet is advertised. For example, at least one processor (210) can determine whether the external electronic device (205) that advertised the advertising packet corresponds to the external electronic device (205) identified using at least one camera (250) by comparing the type of external electronic device (205) identified using at least one camera (250) with the type of external electronic device (205) indicated by the advertising packet.

[0120] For example, at least one processor (210) may display a user interface (UI) through a display (240) to inquire whether to establish a communication connection with the external electronic device (205) that advertised the advertising packet (1310), based on the external electronic device (205) that advertised the advertising packet and the external electronic device (205) identified using at least one camera (250) different from the external electronic device (205). For example, at least one processor (210) may determine the external electronic device (205) identified using at least one camera (250) corresponding to the external electronic device (205) that advertised the advertising packet.

[0121] In operation 1220, at least one processor (210) may bypass (or refrain from, or stop, or not perform the inquiry) whether to establish a communication connection with the external electronic device (205) that advertised the advertising packet (1310), based on determining the external electronic device (205) identified using at least one camera (250) corresponding to the external electronic device (205) that advertised the advertising packet, and may transmit a connection request to the external electronic device (205) using a communication circuit (230). For example, at least one processor (215) may receive a connection request from the electronic device (200) using a communication circuit (235). For example, the external electronic device (205) identified using at least one camera (250) may be described as an electronic device with which a user intends to establish a communication link with the electronic device (200). For example, if the external electronic device (205) that advertised the advertising packet corresponds to the external electronic device (205) identified using at least one camera (250), the external electronic device (205) that advertised the advertising packet can be described as an electronic device with which the user intends to establish a communication link with the electronic device (200), so it may not be necessary to inquire whether to establish a communication connection with the external electronic device (205) that advertised the advertising packet.

[0122] In operation 1230, at least one processor (210) may establish a communication link with an external electronic device (205) based on transmitting a connection request to the external electronic device (205). Establishing a communication link with the external electronic device (205) is exemplified in the description of FIG. 13.

[0123] FIG. 13 illustrates an example of establishing a communication link with an external electronic device using an external electronic device identified using at least one camera and an advertising packet advertised from the external electronic device.

[0124] Referring to FIG. 13, a state (1300) may be described as a state in which a first user input (1305) is received with respect to an external electronic device (205). In the state (1300), while a second information (905) guiding the first user input (1305) (or a third information guiding a change to the first user input (1305)) is displayed, at least one processor (215) may receive the first user input (1305). In FIG. 13, only the first user input (1305) being received with respect to the external electronic device (205) while the second information (905) (or the third information) is displayed is illustrated, but the first user input (1305) may be received while a preview image is displayed. For example, at least one processor (215) can advertise an advertising packet (1310) using a communication circuit (235) based on a first user input (1305). For example, at least one processor (210) can receive an advertising packet (1310) using a communication circuit (230).

[0125] For example, the advertising packet (1310) may indicate a first time point in which the advertising packet (1310) is advertised, or may include information about the first time point. For example, at least one processor (210) may use at least one camera (250) to identify a first user input (1305) received regarding an external electronic device (205) located within the FOV (505) of at least one camera (250). For example, as the at least one processor (210) identifies the first user input (1305) received regarding the external electronic device (205), it may identify a second time point in which the first user input (1305) is received by the external electronic device (205). For example, at least one processor (210) may determine whether the second time point corresponds to the first time point by comparing the first time point with the second time point.

[0126] For example, at least one processor (210) can determine an external electronic device (205) identified using at least one camera (250) different from the external electronic device (205) that advertised the advertising packet (1310) based on a second time point different from the first time point. For example, based on determining an external electronic device (205) identified using at least one camera (250) different from the external electronic device (205) that advertised the advertising packet (1310), at least one processor (210) can display a UI through a display (240) to inquire whether to establish a communication connection with the external electronic device (205) that advertised the advertising packet (1310).

[0127] For example, at least one processor (210) may determine an external electronic device (205) identified using at least one camera (250) corresponding to an external electronic device (205) that advertised the advertising packet (1310), based on a second time point corresponding to a first time point. For example, at least one processor (210) may bypass (or refrain from, or stop, or not perform the inquiry) asking whether to establish a communication connection with the external electronic device (205) that advertised the advertising packet (1310), and may transmit a connection request to the external electronic device (205) using a communication circuit (230). For example, at least one processor (215) may receive a connection request from the electronic device (200) using a communication circuit (235). For example, at least one processor (210) can establish a communication link with an external electronic device (205) based on transmitting a connection request to the external electronic device (205).

[0128] For example, the advertising packet (1310) may indicate the type of external electronic device (205) to which the advertising packet (1310) is advertised, or may include information about the type of external electronic device (205). For example, at least one processor (210) may use at least one camera (250) to identify a first user input (1305) received regarding an external electronic device (205) located within the FOV (505) of at least one camera (250). For example, at least one processor (210) may identify the type of external electronic device (205) to which the first user input (1305) was received. For example, at least one processor (210) can determine whether the type of external electronic device (205) identified using at least one camera (250) corresponds to the type of external electronic device (205) indicated by the advertising packet (1310) by comparing the type of external electronic device (205) indicated by the advertising packet (1310) with the type of external electronic device (205) identified using at least one camera (250).

[0129] For example, at least one processor (210) can determine the external electronic device (205) that advertised the advertising packet (1310) and the external electronic device (205) identified using at least one camera (250) different from the type of external electronic device (205) indicated by the advertising packet (1310). For example, based on determining the external electronic device (205) that advertised the advertising packet (1310) and the external electronic device (205) identified using at least one camera (250) different from the external electronic device (205) that advertised the advertising packet (1310), the at least one processor (210) can display a UI through a display (240) to inquire whether to establish a communication connection with the external electronic device (205) that advertised the advertising packet (1310).

[0130] For example, at least one processor (210) can determine an external electronic device (205) identified using at least one camera (250) corresponding to the external electronic device (205) that advertised the advertising packet (1310), based on the type of external electronic device (205) identified using at least one camera (250) corresponding to the type of external electronic device (205) indicated by the advertising packet (1310). For example, at least one processor (210) can bypass (or refrain from, or stop, or not perform the inquiry) asking whether to establish a communication connection with the external electronic device (205) that advertised the advertising packet (1310), and can transmit a connection request to the external electronic device (205) using the communication circuit (230). For example, at least one processor (215) can receive a connection request from an electronic device (200) using a communication circuit (235). For example, at least one processor (210) can establish a communication link with an external electronic device (205) based on transmitting a connection request to an external electronic device (205).

[0131] For example, if the external electronic device (205) that advertised the advertising packet corresponds to the external electronic device (205) identified using at least one camera (250), the external electronic device (205) that advertised the advertising packet can be described as an electronic device with which the user intends to establish a communication link with the electronic device (200), so it may not be necessary to inquire whether to establish a communication connection with the external electronic device (205) that advertised the advertising packet.

[0132] FIG. 14 is a block diagram of an electronic device in a network environment according to various embodiments.

[0133] Referring to FIG. 14, in a network environment (1400), an electronic device (1401) may communicate with an electronic device (1402) through a first network (1498) (e.g., a short-range wireless communication network) or with at least one of an electronic device (1404) or a server (1408) through a second network (1499) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (1401) may communicate with the electronic device (1404) through a server (1408). According to one embodiment, the electronic device (1401) may include a processor (1420), memory (1430), input module (1450), sound output module (1455), display module (1460), audio module (1470), sensor module (1476), interface (1477), connection terminal (1478), haptic module (1479), camera module (1480), power management module (1488), battery (1489), communication module (1490), subscriber identification module (1496), or antenna module (1497). In some embodiments, at least one of these components (e.g., connection terminal (1478)) may be omitted from the electronic device (1401), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (1476), camera module (1480), or antenna module (1497)) may be integrated into a single component (e.g., display module (1460)).

[0134] The processor (1420) can, for example, execute software (e.g., program (1440)) to control at least one other component (e.g., hardware or software component) of the electronic device (1401) connected to the processor (1420) and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (1420) can store commands or data received from other components (e.g., sensor module (1476) or communication module (1490)) in volatile memory (1432), process the commands or data stored in volatile memory (1432), and store the resulting data in non-volatile memory (1434). According to one embodiment, the processor (1420) may include a main processor (1421) (e.g., a central processing unit or an application processor) or an auxiliary processor (1423) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (1401) includes a main processor (1421) and an auxiliary processor (1423), the auxiliary processor (1423) may be configured to use less power than the main processor (1421) or to be specialized for a specified function. The auxiliary processor (1423) may be implemented separately from the main processor (1421) or as part thereof.

[0135] The auxiliary processor (1423) may control at least some of the functions or states associated with at least one component of the electronic device (1401) (e.g., display module (1460), sensor module (1476), or communication module (1490)) on behalf of the main processor (1421) while the main processor (1421) is in an inactive (e.g., sleep) state, or together with the main processor (1421) while the main processor (1421) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (1423) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (1480) or communication module (1490)). According to one embodiment, the auxiliary processor (1423) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (1401) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (1408)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0136] The memory (1430) can store various data used by at least one component of the electronic device (1401) (e.g., processor (1420) or sensor module (1476)). The data may include, for example, input data or output data for software (e.g., program (1440)) and related commands. The memory (1430) may include volatile memory (1432) or non-volatile memory (1434).

[0137] The program (1440) may be stored as software in memory (1430) and may include, for example, an operating system (1442), middleware (1444), or an application (1446).

[0138] The input module (1450) can receive commands or data to be used for a component of the electronic device (1401) (e.g., processor (1420)) from outside the electronic device (1401) (e.g., user). The input module (1450) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0139] The sound output module (1455) can output a sound signal to the outside of the electronic device (1401). The sound output module (1455) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0140] The display module (1460) can visually provide information to an external (e.g., user) of the electronic device (1401). The display module (1460) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (1460) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0141] The audio module (1470) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (1470) can acquire sound through the input module (1450) or output sound through the sound output module (1455) or an external electronic device (e.g., electronic device (1402)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (1401).

[0142] The sensor module (1476) can detect the operating state of the electronic device (1401) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (1476) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0143] The interface (1477) may support one or more specified protocols that can be used for the electronic device (1401) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (1402)). According to one embodiment, the interface (1477) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0144] The connection terminal (1478) may include a connector through which the electronic device (1401) can be physically connected to an external electronic device (e.g., electronic device (1402)). According to one embodiment, the connection terminal (1478) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0145] The haptic module (1479) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (1479) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0146] The camera module (1480) can capture still images and video. According to one embodiment, the camera module (1480) may include one or more lenses, image sensors, image signal processors, or flashes.

[0147] The power management module (1488) can manage the power supplied to the electronic device (1401). According to one embodiment, the power management module (1488) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0148] The battery (1489) can supply power to at least one component of the electronic device (1401). According to one embodiment, the battery (1489) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0149] The communication module (1490) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (1401) and an external electronic device (e.g., electronic device (1402), electronic device (1404), or server (1408)), and the performance of communication through the established communication channel. The communication module (1490) may include one or more communication processors that operate independently of the processor (1420) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (1490) may include a wireless communication module (1492) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (1494) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (1404) through a first network (1498) (e.g., a short-range communication network such as Bluetooth, Wi-Fi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (1499) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (1492) can identify or authenticate the electronic device (1401) within a communication network such as the first network (1498) or the second network (1499) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (1496).

[0150] The wireless communication module (1492) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (1492) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (1492) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beamforming, or large-scale antenna. The wireless communication module (1492) can support various requirements specified in the electronic device (1401), external electronic device (e.g., electronic device (1404)), or network system (e.g., second network (1499)). According to one embodiment, the wireless communication module (1492) can support a Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mMTC, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for realizing URLLC.

[0151] An antenna module (1497) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (1497) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (1497) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (1498) or a second network (1499), may be selected from the plurality of antennas, for example, by a communication module (1490). A signal or power may be transmitted or received between the communication module (1490) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (1497).

[0152] According to various embodiments, the antenna module (1497) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0153] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0154] According to one embodiment, commands or data may be transmitted or received between the electronic device (1401) and an external electronic device (1404) through a server (1408) connected to a second network (1499). Each of the external electronic devices (1402, or 1404) may be the same or a different type of device as the electronic device (1401). According to one embodiment, all or part of the operations performed on the electronic device (1401) may be performed on one or more of the external electronic devices (1402, 1404, or 1408). For example, if the electronic device (1401) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (1401) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (1401). The electronic device (1401) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (1401) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (1404) may include an Internet of Things (IoT) device. The server (1408) may be an intelligent server using machine learning and / or neural networks.According to one embodiment, an external electronic device (1404) or server (1408) may be included within the second network (1499). The electronic device (1401) may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0155] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0156] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0157] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0158] Various embodiments of the present document may be implemented as software (e.g., program (1440)) comprising one or more instructions stored in a storage medium (e.g., internal memory (1436) or external memory (1438)) readable by a machine (e.g., electronic device (1401)). For example, a processor (e.g., processor (1420)) of the machine (e.g., electronic device (1401)) may call at least one of the one or more instructions stored from the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-transient' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and this term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0159] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0160] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0161] Figure 15 is a schematic diagram of an exemplary AI system.

[0162] Referring to FIG. 15, the AI ​​system (1500) may include an input / output interface (1510), an AI framework (1520), a generative AI model (1530), and / or a knowledge repository (1590).

[0163] The input / output interface (1510) can receive input. The input may include user input and / or data obtained or generated by an electronic device (e.g., the electronic device (200) or electronic device (1401) described above). The above data may include images, videos, and / or sensor data generated by at least one processor of the electronic device (e.g., at least one processor (210) or processor (1450)) (e.g., illumination data around the electronic device obtained from a sensor or sensor hub (e.g., auxiliary processor (1423), posture data (or orientation data) of the electronic device, temperature inside the electronic device (e.g., temperature of the display (240) or at least one processor (210)), size information of the display area of ​​the display (240), and / or images obtained through an image sensor of the electronic device (e.g., included in the camera module (1480)). The user input may include natural language, touch data obtained through a touch circuit included in the display panel (e.g., used to identify input from a finger and / or stylus), images displayed (and / or to be displayed) on the display panel, and / or videos. By example, without limitation, the user input may be provided to the input / output interface (1510) along with context information. It may be received by. The above context information may be described as additional information obtained in relation to the user input. The above context information may be related to the state at the time the user input is received (e.g., the state of the electronic device and / or the state of the surroundings of the electronic device (e.g., user state)). For example, the above context information may include information about one or more software applications executed within the electronic device at the time the user input is received.For example, the above situation information may include information about the location of the electronic device (or the location of the user of the electronic device) at the time the user input is received. For example, the user input may be integrated with the situation information. For example, the user input with the situation information integrated as the input may be received by the input / output interface (1510).

[0164] The input / output interface (1510) may transmit (or provide) an output. The output may include a result (or result information) generated or obtained by the AI ​​system (1500) based on at least part of the input. The format of the output may vary. For example, the output may include natural language. For example, the output may include content (e.g., media content and / or multimedia content). For example, the output may include actions related to the user of the electronic device. For example, the output may have a format according to the user settings of the electronic device.

[0165] The input / output interface (1510) can be described as a user question / response interface (1510).

[0166] The AI ​​framework (1520) can be used to obtain information (or data) about the input from the input / output interface (1510) and to control one or more components related to the AI ​​system (1500) using the obtained information.

[0167] For example, a prompt design component (1521) within an AI framework (1520) can generate or obtain prompts for a generative AI model (1530) (e.g., including a large language model (LLM) or a large multimodal model (LMM)) using the acquired information. For example, the prompt design component (1521) may be described as an AI component that uses a learning algorithm and / or a neural network to provide prompts that are enhanced over time. For example, the prompt design component (1521) can generate or obtain prompts by accessing a knowledge component (e.g., a knowledge repository (1590)) containing user preference data, a prompt library, and / or prompt examples using the acquired information. The generated prompts may be provided to the generative AI model (1530) (e.g., including an LLM or LMM).

[0168] For example, an API / plugin management component (1522) within the AI ​​framework (1520) may be used to support communication for additional information requested (or induced) in relation to the prompt provided (or to be provided) to the generative AI model (1530). For example, the API / plugin management component (1522) may be used to create or establish a channel for communication with various data sources (e.g., knowledge repository (1590)). For example, the API / plugin management component (1522) may support access to at least some of the data sources. For example, the API / plugin management component (1522) may be used to request another component (e.g., application / service component (1580)) that performs feedback (or response) according to the prompt. As a non-limiting example, information obtained (or generated) through the API / plugin management component (1522) may be provided to the prompt design component (1521) for generating a prompt. As a non-limiting example, information obtained (or generated) through the API / plugin management component (1522) may be provided to the generative AI model (1530).

[0169] For example, an improvement component (1523) within the AI ​​framework (1520) can at least partially tune (or adjust) (or change) the result (e.g., content) obtained (or output) from the generative AI model (1530). For example, the improvement component (1523) can determine or verify whether the content obtained from the generative AI model (1530) is related to the input. For example, the improvement component (1523) can determine or verify whether the content obtained from the generative AI model (1530) contains biased content. For example, the improvement component (1523) can determine or verify whether the content obtained from the generative AI model (1530) contains harmful content. For example, the improvement component (1523) can support or assist in performing additional processing to improve the content obtained from the generative AI model (1530). For example, the improvement component (1523) may support providing a hint to the user to improve the content.

[0170] A generative AI model (1530) can be described as an artificial intelligence neural network that generates feedback in response to a prompt. For example, the feedback may include additional data and / or information relative to the prompt, but relative to the prompt. For example, the feedback may include new content relative to the prompt. For example, the generative AI model (1530) may include a model that generates images and / or a model that generates language. For example, the model that generates images may include a generative adversarial network (GAN) and / or a variational autoencoder (VAE). For example, the model that generates images may include a diffusion-based generative model (e.g., a transformer VAE). For example, the model that generates language may include CHAT-GPT 3 and / or CHAT-GPT 4. For example, the generative AI model (1530) may include an LMM that generates the feedback by recognizing text, images, and / or voice.

[0171] As an example without limitation, the AI ​​framework (1520) and / or generative AI model (1530) may be included within an AI module (e.g., including a processing circuit) within the electronic device (200). For example, the AI ​​module may be operatively coupled with at least one processor of the electronic device (200) (e.g., at least one processor (210) or processor (1450)). For example, the AI ​​module may be operatively coupled with a display driving circuit of the electronic device. For example, the AI ​​module may be operatively coupled with a sensor hub of the electronic device for one or more sensors within the electronic device.

[0172] The technical problems to be solved in this disclosure are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which this disclosure pertains.

[0173] The electronic device described above (e.g., the electronic device (200) of FIG. 2) may include at least one processor (e.g., at least one processor (210) of FIG. 2) including a processing circuit, a display (e.g., the display (240) of FIG. 2), at least one camera (e.g., at least one camera (250) of FIG. 2), a communication circuit (e.g., the communication circuit (230) of FIG. 2), and a memory (e.g., the memory (220) of FIG. 2)) including one or more storage media configured to store one or more programs configured to be executed individually or collectively by the at least one processor. The one or more programs may include instructions that cause the electronic device to detect an event related to establishing a communication link using the at least one camera. The one or more programs may include instructions that cause the electronic device to display a preview image using the at least one camera activated based on the event through the display based on the detection. The one or more programs may include instructions that cause an electronic device to identify an external electronic device located within the field of view (FOV) of the at least one camera (e.g., FOV (505) in FIG. 5) while displaying the preview image. The one or more programs may include instructions that cause the electronic device to identify a first user input to be received regarding the external electronic device to establish a communication link with the external electronic device based on the type of the external electronic device. The one or more programs may include instructions that cause the electronic device to identify a second user input received regarding the external electronic device using the at least one camera while displaying the preview image.The above one or more programs may include instructions that cause the electronic device to determine whether the second user input identified using the at least one camera while displaying the preview image corresponds to the first user input identified based on the type of the external electronic device. The above one or more programs may include instructions that cause the electronic device to display information guiding the first user input (e.g., second information (905) of FIG. 9) along with the preview image through the display, based on determining the second user input which is different from the first user input. The above one or more programs may include instructions that cause the electronic device to establish the communication link with the external electronic device based on determining the second user input which corresponds to the first user input.

[0174] For example, the one or more programs may include instructions that cause the electronic device to identify a third user input received regarding the external electronic device using the at least one camera while displaying the information. The one or more programs may include instructions that cause the electronic device to determine whether the third user input identified using the at least one camera while displaying the information corresponds to the first user input identified based on the type of the external electronic device. The one or more programs may include instructions that cause the electronic device to display other information (e.g., third information (1115) of FIG. 11) that guides a change from the third user input to the first user input, along with the preview image, through the display based on determining the third user input which is different from the first user input. The above one or more programs may include instructions that cause the electronic device to establish the communication link with the external electronic device based on determining the third user input corresponding to the first user input.

[0175] For example, the above one or more programs may include instructions that cause the electronic device to identify a first state of the electronic device capable of establishing a communication link with the external electronic device based on the type of the external electronic device. The above one or more programs may include instructions that cause the electronic device to identify a second state of the electronic device regarding the establishment of a communication link while displaying the preview image. The above one or more programs may include instructions that cause the electronic device to determine whether the second state of the electronic device identified while displaying the preview image corresponds to the first state of the electronic device identified based on the type of the external electronic device. The above one or more programs may include instructions that cause the electronic device to display other information (e.g., first information (705) of FIG. 7) guiding the first state of the electronic device through the display based on determining the second state of the electronic device different from the first state of the electronic device. The above one or more programs may include instructions that cause the electronic device to identify the first user input based on determining the second state of the electronic device corresponding to the first state of the electronic device.

[0176] For example, the one or more programs may include instructions that cause the electronic device to receive an advertised advertising packet from the external electronic device using the communication circuit while determining the second user input corresponding to the first user input. The one or more programs may include instructions that cause the electronic device to transmit a connection request to the external electronic device to establish the communication link using the communication circuit based on receiving the advertising packet. The one or more programs may include instructions that cause the electronic device to establish the communication link based on transmitting the connection request.

[0177] For example, the type of the external electronic device may be a first type, and the advertising packet may indicate a second type of the external electronic device. The one or more programs may include instructions that cause the electronic device to determine, based on receiving the advertising packet, whether the second type of the external electronic device indicated by the advertising packet corresponds to the first type of the external electronic device identified using the at least one camera. The one or more programs may include instructions that cause the electronic device to transmit the connection request to the external electronic device using the communication circuit, based on determining the second type of the external electronic device corresponding to the first type of the external electronic device.

[0178] For example, the advertising packet may indicate a first time point at which the advertising packet is transmitted. The one or more programs may include instructions that cause the electronic device to determine whether the first time point at which the advertising packet is transmitted, indicated by the packet, corresponds to a second time point at which the second user input corresponding to the first user input is determined. The one or more programs may include instructions that cause the electronic device to transmit the connection request to the external electronic device using the communication circuit, based on determining the first time point corresponding to the second time point.

[0179] For example, the one or more programs may include instructions that cause the electronic device to generate a prompt indicating the type of the external electronic device, the first user input, and / or the second user input, based on determining the second user input which is different from the first user input. The one or more programs may include instructions that cause the electronic device to obtain the information by providing the prompt to a trained model. The one or more programs may include instructions that cause the electronic device to display the information along with the preview image through the display.

[0180] For example, the one or more programs may include instructions that cause the electronic device to generate a prompt indicating the type of the external electronic device, the first user input, and / or the third user input, based on determining the third user input which is different from the first user input. The one or more programs may include instructions that cause the electronic device to obtain the other information by providing the prompt to a trained model. The one or more programs may include instructions that cause the electronic device to display the other information along with the preview image through the display.

[0181] For example, the above one or more programs may include instructions that cause the electronic device to display the information superimposed on the preview image through the display, based on determining the second user input different from the first user input.

[0182] For example, the above one or more programs may include instructions that cause the electronic device to simultaneously display the preview image and the information in a split view through the display, based on determining the second user input different from the first user input.

[0183] The above-described method may be performed within an electronic device comprising a display, at least one camera, and a communication circuit. The method may include an operation of detecting an event related to establishing a communication link using the at least one camera. Based on the detection, the method may include an operation of displaying a preview image through the display using the at least one camera activated based on the event. While displaying the preview image, the method may include an operation of identifying an external electronic device located within the field of view (FOV) of the at least one camera. Based on the type of the external electronic device, the method may include an operation of identifying a first user input to be received regarding the external electronic device in order to establish a communication link with the external electronic device. While displaying the preview image, the method may include an operation of identifying a second user input received regarding the external electronic device using the at least one camera. While displaying the preview image, the method may include an operation of determining whether the second user input identified using the at least one camera corresponds to the first user input identified based on the type of the external electronic device. The above method may include an operation of displaying information guiding the first user input, along with the preview image, through the display, based on determining the second user input which is different from the first user input. The above method may include an operation of establishing the communication link with the external electronic device based on determining the second user input corresponding to the first user input.

[0184] For example, the method may include an operation of identifying a third user input received with respect to the external electronic device using the at least one camera while displaying the information. The method may include an operation of determining whether the third user input identified using the at least one camera while displaying the information corresponds to the first user input identified based on the type of the external electronic device. Based on determining the third user input that is different from the first user input, the method may include an operation of displaying other information that guides a change from the third user input to the first user input, along with the preview image, through the display. Based on determining the third user input that corresponds to the first user input, the method may include an operation of establishing the communication link with the external electronic device.

[0185] For example, the method may include an operation of identifying a first state of the electronic device capable of establishing a communication link with the external electronic device based on the type of the external electronic device. The method may include an operation of identifying a second state of the electronic device regarding the establishment of a communication link while displaying the preview image. The method may include an operation of determining whether the second state of the electronic device identified while displaying the preview image corresponds to the first state of the electronic device identified based on the type of the external electronic device. The method may include an operation of displaying other information guiding the first state of the electronic device through the display based on determining the second state of the electronic device which is different from the first state of the electronic device. The method may include an operation of identifying the first user input based on determining the second state of the electronic device corresponding to the first state of the electronic device.

[0186] For example, the above method may include an operation of receiving an advertised advertising packet from the external electronic device using the communication circuit while determining the second user input corresponding to the first user input. The above method may include an operation of transmitting a connection request to the external electronic device to establish the communication link using the communication circuit based on receiving the advertising packet. The above method may include an operation of establishing the communication link based on transmitting the connection request.

[0187] For example, the type of the external electronic device may be a first type, and the advertising packet may indicate a second type of the external electronic device. The method may include, based on receiving the advertising packet, an operation of determining whether the second type of the external electronic device indicated by the advertising packet corresponds to the first type of the external electronic device identified using the at least one camera. The method may include, based on determining the second type of the external electronic device corresponding to the first type of the external electronic device, an operation of transmitting the connection request to the external electronic device using the communication circuit.

[0188] For example, the advertising packet may indicate a first time point at which the advertising packet was transmitted. The method may include, based on receiving the advertising packet, an operation of determining whether the first time point at which the advertising packet was transmitted, indicated by the advertising packet, corresponds to a second time point at which the second user input corresponding to the first user input is determined. The method may include, based on determining the first time point corresponding to the second time point, an operation of transmitting the connection request to the external electronic device using the communication circuit.

[0189] For example, the method may include an operation of generating a prompt indicating the type of the external electronic device, the first user input, and / or the second user input, based on determining the second user input which is different from the first user input. The method may include an operation of obtaining the information by providing the prompt to a trained model. The method may include an operation of displaying the information along with the preview image through the display.

[0190] For example, the method may include an operation of generating a prompt indicating the type of the external electronic device, the first user input, and / or the third user input, based on determining the third user input which is different from the first user input. The method may include an operation of obtaining the other information by providing the prompt to a trained model. The method may include an operation of displaying the other information along with the preview image through the display.

[0191] For example, the above method may include an operation of superimposing the information onto the preview image through the display based on determining the second user input which is different from the first user input.

[0192] For example, the above method may include an operation of simultaneously displaying the preview image and the information in a split view through the display, based on determining the second user input which is different from the first user input.

[0193] The above-described non-transient computer-readable storage medium may store one or more programs. The one or more programs may include instructions that cause the electronic device to detect an event related to establishing a communication link using the at least one camera when executed by the electronic device comprising a display, at least one camera, and a communication circuit. The one or more programs may include instructions that cause the electronic device to display a preview image using the at least one camera activated based on the event through the display based on the detection when executed by the electronic device. The one or more programs may include instructions that cause the electronic device to identify an external electronic device located within the field of view (FOV) of the at least one camera while displaying the preview image when executed by the electronic device. The above one or more programs may include instructions that cause the electronic device to identify a first user input to be received regarding the external electronic device in order to establish a communication link with the external electronic device, based on the type of the external electronic device when executed by the electronic device. The above one or more programs may include instructions that cause the electronic device to identify a second user input received regarding the external electronic device using the at least one camera while displaying the preview image when executed by the electronic device.The above one or more programs may include instructions that cause the electronic device to determine, when executed by the electronic device, whether the second user input identified using the at least one camera while displaying the preview image corresponds to the first user input identified based on the type of the external electronic device. The above one or more programs may include instructions that cause the electronic device to display information guiding the first user input along with the preview image through the display, based on determining the second user input different from the first user input when executed by the electronic device. The above one or more programs may include instructions that cause the electronic device to establish the communication link with the external electronic device based on determining the second user input corresponding to the first user input when executed by the electronic device.

[0194] For example, the one or more programs may include instructions that cause the electronic device to identify a third user input received with respect to the external electronic device using the at least one camera while displaying the information when executed by the electronic device. The one or more programs may include instructions that cause the electronic device to determine whether the third user input identified using the at least one camera while displaying the information when executed by the electronic device corresponds to the first user input identified based on the type of the external electronic device. The one or more programs may include instructions that cause the electronic device to display other information guiding a change from the third user input to the first user input, along with the preview image, through the display, based on determining the third user input which is different from the first user input when executed by the electronic device. The above one or more programs may include instructions that cause the electronic device to establish the communication link with the external electronic device based on determining the third user input corresponding to the first user input when executed by the electronic device.

[0195] For example, the one or more programs may include instructions that cause the electronic device to identify a first state of the electronic device capable of establishing a communication link with the external electronic device based on the type of the external electronic device when executed by the electronic device. The one or more programs may include instructions that cause the electronic device to identify a second state of the electronic device regarding the establishment of a communication link while displaying the preview image when executed by the electronic device. The one or more programs may include instructions that cause the electronic device to determine whether the second state of the electronic device identified while displaying the preview image corresponds to the first state of the electronic device identified based on the type of the external electronic device when executed by the electronic device. The above one or more programs may include instructions that cause the electronic device to display other information guiding the first state of the electronic device through the display, based on determining the second state of the electronic device different from the first state of the electronic device when executed by the electronic device. The above one or more programs may include instructions that cause the electronic device to identify the first user input, based on determining the second state of the electronic device corresponding to the first state of the electronic device when executed by the electronic device.

[0196] For example, the one or more programs may include instructions that cause the electronic device to receive an advertised advertising packet from the external electronic device using the communication circuit while determining the second user input corresponding to the first user input when executed by the electronic device. The one or more programs may include instructions that cause the electronic device to transmit a connection request to the external electronic device to establish the communication link using the communication circuit, based on receiving the advertising packet when executed by the electronic device. The one or more programs may include instructions that cause the electronic device to establish the communication link based on transmitting the connection request when executed by the electronic device.

[0197] For example, the type of the external electronic device may be a first type, and the advertising packet may indicate a second type of the external electronic device. The one or more programs may include instructions that cause the electronic device to determine, based on receiving the advertising packet when executed by the electronic device, whether the second type of the external electronic device indicated by the advertising packet corresponds to the first type of the external electronic device identified using the at least one camera. The one or more programs may include instructions that cause the electronic device to transmit the connection request to the external electronic device using the communication circuit, based on determining the second type of the external electronic device corresponding to the first type of the external electronic device when executed by the electronic device.

[0198] For example, the advertising packet may indicate a first time point at which the advertising packet was transmitted. The one or more programs may include instructions that cause the electronic device to determine, based on receiving the advertising packet when executed by the electronic device, whether the first time point at which the advertising packet was transmitted, indicated by the advertising packet, corresponds to a second time point at which the second user input corresponding to the first user input is determined. The one or more programs may include instructions that cause the electronic device to transmit the connection request to the external electronic device using the communication circuit, based on determining the first time point corresponding to the second time point when executed by the electronic device.

[0199] For example, the one or more programs may include instructions that cause the electronic device to generate a prompt indicating the type of the external electronic device, the first user input, and / or the second user input, based on determining the second user input different from the first user input when executed by the electronic device. The one or more programs may include instructions that cause the electronic device to obtain the information by providing the prompt to a trained model when executed by the electronic device. The one or more programs may include instructions that cause the electronic device to display the information along with the preview image through the display when executed by the electronic device.

[0200] For example, the one or more programs may include instructions that cause the electronic device to generate a prompt indicating the type of the external electronic device, the first user input, and / or the third user input, based on determining the third user input different from the first user input when executed by the electronic device. The one or more programs may include instructions that cause the electronic device to obtain the other information by providing the prompt to a trained model when executed by the electronic device. The one or more programs may include instructions that cause the electronic device to display the other information along with the preview image through the display when executed by the electronic device.

[0201] For example, the above one or more programs may include instructions that cause the electronic device to display the information superimposed on the preview image through the display, based on determining the second user input different from the first user input when executed by the electronic device.

[0202] For example, the above one or more programs may include instructions that cause the electronic device to simultaneously display the preview image and the information in a split view through the display, based on determining the second user input different from the first user input when executed by the electronic device.

[0203] The effects obtainable from the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which the present disclosure belongs.

Claims

1. In an electronic device, At least one processor including a processing circuit; display; At least one camera; Communication circuit; and Memory comprising one or more programs configured to be executed individually or collectively by at least one processor, and including one or more storage media, The above one or more programs are: Detecting an event related to establishing a communication link using at least one camera; Based on the above detection, a preview image is displayed through the display using the at least one camera activated based on the event; While displaying the above preview image, identify an external electronic device located within the field of view (FOV) of at least one camera; Based on the type of the external electronic device, to identify a first user input to be received with respect to the external electronic device in order to establish a communication link with the external electronic device; While displaying the above preview image, using the at least one camera, identify a second user input received regarding the external electronic device; Determining whether the second user input identified using the at least one camera while displaying the above preview image corresponds to the first user input identified based on the type of the external electronic device; Based on determining the second user input different from the first user input, information guiding the first user input is displayed through the display along with the preview image; and Based on determining the second user input corresponding to the first user input, to establish the communication link with the external electronic device, Instructions including those that cause the above electronic device Electronic device.

2. In Claim 1, The above one or more programs are: While displaying the above information, using the at least one camera, identify a third user input received with respect to the external electronic device; Determining whether the third user input identified using the at least one camera while displaying the above information corresponds to the first user input identified based on the type of the external electronic device; Based on determining the third user input different from the first user input, displaying other information that guides a change from the third user input to the first user input, together with the preview image, through the display; and Based on determining the third user input corresponding to the first user input, to establish the communication link with the external electronic device, Instructions including those that cause the above electronic device Electronic device.

3. In Claim 1, The above one or more programs are: Based on the type of the external electronic device, identify a first state of the electronic device capable of establishing a communication link with the external electronic device; While displaying the above preview image, identify a second state of the electronic device regarding the establishment of a communication link; Determining whether the second state of the electronic device identified while displaying the above preview image corresponds to the first state of the electronic device identified based on the type of the external electronic device; Based on determining the first state of the electronic device and the second state of the electronic device different from the first state of the electronic device, other information guiding the first state of the electronic device is displayed through the display; and To identify the first user input based on determining the second state of the electronic device corresponding to the first state of the electronic device, including instructions that cause the above electronic device, Electronic device.

4. In Claim 1, The above one or more programs are: While determining the second user input corresponding to the first user input, using the communication circuit, receive an advertised advertising packet from the external electronic device; Based on receiving the above advertising packet, using the communication circuit, transmit a connection request to the external electronic device to establish the communication link; and Based on transmitting the above connection request, to establish the above communication link, Instructions including those that cause the above electronic device Electronic device.

5. In Claim 4, The above type of the above external electronic device is, It is Type 1, and The above advertising packet is, Indicating the second type of the above external electronic device, The above one or more programs are: Based on receiving the advertising packet, determining whether the second type of the external electronic device indicated by the advertising packet corresponds to the first type of the external electronic device identified using the at least one camera; and Based on determining the second type of the external electronic device corresponding to the first type of the external electronic device, the communication circuit is used to transmit the connection request to the external electronic device. Instructions including those that cause the above electronic device Electronic device.

6. In Claim 4, The above advertising packet is, Indicates a first point in time when the above advertising packet was transmitted, and The above one or more programs are: Based on receiving the advertising packet, determining whether the first time point in which the advertising packet indicated by the advertising packet was transmitted corresponds to the second time point in which the second user input corresponding to the first user input was determined; and Based on determining the first time point corresponding to the second time point, the communication circuit is used to transmit the connection request to the external electronic device. Instructions including those that cause the above electronic device Electronic device.

7. In Claim 1, The above one or more programs are: Based on determining the second user input different from the first user input, generating a prompt indicating the type of the external electronic device, the first user input, and / or the second user input; Acquire the above information by providing the above prompt to a trained model; and To display the information together with the preview image through the above display, Instructions including those that cause the above electronic device Electronic device.

8. In Claim 2, The above one or more programs are: Based on determining the third user input different from the first user input, generating a prompt indicating the type of the external electronic device, the first user input, and / or the third user input; By providing the above prompt to the trained model, the above other information is obtained; and To display the other information along with the preview image through the above display, Instructions including those that cause the above electronic device Electronic device.

9. In Claim 1, The above one or more programs are: Based on determining the second user input different from the first user input, the information is superimposed and displayed on the preview image through the display. Instructions including those that cause the above electronic device Electronic device.

10. In Claim 1, The above one or more programs are: Based on determining the second user input different from the first user input, the preview image and the information are simultaneously displayed in a split view through the display. Instructions including those that cause the above electronic device Electronic device.

11. A method executed within an electronic device comprising a display, at least one camera, and a communication circuit, wherein the method comprises: An operation to detect an event related to establishing a communication link using at least one camera; An operation to display a preview image using the at least one camera activated based on the event through the display based on the above detection; An operation of identifying an external electronic device located within the field of view (FOV) of at least one camera while displaying the above preview image; An operation to identify a first user input to be received with respect to the external electronic device in order to establish a communication link with the external electronic device, based on the type of the external electronic device; An operation of identifying a second user input received with respect to the external electronic device using the at least one camera while displaying the above preview image; An operation to determine whether the second user input identified using the at least one camera while displaying the above preview image corresponds to the first user input identified based on the type of the external electronic device; An operation of displaying information guiding the first user input, together with the preview image, through the display, based on determining the second user input which is different from the first user input; and Based on determining the second user input corresponding to the first user input, the operation of establishing the communication link with the external electronic device, method.

12. In claim 11, the method comprises: An operation of identifying a third user input received with respect to the external electronic device using the at least one camera while displaying the above information; An operation to determine whether the third user input identified using the at least one camera while displaying the above information corresponds to the first user input identified based on the type of the external electronic device; An operation of displaying other information that guides a change from the third user input to the first user input, together with the preview image, through the display, based on determining the third user input which is different from the first user input; and Based on determining the third user input corresponding to the first user input, the operation of establishing the communication link with the external electronic device, method.

13. In claim 11, the method comprises: An operation to identify a first state of the electronic device capable of establishing a communication link with the external electronic device based on the type of the external electronic device; An operation to identify a second state of the electronic device regarding the establishment of a communication link while displaying the above preview image; An operation to determine whether the second state of the electronic device identified while displaying the above preview image corresponds to the first state of the electronic device identified based on the type of the external electronic device; An operation of displaying other information that guides the first state of the electronic device through the display, based on determining the second state of the electronic device different from the first state of the electronic device; and An operation for identifying the first user input based on determining the second state of the electronic device corresponding to the first state of the electronic device, method.

14. In claim 11, the method comprises: While determining the second user input corresponding to the first user input, the operation of receiving an advertised advertising packet from the external electronic device using the communication circuit; Based on receiving the advertising packet, the operation of transmitting a connection request to the external electronic device to establish the communication link using the communication circuit; and Based on transmitting the above connection request, the operation of establishing the above communication link, method.

15. In Claim 14, The above type of the above external electronic device is, It is Type 1, and The above advertising packet is, Indicating the second type of the above external electronic device, The above method is: An operation to determine, based on receiving the advertising packet, whether the second type of the external electronic device indicated by the advertising packet corresponds to the first type of the external electronic device identified using the at least one camera; and Based on determining the second type of the external electronic device corresponding to the first type of the external electronic device, the operation of transmitting the connection request to the external electronic device using the communication circuit, method.

Images