Wearable electronic device for displaying virtual object, operation method thereof, and recording medium

Abstract

According to one embodiment, instructions, when executed individually or collectively by at least one processor, may cause a wearable electronic device to: identify a first object existing in the real world from a first image around the wearable electronic device obtained through a camera; display information about a second object related to the first object through the display on the basis of identifying that the first object corresponds to a designated object of interest; display a virtual first three-dimensional object of the second object corresponding to the position of the first object within the field of view of a user through the display on the basis of receiving a user input for the information about the second object; and rotate or move the first three-dimensional object according to the rotation or movement of the first object through the display to display the first three-dimensional object around the first object within the field of view of the user on the basis of identifying, by using a second image obtained through the camera, that the first object rotates or moves.

Description

Wearable electronic device for displaying virtual objects, method of operating the same, and recording medium

[0001] Various embodiments relate to a wearable electronic device for displaying a virtual object, a method of operating the same, and a recording medium.

[0002] The variety of services and additional features offered through wearable electronic devices, such as augmented reality glasses (AR glasses), video see-through (VST) devices, and head-mounted displays (HMDs), is steadily increasing. To enhance the utility of these devices and satisfy the needs of diverse users, telecommunications service providers and electronic device manufacturers are competitively developing electronic devices that offer diverse features and differentiate themselves from competitors. Consequently, the various functions offered through wearable electronic devices are also becoming increasingly sophisticated.

[0003] AR glasses or VST devices can provide users with a realistic experience by displaying virtual images while worn on the user's body. AR glasses or VST (video see-through) devices can replace smartphones in various fields, such as gaming, entertainment, education, and social networking services (SNS). Through AR glasses or VST (video see-through) devices, users can receive realistic content and, through interaction, experience the sensation of being immersed in a virtual world.

[0004] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above-described matters constitute prior art related to the present disclosure.

[0005] According to one embodiment, a wearable electronic device may include a camera, at least one processor, a display, and a memory storing instructions.

[0006] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the wearable electronic device to identify a first object existing in the real world from a first image of the wearable electronic device's surroundings acquired through the camera.

[0007] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the wearable electronic device to display, through the display, information about a second object related to the first object based on determining that the first object corresponds to a designated object of interest.

[0008] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the wearable electronic device to display a virtual first three-dimensional object of the second object within the user's field of view through the display, corresponding to a location of the first object, based on receiving a user input regarding information about the second object.

[0009] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the wearable electronic device to, based on determining that the first object is rotated or moved using a second image acquired through the camera, display the first three-dimensional object around the first object within the user's field of view by rotating or moving the first object according to the rotation or movement of the first object through the display.

[0010] According to one embodiment, a method of operating a wearable electronic device may include an operation of identifying a first object existing in the real world from a first image around the wearable electronic device obtained through a camera of the wearable electronic device.

[0011] According to one embodiment, a method of operating a wearable electronic device may include an operation of displaying information about a second object related to the first object through a display of the wearable electronic device based on determining that the first object corresponds to a designated object of interest.

[0012] According to one embodiment, a method of operating a wearable electronic device may include displaying a virtual first three-dimensional object of the second object corresponding to a location of the first object within the user's field of view through the display, based on receiving a user input regarding information about the second object.

[0013] According to one embodiment, a method of operating a wearable electronic device may include an operation of displaying a first three-dimensional object around the first object within the user's field of view by rotating or moving the first object according to the rotation or movement of the first object through the display based on confirming that the first object is rotated or moved using a second image acquired through the camera.

[0014] According to one embodiment, a non-transitory storage medium storing computer-readable instructions, wherein the instructions, when executed by at least one processor of a wearable electronic device, cause the wearable electronic device to perform at least one operation, wherein the at least one operation may include a first operation of identifying an object existing in the real world from a first image of the surroundings of the wearable electronic device acquired through a camera of the wearable electronic device.

[0015] According to one embodiment, a non-transitory storage medium storing computer-readable instructions, wherein the instructions, when executed by at least one processor of a wearable electronic device, cause the wearable electronic device to perform at least one action, wherein the at least one action includes displaying information about a second object related to the first object through a display of the wearable electronic device based on determining that the first object corresponds to a designated object of interest.

[0016] According to one embodiment, a non-transitory storage medium storing computer-readable instructions, wherein the instructions, when executed by at least one processor of a wearable electronic device, cause the wearable electronic device to perform at least one operation, wherein the at least one operation may include displaying a virtual first three-dimensional object of the second object corresponding to a location of the first object within the user's field of view through the display based on receiving a user input regarding information about the second object.

[0017] According to one embodiment, a non-transitory storage medium storing computer-readable instructions, wherein the instructions, when executed by at least one processor of a wearable electronic device, cause the wearable electronic device to perform at least one operation, wherein the at least one operation may include an operation of rotating or moving the first three-dimensional object according to the rotation or movement of the first object through the display and displaying the first three-dimensional object around the first object within the user's field of view based on confirming that the first object rotates or moves using a second image acquired through the camera.

[0018] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0019] FIG. 2 is a perspective view illustrating the internal configuration of a wearable electronic device according to an embodiment of the present disclosure.

[0020] FIGS. 3A and 3B are drawings showing the front and back of a wearable electronic device according to one embodiment.

[0021] FIG. 4 is a diagram illustrating a system including a wearable electronic device and a server according to one embodiment.

[0022] FIG. 5 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to rotate or move a virtual object corresponding to a second object according to the rotation or movement of a first object.

[0023] FIG. 6A is a flowchart illustrating an operation of a wearable electronic device according to one embodiment to determine whether a first object satisfies a specified condition.

[0024] FIG. 6b is a flowchart illustrating an operation of a wearable electronic device according to one embodiment to determine whether a first object satisfies a specified condition.

[0025] FIG. 7A is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to display information about a first object and information about a second object.

[0026] FIG. 7b is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to display information about a first object and information about a second object.

[0027] FIG. 8 is a drawing for explaining an operation of a wearable electronic device according to one embodiment to confirm a first product based on an image acquired through a camera.

[0028] FIG. 9 is a diagram for explaining an operation of a wearable electronic device according to one embodiment of the present invention to display information about a first product and information about at least one product related to the first product.

[0029] FIG. 10 is a drawing for explaining an operation of a wearable electronic device according to one embodiment of the present invention to display a second product related to a first product as a three-dimensional first virtual object.

[0030] FIG. 11 is a drawing for explaining an operation of a wearable electronic device according to one embodiment of the present invention to rotate or move a first virtual object according to rotation or movement of a first product.

[0031] FIG. 12 is a drawing for explaining an operation of a wearable electronic device according to one embodiment of the present invention to overlay and display a first virtual object on a first object.

[0032] FIG. 13A is a diagram for explaining an operation of a wearable electronic device displaying a shopping cart list according to one embodiment.

[0033] FIG. 13b is a diagram for explaining an operation of a wearable electronic device displaying a shopping cart list according to one embodiment.

[0034] FIG. 14 is a diagram illustrating an operation of a wearable electronic device according to one embodiment of the present invention to display a three-dimensional virtual object corresponding to a first product based on confirmation of a user input for selecting a color of the first product.

[0035] FIG. 15 is a diagram for explaining an operation of displaying a virtual window including information about a plurality of designated products of interest when a wearable electronic device according to one embodiment checks a plurality of designated products of interest through a camera.

[0036] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.

[0037] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0038] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0039] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, in the electronic device (101) itself where artificial intelligence is performed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0040] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0041] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0042] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0043] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0044] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0045] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0046] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0047] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0048] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0049] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0050] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0051] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0052] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0053] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0054] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0055] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0056] In one embodiment, the antenna module (197) may generate a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.

[0057] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0058] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0059] FIG. 2 is a perspective view illustrating the internal configuration of a wearable electronic device according to an embodiment of the present disclosure.

[0060] Referring to FIG. 2, a wearable electronic device (200) according to one embodiment of the present disclosure may include at least one of a light output module (211), a display member (201), and a camera module (250).

[0061] According to one embodiment of the present disclosure, the light output module (211) may include a light source capable of outputting an image, and a lens for guiding the image to the display member (201). According to one embodiment of the present disclosure, the light output module (211) may include at least one of a liquid crystal display (LCD), a digital mirror device (DMD), a liquid crystal on silicon (LCoS), an organic light emitting diode (OLED), or a micro light emitting diode (micro LED).

[0062] According to one embodiment of the present disclosure, the display member (201) may include an optical waveguide (e.g., a waveguide). According to one embodiment of the present disclosure, an output image of an optical output module (211) incident on one end of the optical waveguide may be propagated inside the optical waveguide and provided to a user. According to one embodiment of the present disclosure, the optical waveguide may include at least one diffractive element (e.g., a diffractive optical element (DOE), a holographic optical element (HOE)) or at least one reflective element (e.g., a reflective mirror). For example, the optical waveguide may guide an output image of the optical output module (211) to a user's eye by using at least one diffractive element or reflective element.

[0063] According to one embodiment of the present disclosure, the camera module (250) can capture still images and / or moving images. According to one embodiment, the camera module (250) is disposed within a lens frame and can be disposed around the display member (201).

[0064] According to one embodiment of the present disclosure, the first camera module (251) can capture and / or recognize the trajectory of the user's eye (e.g., pupil, iris) or gaze. According to one embodiment of the present disclosure, the first camera module (251) can periodically or aperiodically transmit information related to the trajectory of the user's eye or gaze (e.g., trajectory information) to a processor (e.g., processor (120) of FIG. 1).

[0065] According to one embodiment of the present disclosure, the second camera module (253) can capture an external image.

[0066] According to one embodiment of the present disclosure, the third camera module (255) can be used for hand detection and tracking, and user gesture (e.g., hand movement) recognition. According to one embodiment of the present disclosure, the third camera module (255) can be used for 3 degrees of freedom (3DoF), 6DoF head tracking, position (space, environment) recognition, and / or movement recognition. According to one embodiment of the present disclosure, the second camera module (253) can also be used for hand detection and tracking, and user gesture recognition. According to one embodiment of the present disclosure, at least one of the first camera module (251) to the third camera module (255) can be replaced with a sensor module (e.g., a LiDAR sensor). For example, the sensor module can include at least one of a vertical cavity surface emitting laser (VCSEL), an infrared sensor, and / or a photodiode.

[0067] FIGS. 3A and 3B are drawings showing the front and back of a wearable electronic device according to one embodiment.

[0068] Referring to FIGS. 3A and 3B, in one embodiment, camera modules (311, 312, 313, 314, 315, 316) and / or depth sensors (317) for obtaining information related to the surrounding environment of the wearable electronic device (300) may be arranged on the first surface (310) of the housing.

[0069] In one embodiment, the camera modules (311, 312) can acquire images related to the environment surrounding the wearable electronic device.

[0070] In one embodiment, the camera modules (313, 314, 315, 316) can acquire images while the wearable electronic device is worn by a user. The camera modules (313, 314, 315, 316) can be used for hand detection and tracking, and user gesture (e.g., hand movement) recognition. The camera modules (313, 314, 315, 316) can be used for 3DoF, 6DoF head tracking, position (spatial, environmental) recognition, and / or movement recognition. In one embodiment, the camera modules (311, 312) can also be used for hand detection and tracking, and user gesture.

[0071] In one embodiment, a depth sensor (317) may be configured to transmit a signal and receive a signal reflected from a subject, and may be used for purposes such as time of flight (TOF) to determine the distance to an object. Instead of or in addition to the depth sensor (217), the camera modules (213, 214, 215, 216) may determine the distance to an object.

[0072] According to one embodiment, a camera module (325, 326) for facial recognition and / or a display (321) (and / or a lens) may be disposed on the second side (320) of the housing.

[0073] In one embodiment, a face recognition camera module (325, 326) adjacent to the display may be used to recognize a user's face, or may recognize and / or track both eyes of the user.

[0074] In one embodiment, the display (321) (and / or lens) may be disposed on the second side (320) of the wearable electronic device (300). In one embodiment, the wearable electronic device (300) may not include camera modules (315, 316) among the plurality of camera modules (313, 314, 315, 316). Although not illustrated in FIGS. 3A and 3B , the wearable electronic device (300) may further include at least one of the configurations illustrated in FIG. 2 .

[0075] As described above, according to one embodiment, the wearable electronic device (300) may have a form factor for being worn on a user's head. The wearable electronic device (300) may further include a strap and / or a wearing member for being secured to a body part of the user. The wearable electronic device (300) may provide a user experience based on augmented reality, virtual reality, and / or mixed reality while being worn on the user's head.

[0076] FIG. 4 is a diagram illustrating a system including a wearable electronic device and a server according to one embodiment.

[0077] Referring to FIG. 4, according to one embodiment, a system (400) may include a wearable electronic device (401) and a server (402) (e.g., electronic devices (102, 104) of FIG. 1, server (108) of FIG. 1). According to one embodiment, the system (400) may include a system that provides information on a product identified through a camera (410) and at least one product related to the product, and provides an environment in which the product identified through the camera (410) and at least one product related to the product can be compared.

[0078] According to one embodiment, the wearable electronic device (401) may be implemented as a wearable electronic device that can be worn on a user's body (e.g., head). For example, the wearable electronic device (401) may be implemented as an augmented reality glass (AR glass), a video see-through (VST) device, or a head-mounted display (HMD) device. However, this is merely an example, and the wearable electronic device (401) may be implemented as various devices.

[0079] According to one embodiment, the wearable electronic device (401) can confirm a first product identified through a camera (410). According to one embodiment, the wearable electronic device (401) can obtain information about a second product (e.g., a product similar to the first product) related to the first product identified through the camera (410) from a server (402). According to one embodiment, in response to confirming a user input for displaying the second product as a three-dimensional virtual object, the wearable electronic device (401) can display the second product as a three-dimensional virtual object around the first product within the user's field of view through a display (460) based on the information about the second product obtained from the server (402).

[0080] According to one embodiment, when the wearable electronic device (401) determines that the first product is being rotated or moved, it may display a three-dimensional virtual object corresponding to the second product as being rotated or moved according to the rotation or movement of the first product. Through this, the wearable electronic device (401) can provide an environment in which the first product and the second product can be compared in three-dimensional space.

[0081] According to one embodiment, a wearable electronic device (401) may include a camera (410) (e.g., the camera module (180) of FIG. 1), a sensor (411) (e.g., the sensor module (176) of FIG. 1), a processor (420) (e.g., the processor (120) of FIG. 1), a memory (430) (e.g., the memory (130) of FIG. 1), a display (460) (e.g., the display module (160) of FIG. 1), and a communication circuit (490) (e.g., the communication module (190) of FIG. 1).

[0082] According to one embodiment, the wearable electronic device (401) may be implemented identically or similarly to the electronic device (101) of FIG. 1, the wearable electronic device (200) of FIG. 2, or the wearable electronic device (300) of FIG. 3.

[0083] According to one embodiment, the processor (420) can control the overall operation of the wearable electronic device (401).

[0084] According to one embodiment, the sensor (411) may be implemented as a gaze tracking camera. According to one embodiment, the sensor (411) may be implemented in the same or similar manner as the first camera module (251) (e.g., the first camera module (251) of FIG. 2). According to one embodiment, the sensor (411) may be implemented in the same or similar manner as the face recognition camera module (325, 326) (e.g., the face recognition camera module (325, 326) of FIG. 3B). According to one embodiment, the sensor (411) may be implemented in the same or similar manner as the face recognition camera module (325, 326) of FIG. 3B.

[0085] According to one embodiment, the processor (420) can acquire at least one image in real time through the camera (410). According to one embodiment, the processor (420) can display an image including a first object in real time through the display (460) based on the image including the first object. For example, the object may represent a product existing in the real world. In the specification of the present invention, the terms first product and first object may be used interchangeably with the same meaning. In the specification of the present invention, the terms second product and second object may be used interchangeably with the same meaning. In the specification of the present invention, the terms third product and third object may be used interchangeably with the same meaning.

[0086] In one embodiment, the processor (420) may determine whether a first product (e.g., a first object) satisfies a specified condition. For example, the specified condition may include a condition for displaying information about the first product and information about at least one product related to the first product.

[0087] In one embodiment, if the processor (420) determines that the first product corresponds to a designated product of interest, the processor (420) may determine that the first product satisfies a designated condition. In one embodiment, the processor (420) may display an icon indicating that the first product corresponds to the designated product of interest around the first product, corresponding to the first product's location within the user's field of view.

[0088] For example, the processor (420) may confirm a user input designating at least one product from a product list containing multiple products stored in the memory (430) as a product of interest. Based on the user input, the processor (420) may store information about the designated product of interest in the memory (430).

[0089] For example, the processor (420) may be connected to the server (402) using authentication information (e.g., login information, account information, or identification information) specified in the wearable electronic device (401). The processor (420) may also receive information about a product of interest specified by an external electronic device connected to the server (402) from the server (402) using the same authentication information as the authentication information specified in the wearable electronic device (401). For example, the external electronic device may include a mobile phone, a tablet PC, or a computing device.

[0090] According to one embodiment, the processor (420) can detect the gaze of a user wearing the wearable electronic device (401) through the sensor (411). Based on the determination that the user's gaze is directed toward the first product for a specified period of time, the processor (420) can determine that the first product satisfies a specified condition. For example, the specified period of time may be set by the user or automatically set by the processor (420). According to one embodiment, based on the determination that the user's gaze is directed toward the first product for a specified period of time, the processor (420) can display an icon indicating that the first product corresponds to the user's gaze around the first product.

[0091] According to one embodiment, the processor (420) may verify information about the first product and information about a second product (e.g., a second object) related to the first product based on verifying that the first product satisfies a specified condition.

[0092] According to one embodiment, the second product may include a product similar to the first product. According to one embodiment, the processor (420) may identify the shape, size, color, or material of the first product based on an image including the first product. For example, the processor (420) may identify a second product similar to the first product among a plurality of products stored in the memory (430) based on information about the shape, size, color, or material of the first product. For example, the processor (420) may provide information about at least one of the shape, size, color, or material of the first product to the server (402) via the communication circuit (490). The server (402) may identify a second product similar to the first product based on information about at least one of the shape, size, color, or material of the first product. The server (402) may provide information about the second product to the wearable electronic device (401). The processor (420) may identify a second product based on information about the second product obtained from the server (402). For example, the processor (420) may identify a second product similar to the first product based on providing an image including the first product to an artificial intelligence model. For example, the artificial intelligence model may be stored in the memory (430) or the server (402).

[0093] In one embodiment, the second product may include a product included in the purchase list of a purchaser who purchased the first product. In one embodiment, the processor (420) may transmit a command requesting information about the purchase list of a purchaser who purchased the first product to the server (402) via the communication circuit (490). In one embodiment, the processor (420) may obtain information about the purchase list of a purchaser who purchased the first product from the server (402). In one embodiment, the processor (420) may identify the second product from the purchase list.

[0094] According to one embodiment, the processor (420) may display a virtual first window via the display (460) that includes information about a first product and information about a second product related to the first product. For example, the information about the first product may include the price of the first product, a website address where the first product can be purchased, or information about an offline store where the first product can be purchased. For example, the information about the second product may include information about the price of the second product, a website where the second product can be purchased, or information about an offline store where the second product can be purchased.

[0095] For example, if a user input selecting a website address from which a first product can be purchased is confirmed, the processor (420) may display the corresponding website screen. For example, if a user input selecting a website address from which a second product can be purchased is confirmed, the processor (420) may display the corresponding website screen.

[0096] For example, the processor (420) may display the virtual first window to the right of the first product. However, this is an example, and the processor (420) may also display the virtual first window to the left, top, or bottom of the first product.

[0097] According to one embodiment, the processor (420) can detect a user input that displays a second product inputted into a virtual first window as a three-dimensional virtual object through the camera (410). For example, the user input may include a touch gesture or a long press gesture.

[0098] According to one embodiment, the processor (420) may display a first three-dimensional virtual object corresponding to the second product based on a user input that displays the second product as a three-dimensional virtual object in relation to the first virtual window. For example, the processor (420) may display the first virtual object adjacent to the first product. For example, the processor (420) may also display the first virtual object by overlaying it on the first product.

[0099] According to one embodiment, the processor (420) may not display a virtual first window including information about the first product and information about a second product related to the first product while displaying a three-dimensional first virtual object corresponding to the second product.

[0100] In one embodiment, the processor (420) may determine the size of the first virtual object corresponding to the second product based on the actual size of the second product. For example, the processor (420) may determine the size of the first virtual object based on a table representing the relationship between the actual size and the size of the virtual object. In one embodiment, the processor (420) may also adjust the size of the first virtual object based on a user input that adjusts the size of the first virtual object. For example, the user input may include a pinch-to-zoom gesture or a pinch-to-out gesture.

[0101] According to one embodiment, the processor (420) can determine that the first product is rotated or moved by a user wearing the wearable electronic device (401) based on real-time acquisition of an image including the first product through the camera (410). According to one embodiment, the processor (420) can display the first virtual object by rotating or moving it according to the rotation or movement of the first product.

[0102] According to one embodiment, the processor (420) may display the first virtual object by rotating or moving it based on a user input that rotates or moves the first virtual object.

[0103] In one embodiment, the processor (420) may display a three-dimensional third virtual object corresponding to the first product of a specific color based on a user input selecting a specific color different from the color of the first product input into the virtual first window. For example, the processor (420) may display the third virtual object adjacent to the first product or overlaid on the first product.

[0104] In one embodiment, the processor (420) can verify a user input for storing the first product and the second product entered in the virtual first window in the shopping cart list. In one embodiment, the processor (420) can store the first product and the second product in the shopping cart list.

[0105] According to one embodiment, after the processor (420) has stored the first product and the second product in the shopping cart list, if a user input for displaying the shopping cart list is confirmed, the processor (420) may display a virtual second window including information about the shopping cart list including the first product and the second product. According to one embodiment, the information about the shopping cart list including the first product and the second product may include information about the price of the first product, a website where the first product can be purchased, or an offline store where the first product can be purchased, and information about the price of the second product, a website where the second product can be purchased, or an offline store where the second product can be purchased.

[0106] According to one embodiment, when a user input to display a first product as a three-dimensional virtual object from the shopping cart list is confirmed and a user input to display a second product as a three-dimensional virtual object is confirmed, the processor (420) may display the first product as a three-dimensional virtual object and display the second product as a three-dimensional virtual object. According to one embodiment, when a user input to move or rotate the three-dimensional virtual object of the first product is confirmed, the processor (420) may move or rotate the three-dimensional virtual object of the first product. According to one embodiment, when a user input to move or rotate the three-dimensional virtual object of the second product is confirmed, the processor (420) may move or rotate the three-dimensional virtual object of the second product. According to one embodiment, when a user input to move or rotate the three-dimensional virtual object of the first product is confirmed, the processor (420) may display the three-dimensional virtual object of the first product and the three-dimensional virtual object of the second product by moving or rotating them. According to one embodiment, when a user input for moving or rotating a three-dimensional virtual object of a second product is confirmed, the processor (420) may display the three-dimensional virtual object of the first product and the three-dimensional virtual object of the second product by moving or rotating them.

[0107] According to one embodiment, the processor (420) may store an image of a three-dimensional space acquired through the camera (410) in the memory (430). According to one embodiment, the processor (420) may also display a virtual window containing information about a product on the image stored in the memory (430).

[0108] The operations of the wearable electronic device (401) described in the drawings below may be performed by the processor (420). However, for convenience of explanation, the operations performed by the processor (420) will be described as being performed by the wearable electronic device (401).

[0109] FIG. 5 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to rotate or move a virtual object corresponding to a second object according to the rotation or movement of a first object.

[0110] Referring to FIG. 5, according to one embodiment, in operation 511, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) may acquire a first image via a camera (410) (e.g., the camera (410) of FIG. 4). For example, the first image may represent an image including a first object (e.g., a product). For example, the first object may represent a product in the real world.

[0111] According to one embodiment, in operation 513, the wearable electronic device (401) can identify a first object existing in the real world from an image.

[0112] According to one embodiment, in operation 515, the wearable electronic device (401) may display information about the first object and information about a second object (e.g., a product) based on determining that the first object satisfies a specified condition. For example, the wearable electronic device (401) may display a virtual first window including information about the first object and information about the second object. For example, the specified condition may include a condition for displaying information about the first object and information about a second object related to the first object. According to one embodiment, the second object may include a product similar to the first object. According to one embodiment, the second object may also include an object included in the purchase list of the first purchaser. According to one embodiment, a description of the specified condition is described in detail with reference to FIGS. 6A and 6B.

[0113] For example, information about a first object may include information about the price of the first object, a website where the first object can be purchased, or an offline store where the first object can be purchased. For example, information about a second object may include information about the price of the second object, a website where the second object can be purchased, or an offline store where the second object can be purchased.

[0114] According to one embodiment, in operation 517, the wearable electronic device (401) may confirm a user input to display a second object as a three-dimensional virtual object. For example, the wearable electronic device (401) may confirm a user input to display a second object input in a virtual first window as a three-dimensional virtual object. For example, the user input may include a touch gesture or a long press gesture confirmed through the camera (410).

[0115] According to one embodiment, in operation 519, the wearable electronic device (401) may display a first three-dimensional virtual object corresponding to the second object based on identifying a user input to display the second object as a three-dimensional virtual object.

[0116] According to one embodiment, the wearable electronic device (401) can display a first virtual object around the first object. According to one embodiment, the wearable electronic device (401) can also display the first virtual object by overlaying it on the first object. According to one embodiment, the wearable electronic device (401) can display the first virtual object corresponding to the position of the first object within the user's field of view through the display (460).

[0117] According to one embodiment, the wearable electronic device (401) may determine the size of the first virtual object corresponding to the second object based on the actual size of the second object. For example, the wearable electronic device (401) may determine the size of the first virtual object based on a table representing the relationship between the actual size and the size of the virtual object. According to one embodiment, the wearable electronic device (401) may also adjust the size of the first virtual object based on a user input that adjusts the size of the first virtual object. For example, the user input may include a pinch-zoom gesture or a pinch-out gesture.

[0118] According to one embodiment, in operation 521, the wearable electronic device (401) can determine that the first object is rotating or moving based on an image acquired through the camera (410).

[0119] According to one embodiment, in operation 523, the wearable electronic device (401) may display the first virtual object by rotating or moving it according to the rotation or movement of the first object. Through this, the wearable electronic device (401) according to one embodiment may provide an environment in which the shapes of the first object and a second object related to the first object can be compared.

[0120] FIG. 6A is a flowchart illustrating an operation of a wearable electronic device according to one embodiment to determine whether a first object satisfies a specified condition.

[0121] Referring to FIG. 6A, according to one embodiment, in operation 611, the wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) may determine that a first object included in an image corresponds to a designated object of interest. According to one embodiment, the wearable electronic device (401) may display an icon indicating that the first object corresponds to the designated object of interest around the first object.

[0122] For example, the wearable electronic device (401) may identify a user input designating at least one product from an object list including multiple objects stored in the memory (430) (e.g., the memory (430) of FIG. 4) as an object of interest. Based on the user input, the wearable electronic device (401) may store information about the designated object of interest in the memory (430).

[0123] For example, the wearable electronic device (401) may be connected to a server (402) (e.g., server (402) of FIG. 4) using authentication information (e.g., login information, account information, or identification information) specified in the wearable electronic device (401). The wearable electronic device (401) may also receive information about a product of interest specified by an external electronic device connected to the server (402) from the server (402) using the same authentication information as the authentication information specified in the wearable electronic device (401). For example, the external electronic device may include a mobile phone, a tablet PC, or a computing device.

[0124] According to one embodiment, in operation 613, the wearable electronic device (401) may determine that the first object satisfies a specified condition based on determining that the first object corresponds to a specified object of interest. According to one embodiment, the wearable electronic device (401) may display information about the first object and information about the second object based on determining that the first object satisfies the specified condition. For example, the wearable electronic device (401) may display a virtual first window including information about the first object and information about the second object.

[0125] FIG. 6b is a flowchart illustrating an operation of a wearable electronic device according to one embodiment to determine whether a first object satisfies a specified condition.

[0126] Referring to FIG. 6B, according to one embodiment, in operation 631, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) can detect a user's gaze through a sensor (411) (e.g., the sensor (411) of FIG. 4).

[0127] According to one embodiment, in operation 633, the wearable electronic device (401) may determine that the user's gaze is directed toward the first object for a specified period of time. For example, the specified period of time may be set by the user or may be automatically set by the wearable electronic device (401). According to one embodiment, the wearable electronic device (401) may display an icon indicating that the first object corresponds to the user's gaze around the first object based on determining that the user's gaze is directed toward the first object for a specified period of time.

[0128] According to one embodiment, in operation 635, the wearable electronic device (401) may determine that the first object satisfies a specified condition based on determining that the user's gaze is directed toward the first object for a specified period of time. According to one embodiment, the wearable electronic device (401) may display information about the first object and information about the second object based on determining that the first object satisfies the specified condition. For example, the wearable electronic device (401) may display a virtual first window including information about the first object and information about the second object.

[0129] FIG. 7A is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to display information about a first object and information about a second object.

[0130] Referring to FIG. 7A, according to one embodiment, in operation 711, the wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) may identify a shape, size, color, or material of a first object based on an image including the first object.

[0131] According to one embodiment, in operation 713, the wearable electronic device (401) can identify a second object similar to the first object based on identifying the shape, size, color, or material of the first object.

[0132] For example, the wearable electronic device (401) can identify a second object similar to the first object among a plurality of products stored in the memory (430) (e.g., the memory (430) of FIG. 4) based on information about the shape, size, color, or material of the first object.

[0133] For example, the wearable electronic device (401) may provide information on at least one of the shape, size, color, or material of the first object to the server (402) (e.g., the server (402) of FIG. 4) through the communication circuit (490) (e.g., the communication circuit (490) of FIG. 4). According to one embodiment, the server (402) may identify a second object similar to the first object based on the information on at least one of the shape, size, color, or material of the first object. According to one embodiment, the server (402) may provide information on the second object to the wearable electronic device (401). The wearable electronic device (401) may identify the second object based on the information on the second object obtained from the server (402).

[0134] For example, a wearable electronic device (401) may identify a second object similar to the first object based on providing an image including the first object to an artificial intelligence model. For example, the artificial intelligence model may be stored in a memory (430) (e.g., the memory (430) of FIG. 4 ) or stored in a server (402).

[0135] According to one embodiment, in operation 715, the wearable electronic device (401) may display information about a first object and information about a second object. For example, the wearable electronic device (401) may display a virtual window including information about the first object and information about the second object.

[0136] FIG. 7b is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to display information about a first object and information about a second object.

[0137] Referring to FIG. 7B, according to one embodiment, in operation 731, the wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4 ) may obtain information on a purchase list of a buyer who purchased a first object from a server (402) (e.g., the server (402) of FIG. 4 ). For example, the wearable electronic device (401) may provide a command requesting information on a purchase list of a buyer who purchased the first object to the server (402) through a communication circuit (490) (e.g., the communication circuit (490) of FIG. 4 )) based on determining that the first object corresponds to a designated object of interest or determining that the user's gaze is directed toward the first object for a designated period of time. According to one embodiment, the server (402) may provide information on the purchase list to the wearable electronic device (401) based on the command.

[0138] According to one embodiment, in operation 733, the wearable electronic device (401) can identify a second object from the purchase list.

[0139] According to one embodiment, in operation 735, the wearable electronic device (401) may display information about a first object and information about a second object. For example, the wearable electronic device (401) may display a virtual window including information about the first object and information about the second object.

[0140] FIG. 8 is a drawing for explaining an operation of a wearable electronic device according to one embodiment to confirm a first product based on an image acquired through a camera.

[0141] Referring to (a) of FIG. 8, according to one embodiment, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) may acquire an image including a plurality of products through a camera (410) (e.g., the camera (410) of FIG. 4). For example, based on the image including the plurality of products, the wearable electronic device (401) may display a screen including objects (801, 802, 803) corresponding to each of the plurality of products. For example, the plurality of products may represent products corresponding to pre-designated products of interest.

[0142] Referring to (b) of FIG. 8, according to one embodiment, the wearable electronic device (401) may acquire an image including a first product through a camera (410). According to one embodiment, the wearable electronic device (401) may display a screen including a first object (810) corresponding to the first product based on the image including the first product.

[0143] In one embodiment, the wearable electronic device (401) can determine whether the first product corresponds to a designated product of interest. In one embodiment, if the wearable electronic device (401) determines that the first product corresponds to the designated product of interest, the wearable electronic device (401) can display an icon (820) around the first object (810).

[0144] According to one embodiment, the wearable electronic device (401) can detect the user's gaze through a sensor (411) (e.g., sensor (411) of FIG. 4). According to one embodiment, if the wearable electronic device (401) detects that the user's gaze is directed toward the first product, the wearable electronic device (401) can display an icon (820) around the first object (810).

[0145] Referring to (c) of FIG. 8, according to one embodiment, if the wearable electronic device (401) determines that the first product corresponds to a designated product of interest or that the user's gaze is directed toward the first product, the wearable electronic device (401) may display a virtual object (830) representing a second product related to the first product around the first object (810). For example, the second product may include a product similar to the first product. For example, the second product may also include a product included in the purchase list of a purchaser who purchased the first product.

[0146] FIG. 9 is a diagram for explaining an operation of a wearable electronic device according to one embodiment of the present invention to display information about a first product and information about at least one product related to the first product.

[0147] Referring to FIG. 9, according to one embodiment, when a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) determines that a first product corresponds to a designated product of interest or that the user's gaze is directed toward the first product, the wearable electronic device (401) may display a virtual window (910) including information (920) about the first product and information (930) about at least one product related to the first product on a screen including a first object (810) (e.g., the first object (810) of FIG. 8) corresponding to the first product through a display (460) (e.g., the display (460) of FIG. 4)) around the first object (810).

[0148] According to one embodiment, information (920) about the first product may include information about at least one of the price of the first product, a website where the first product can be purchased, or an offline store where the first product can be purchased.

[0149] In one embodiment, the information (930) regarding at least one product associated with the first product may include an image of at least one product. In one embodiment, the at least one product associated with the first product may include a product included in the purchase list of a purchaser who purchased the first product.

[0150] According to one embodiment, the wearable electronic device (401) may display an indicator (921) (e.g., Add to Cart) in a virtual window (910) to save a first product to a shopping cart list.

[0151] According to one embodiment, the wearable electronic device (401) may display information about a second product (931) when a user input is confirmed to display information about at least one product (930) related to a first product.

[0152] FIG. 10 is a drawing for explaining an operation of a wearable electronic device according to one embodiment of the present invention to display a second product related to a first product as a three-dimensional first virtual object.

[0153] Referring to (a) of FIG. 10, according to one embodiment, when a user input is confirmed to display information on a second product (931 of FIG. 9) among information on at least one product (930 of FIG. 9) related to a first product, the wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) may display information (1010) on the second product (931) in a virtual window (1000). According to one embodiment, the wearable electronic device (401) may further display information (1020) on the remaining products, excluding the second product (931), among at least one product related to the first product, in the virtual window (1000). For example, the information (1020) on the remaining products may include images representing the remaining products.

[0154] According to one embodiment, information (1010) about a second product (931) may include information about at least one of a price of the second product, a website where the second product can be purchased, or an offline store where the second product can be purchased.

[0155] According to one embodiment, the wearable electronic device (401) may further display an indicator (1030) capable of displaying a second product as a three-dimensional virtual object (e.g., view in 3D) in a virtual window (1000).

[0156] Referring to (b) of FIG. 10, according to one embodiment, when a user input for an indicator (1030) is confirmed, the wearable electronic device (401) may display a second product as a three-dimensional virtual object (1040). According to one embodiment, the wearable electronic device (401) may display the three-dimensional virtual object (1040) around the first object (810).

[0157] According to one embodiment, the wearable electronic device (401) can display a three-dimensional virtual object (1040) with a specified size. For example, the specified size may represent a size set by a user or automatically set by the wearable electronic device (401). For example, the specified size may represent the same size as the first object.

[0158] According to one embodiment, the wearable electronic device (401) may display an indicator (1060) that displays the size of the three-dimensional virtual object (1040) as a size corresponding to the actual size of the second product. For example, when a user input for the indicator (1060) that displays the size of the three-dimensional virtual object (1040) as a size corresponding to the actual size of the second product is confirmed, the wearable electronic device (401) may display the three-dimensional virtual object (1040) based on a table representing the relationship between the actual size and the size of the virtual object corresponding to the actual size.

[0159] According to one embodiment, the wearable electronic device (401) may not display the virtual window (1000) based on displaying the second product as a three-dimensional virtual object (1040). According to one embodiment, the wearable electronic device (401) may display an indicator (1050) capable of executing a function of displaying the virtual window (1000). According to one embodiment, when a user input for the indicator (1050) capable of executing a function of displaying the virtual window (1000) is confirmed, the wearable electronic device (401) may display the virtual window (1000).

[0160] FIG. 11 is a drawing for explaining an operation of a wearable electronic device according to one embodiment of the present invention to rotate or move a first virtual object according to rotation or movement of a first product.

[0161] Referring to (a) of FIG. 11, according to one embodiment, the wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) can determine that the first product is rotated by the body (e.g., the hand) (1100) of the user wearing the wearable electronic device (401) based on an image acquired through a camera (410) (e.g., the camera (410) of FIG. 4). According to one embodiment, the wearable electronic device (401) can rotate (1120) the first object (810) corresponding to the first product (e.g., the first object (810) of FIG. 8) and display a three-dimensional virtual object (1040) (e.g., 1040 of FIG. 10) corresponding to the second product by rotating (1130) as the first object (810) corresponding to the first product is rotated (1120).

[0162] Referring to (b) of FIG. 11, according to one embodiment, the wearable electronic device (401) can determine that the first product is moved by the body (e.g., hand) (1100) of the user wearing the wearable electronic device (401) based on an image acquired through the camera (410). According to one embodiment, the wearable electronic device (401) can display a three-dimensional virtual object (1040) corresponding to the second product by moving (1140) the first object (810) corresponding to the first product as the first object (810) corresponding to the first product moves (1130).

[0163] FIG. 12 is a drawing for explaining an operation of a wearable electronic device according to one embodiment of the present invention to overlay and display a first virtual object on a first object.

[0164] Referring to FIG. 12, according to one embodiment, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) may display a three-dimensional virtual object (1040) (e.g., 1040 of FIG. 10) corresponding to a second product by overlaying (1200) a first object (810) corresponding to the first product (e.g., the first object (810) of FIG. 8)) upon confirmation of a user input for an indicator (1030) (e.g., 3D view) (e.g., 1030 of FIG. 10) capable of executing a function of displaying a second product as a three-dimensional virtual object.

[0165] Alternatively, according to one embodiment, when a user input is confirmed to drag a three-dimensional virtual object (1040) corresponding to a second product displayed adjacent to a first object (810) to a location where the first object (810) is displayed, the wearable electronic device (401) may display a three-dimensional virtual object (1040) corresponding to a second product by overlaying (1200) the three-dimensional virtual object (1040) on the first object (810).

[0166] FIG. 13A is a diagram for explaining an operation of a wearable electronic device displaying a shopping cart list according to one embodiment.

[0167] Referring to (a) of FIG. 13A, according to one embodiment, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) may display a virtual window (1310) including a shopping cart list.

[0168] According to one embodiment, the shopping cart list may include products identified through the camera (410) (e.g., camera (410) of FIG. 4) and products included in the purchase list of a purchaser who purchased the products identified through the camera (410). For example, the wearable electronic device (401) may store products identified through the camera (410) in the shopping cart based on a user input confirmed for an indicator (921) (e.g., 910 of FIG. 9) for storing the products identified through the camera (410) in the shopping cart with respect to a virtual window (910) (e.g., 910 of FIG. 9).

[0169] Referring to (b) of FIG. 13a, according to one embodiment, the wearable electronic device (401) can confirm a user input for selecting a product (1320) from a shopping cart list.

[0170] In one embodiment, the wearable electronic device (401) may display a virtual window (1330) containing information about the selected first product (1320) based on a user input selecting the first product (1320) from the shopping cart list. In one embodiment, the virtual window (1330) may further display information about other products included in the shopping cart list.

[0171] According to one embodiment, the wearable electronic device (401) may display an indicator (1340) that displays the selected first product (1320) as a three-dimensional virtual object (e.g., view in 3D).

[0172] FIG. 13b is a diagram for explaining an operation of a wearable electronic device displaying a shopping cart list according to one embodiment.

[0173] Referring to (a) of FIG. 13B, according to one embodiment, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) may display the selected first product (1320) (e.g., 1320 of FIG. 13A) as a three-dimensional first virtual object based on confirming a user input for an indicator (1340) (e.g., 1340 of FIG. 13A) that displays the selected first product (1320) as a three-dimensional first virtual object (1360).

[0174] According to one embodiment, the wearable electronic device (401) may display a virtual window containing information about the second product (1350) based on confirming a user input selecting the second product (1350) (e.g., 1350 of FIG. 13A) from a shopping cart list.

[0175] According to one embodiment, the wearable electronic device (401) may display the second product (1350) as a three-dimensional second virtual object (1380) based on confirming a user input for an indicator (1370) (e.g., displaying in 3D) that causes the second product (1350) entered in a virtual window to be displayed as a three-dimensional second virtual object.

[0176] Referring to (b) of FIG. 13, according to one embodiment, when a user input to rotate the first virtual object (1360) is confirmed, the wearable electronic device (401) may rotate (1361) the first virtual object (1360) and display it. According to one embodiment, the wearable electronic device (401) may rotate (1381) the second virtual object (1380) and display it according to the rotation of the first virtual object (1360). According to one embodiment, the user input may include a drag gesture.

[0177] FIG. 14 is a diagram illustrating an operation of a wearable electronic device according to one embodiment of the present invention to display a three-dimensional virtual object corresponding to a first product based on confirmation of a user input for selecting a color of the first product.

[0178] Referring to (a) of FIG. 14, according to one embodiment, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) can confirm a user input to select a specific color (1410) among a plurality of colors (1400) of a first object (810) (e.g., the first object (810) of FIG. 8).

[0179] Referring to (b) of FIG. 14, according to one embodiment, the wearable electronic device (401) may display an indicator (1402) representing a function to display a three-dimensional virtual object corresponding to a first object (810) based on confirming a user input to select a specific color (1410).

[0180] In one embodiment, the wearable electronic device (401) may display an image (or thumbnail) (1403) representing a first object of the selected specific color (1410) based on identifying a user input to select a specific color (1410).

[0181] Referring to (c) of FIG. 14, according to one embodiment, the wearable electronic device (401) may display a three-dimensional virtual object (1430) of a specific color around the first object (810) based on confirming a user input for an indicator (1402) indicating a function to display a three-dimensional virtual object corresponding to the first object (810). According to one embodiment, the wearable electronic device (401) may display a plurality of colors (1440) that can be applied to the three-dimensional virtual object (1430) of the specific color. According to one embodiment, the wearable electronic device (401) may change the specific color of the three-dimensional virtual object (1430) to the selected color and display it based on a user input for selecting one of the plurality of colors (1440).

[0182] FIG. 15 is a diagram for explaining an operation of displaying a virtual window including information about a plurality of designated products of interest when a wearable electronic device according to one embodiment checks a plurality of designated products of interest through a camera.

[0183] Referring to (a) of FIG. 15, according to one embodiment, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) can check a first product (810) and a fourth product (1510) through a camera (410) (e.g., the camera (410) of FIG. 4).

[0184] According to one embodiment, the wearable electronic device (401) can determine that the first product (810) and the fourth product (1510) correspond to designated products of interest, or can determine that the user's gaze is directed toward the first product (810) and the fourth product (1510) through a sensor (411) (e.g., sensor (411) of FIG. 4).

[0185] According to one embodiment, the wearable electronic device (401) may display a virtual window (1500) including information (1520) about the first product (810) and information (1530) about the fourth product (1510) based on determining that the first product (810) and the fourth product (1510) correspond to designated products of interest or determining that the user's gaze is directed toward the first product (810) and the fourth product (1510).

[0186] According to one embodiment, information (1520) about the first product (810) may include information about the price of the first product (810), a website where the first product (810) can be purchased, or an offline store where the first product (810) can be purchased.

[0187] According to one embodiment, information (1530) about the fourth product (1510) may include information about the price of the fourth product (1510), a website where the fourth product (1510) can be purchased, or an offline store where the fourth product (1510) can be purchased.

[0188] According to one embodiment, the wearable electronic device (401) may further display information (1540) regarding the purchase list of a purchaser who purchased the first product (810) and the purchase list of a purchaser who purchased the fourth product (1510) in a virtual window (1500). For example, the wearable electronic device (401) may display information (1540) regarding the purchase list of a purchaser who purchased the first product (810) and the purchase list of a purchaser who purchased the fourth product (1510) as images.

[0189] According to one embodiment, the wearable electronic device (401) can confirm a user input to display a fifth product (1541) as a three-dimensional virtual object from the purchase list of a purchaser who purchased a fourth product (1510).

[0190] Referring to (b) of FIG. 15, according to one embodiment, the wearable electronic device (401) may display a three-dimensional virtual object (1550) representing the fifth product (1541) at a location adjacent to the fourth product (1510) based on confirming a user input to display the fifth product (1541) as a three-dimensional virtual object.

[0191] In one embodiment, the wearable electronic device (401) may not display the virtual window (1500) based on confirming a user input to display the fifth product (1541) as a three-dimensional virtual object. In one embodiment, the wearable electronic device (401) may display an indicator (1560) that enables the display of the virtual window (1500) based on not displaying the virtual window (1500).

[0192] According to one embodiment, the wearable electronic device (401) can display the virtual window (1500) when a user input is confirmed for an indicator (1560) that enables the display of the virtual window (1500).

[0193] According to one embodiment, a wearable electronic device (401) may include a camera (410), at least one processor (420), a display (460), and a memory (430) for storing instructions.

[0194] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (420), may cause the wearable electronic device (401) to identify a first object existing in the real world from a first image around the wearable electronic device acquired through the camera.

[0195] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (420), may cause the wearable electronic device (401) to display information about a second object related to the first object through the display based on determining that the first object corresponds to a designated object of interest.

[0196] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (420), may cause the wearable electronic device (401) to display a virtual first three-dimensional object of the second object corresponding to a location of the first object within the user's field of view through the display, based on receiving a user input regarding information about the second object.

[0197] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (420), may cause the wearable electronic device (401) to, based on determining that the first object rotates or moves using a second image acquired through the camera (410), rotate or move the first 3D object according to the rotation or movement of the first object and display the first 3D object around the first object within the user's field of view through the display (460).

[0198] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (420), may cause the wearable electronic device (401) to detect the user's gaze through the sensor (411).

[0199] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (420), may cause the wearable electronic device (401) to display information about the first object through the display (460) based on determining that the user's gaze is directed toward the first object for a specified period of time.

[0200] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (420), may cause the wearable electronic device (401) to obtain information about a purchase list of a purchaser who purchased the first object from a server (402) via the communication circuit (490).

[0201] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (420), may cause the wearable electronic device (401) to check information about the second object from the purchase list.

[0202] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (420), may cause the wearable electronic device (401) to identify a second object similar to the first object based on at least one of a shape, a size, a color, or a material of the first object.

[0203] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (420), may cause the wearable electronic device (401) to determine a size of the first three-dimensional object corresponding to the second object based on a real size of the second object.

[0204] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (420), may cause the wearable electronic device (401) to display the first three-dimensional object as an overlay over the first object through the display (460).

[0205] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (420), may cause the wearable electronic device (401) to store the first object and the second object in the shopping cart list based on identifying a user input to store the first object and the second object in the shopping cart list.

[0206] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (420), may cause the wearable electronic device (401) to, after storing the first object and the second object in the shopping cart list, display information about a shopping cart list including the first object and the second object when a user input to display the shopping cart list is confirmed.

[0207] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (420), may cause the wearable electronic device (401) to display a virtual second three-dimensional object corresponding to the third object included in the shopping cart list based on identifying a user input that causes the third object to be displayed as a three-dimensional virtual object.

[0208] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (420), may cause the wearable electronic device (401) to display, through the display (460), an icon around the first object indicating that the first object is the designated object of interest.

[0209] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (420), may cause the wearable electronic device (401) to display a virtual third three-dimensional object corresponding to the first object of the specific color based on identifying a user input selecting a specific color different from the color of the first object.

[0210] According to one embodiment, the information about the second object may include information about the price of the second object, a website where the second object can be purchased, or an offline store where the second object can be purchased.

[0211] According to one embodiment, a method of operating a wearable electronic device (401) may include an operation of identifying a first object existing in the real world from a first image around the wearable electronic device obtained through a camera (410) of the wearable electronic device.

[0212] According to one embodiment, a method of operating a wearable electronic device (401) may include an operation of displaying information about a second object related to the first object through a display (460) of the wearable electronic device based on determining that the first object corresponds to a designated object of interest.

[0213] According to one embodiment, a method of operating a wearable electronic device (401) may include an operation of displaying a virtual first three-dimensional object of the second object corresponding to a location of the first object within the user's field of view through the display, based on receiving a user input regarding information about the second object.

[0214] According to one embodiment, the operating method of the wearable electronic device (401) may include an operation of displaying the first 3D object around the first object within the user's field of view by rotating or moving the first object according to the rotation or movement of the first object through the display based on confirming that the first object is rotated or moved using the second image acquired through the camera.

[0215] According to one embodiment, a method of operating a wearable electronic device (401) may include an operation of confirming the user's gaze through a sensor (411) of the wearable electronic device (401).

[0216] According to one embodiment, a method of operating a wearable electronic device (401) may include an operation of displaying information about the first object through the display based on determining that the user's gaze is directed toward the first object for a specified period of time.

[0217] According to one embodiment, the method of operating the wearable electronic device (401) may include an operation of obtaining information on a purchase list of a purchaser who purchased the first object from a server (402) through a communication circuit (490) of the wearable electronic device.

[0218] According to one embodiment, the method of operating the wearable electronic device (401) may include an operation of checking information about the second object from the purchase list.

[0219] According to one embodiment, the method of operating the wearable electronic device (401) may include an operation of identifying a second object similar to the first product based on at least one of a shape, size, color, or material of the first object.

[0220] According to one embodiment, the method of operating the wearable electronic device (401) may include an operation of determining a size of the first three-dimensional object corresponding to the second object based on the actual size of the second object.

[0221] According to one embodiment, the method of operating the wearable electronic device (401) may include an operation of displaying the first three-dimensional object by overlaying it on the first object through the display (460).

[0222] According to one embodiment, a method of operating a wearable electronic device (401) may include an operation of storing the first object and the second object in a shopping cart list based on a user input to store the first object and the second object in the shopping cart list.

[0223] According to one embodiment, the operating method of the wearable electronic device (401) may include an operation of displaying information about a shopping cart list including the first object and the second object on the screen when a user input for displaying the shopping cart list is confirmed after storing the first object and the second object in the shopping cart list.

[0224] According to one embodiment, a method of operating a wearable electronic device (401) may include an operation of displaying a virtual second three-dimensional object corresponding to a third object included in the shopping cart list based on confirming a user input to display the third object as a three-dimensional virtual object.

[0225] According to one embodiment, a non-transitory storage medium storing computer-readable instructions, wherein the instructions, when executed by at least one processor (420) of a wearable electronic device (401), cause the wearable electronic device (401) to perform at least one operation, wherein the at least one operation may include an operation of identifying a first object existing in the real world from a first image around the wearable electronic device (401) acquired through a camera (410) of the wearable electronic device.

[0226] According to one embodiment, a non-transitory storage medium storing computer-readable instructions, wherein the instructions, when executed by at least one processor (420) of a wearable electronic device (401), cause the wearable electronic device (401) to perform at least one operation, wherein the at least one operation may include an operation of displaying information about a second object related to the first object through a display (460) of the wearable electronic device (401) based on determining that the first object corresponds to a designated object of interest.

[0227] According to one embodiment, a non-transitory storage medium storing computer-readable instructions, wherein the instructions, when executed by at least one processor (420) of a wearable electronic device (401), cause the wearable electronic device (401) to perform at least one operation, wherein the at least one operation may include an operation of displaying a virtual first three-dimensional object of the second object corresponding to a location of the first object within the user's field of view through the display based on receiving a user input regarding information about the second object.

[0228] According to one embodiment, a non-transitory storage medium storing computer-readable instructions, wherein the instructions, when executed by at least one processor (420) of a wearable electronic device (401), cause the wearable electronic device (401) to perform at least one operation, wherein the at least one operation may include an operation of rotating or moving the first three-dimensional object according to the rotation or movement of the first object through the display (460) and displaying the first three-dimensional object around the first object within the user's field of view based on confirming that the first object rotates or moves using a second image acquired through the camera (410).

[0229] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments disclosed in this document are not limited to the aforementioned devices.

[0230] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0231] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0232] Various embodiments of the present document may be implemented as software (e.g., program (140)) including one or more commands stored in a storage medium (e.g., built-in memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101, 200, 300, 401)). For example, a processor (e.g., processor (120, 420)) of a machine (e.g., electronic device (101, 200, 300, 401)) may call at least one command among the one or more commands stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the called at least one command. The one or more commands may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'Non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0233] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0234] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In a wearable electronic device (401) worn by a user, Camera (410); display (460); A memory (430) for storing computer-executable instructions; and comprising one or more processors (420) connected to communicate with the above memory, The above instructions, when individually or collectively executed by the one or more processors, cause the wearable electronic device to: Identifying a first object existing in the real world from a first image around the wearable electronic device acquired through the camera, Based on the determination that the first object corresponds to a designated object of interest, information about a second object related to the first object is displayed through the display, Based on receiving user input regarding information about the second object, displaying a virtual first three-dimensional object of the second object corresponding to the location of the first object within the user's field of view through the display, A wearable electronic device characterized in that it includes instructions for causing the first 3D object to be rotated or moved in accordance with the rotation or movement of the first object through the display and displayed around the first object within the user's field of view based on confirming that the first object is rotated or moved using the second image acquired through the camera.

2. In paragraph 1, Including a sensor (411), The instructions, when individually or collectively executed by the one or more processors, cause the wearable electronic device to: Through the above sensor, the user's gaze is confirmed, A wearable electronic device characterized by including instructions that cause information about the first object to be displayed through the display based on determining that the user's gaze is directed toward the first object for a specified period of time.

3. In paragraph 1 or 2, Further comprising a communication circuit (490), The instructions, when individually or collectively executed by the one or more processors, cause the wearable electronic device to: Through the above communication circuit, information on the purchase list of the purchaser who purchased the first object is obtained from the server (402), A wearable electronic device characterized by including instructions that cause information about the second object to be checked from the purchase list.

4. In any one of paragraphs 1 to 3, The instructions, when individually or collectively executed by the one or more processors, cause the wearable electronic device to: A wearable electronic device characterized by including instructions that cause the second object to be identified as similar to the first object based on at least one of the shape, size, color, or material of the first object.

5. In any one of paragraphs 1 to 4, The instructions, when individually or collectively executed by the one or more processors, cause the wearable electronic device to: A wearable electronic device characterized by including instructions for determining a size of the first three-dimensional object corresponding to the second object based on the actual size of the second object.

6. In any one of paragraphs 1 to 5, The instructions, when individually or collectively executed by the one or more processors, cause the wearable electronic device to: A wearable electronic device characterized by including instructions that cause the first three-dimensional object to be displayed by overlaying it on the first object through the display.

7. In any one of paragraphs 1 to 6, The instructions, when individually or collectively executed by the one or more processors, cause the wearable electronic device to: Based on verifying a user input to store the first object and the second object in the shopping cart list, storing the first object and the second object in the shopping cart list, A wearable electronic device characterized in that it includes instructions that cause information about a shopping cart list including the first object and the second object to be displayed when a user input for displaying the shopping cart list is confirmed after storing the first object and the second object in the shopping cart list.

8. In any one of paragraphs 1 to 7, The instructions, when individually or collectively executed by the one or more processors, cause the wearable electronic device to: A wearable electronic device characterized by including instructions that cause a virtual second three-dimensional object corresponding to a third object to be displayed based on a user input that causes a third object included in the shopping cart list to be displayed as a three-dimensional virtual object.

9. In any one of paragraphs 1 to 8, The instructions, when individually or collectively executed by the one or more processors, cause the wearable electronic device to: A wearable electronic device characterized by including instructions that cause an icon indicating that the first object is the designated object of interest to be displayed around the first object through the display.

10. In any one of paragraphs 1 to 9, The instructions, when individually or collectively executed by the one or more processors, cause the wearable electronic device to: A wearable electronic device characterized by including instructions that cause a virtual third three-dimensional object corresponding to the first object of the specific color to be displayed based on a user input selecting a specific color different from the color of the first object.

11. In any one of paragraphs 1 to 10, A wearable electronic device, characterized in that the information about the second object includes information about the price of the second object, a website where the second object can be purchased, or an offline store where the second object can be purchased.

12. In the operating method of a wearable electronic device (401) worn by a user, An operation of identifying a first object existing in the real world from a first image around the wearable electronic device obtained through a camera (410) of the wearable electronic device; An action of displaying information about a second object related to the first object through a display (460) of the wearable electronic device based on determining that the first object corresponds to a designated object of interest; An operation of displaying a virtual first three-dimensional object of the second object corresponding to a location of the first object within the user's field of view through the display based on receiving a user input regarding information about the second object; and A method of operating a wearable electronic device, characterized in that it includes an operation of displaying the first 3D object around the first object within the user's field of view by rotating or moving the first object according to the rotation or movement of the first object through the display based on confirming that the first object is rotating or moving using the second image acquired through the camera.

13. In paragraph 12, An action of confirming the user's gaze through the sensor (411) of the wearable electronic device; and A method of operating a wearable electronic device, characterized in that it further includes an action of displaying information about the first object through the display based on confirming that the user's gaze is directed toward the first object for a specified period of time.

14. In paragraph 12 or 13, An operation of obtaining information about a purchase list of a purchaser who purchased the first object from a server (402) through a communication circuit (490) of the wearable electronic device; and A method of operating a wearable electronic device, characterized in that it further includes an action of checking information about the second object from the purchase list.

15. In a non-transitory storage medium storing computer-readable instructions, the instructions, when executed by at least one processor (420) of a wearable electronic device (401), cause the wearable electronic device to perform at least one operation, the at least one operation being: An operation of identifying a first object existing in the real world from a first image around the wearable electronic device obtained through a camera (410) of the wearable electronic device; An action of displaying information about a second object related to the first object through a display (460) of the wearable electronic device based on determining that the first object corresponds to a designated object of interest; An operation of displaying a virtual first three-dimensional object of the second object corresponding to a location of the first object within the user's field of view through the display based on receiving a user input regarding information about the second object; and A storage medium characterized by including an operation of rotating or moving the first 3D object according to the rotation or movement of the first object through the display and displaying the first 3D object around the first object within the user's field of view based on confirming that the first object is rotating or moving using the second image acquired through the camera.

Images