Wearable device and method for displaying multimedia content provided by external electronic device

Abstract

A processor of a wearable device according to an embodiment may identify an external electronic device based on a first object in an image obtained using a camera. The processor may request information for displaying multimedia content provided via the external electronic device from the external electronic device via the communication circuitry based on the identification. The processor may, in response to receiving information transmitted from the external electronic device via the communication circuit, display a second object for notifying the external electronic device that is selectable in association with the first object. The processor may display, via the display, multimedia content obtained from the external electronic device according to the information based on whether the user input for the first object is detected.

Description

Technical Field

[0001] The present disclosure relates to a wearable device for displaying multimedia content provided by an external electronic device and a method thereof. Background Art

[0002] To provide an enhanced user experience, an electronic device that provides an augmented reality (AR) service, which displays information generated by a computer in combination with an external object in the real world, is being developed. The electronic device may be a wearable device that can be worn by a user. For example, the electronic device may be AR glasses and / or a head-mounted device (HMD). Summary of the Invention

[0003] Technical Solution

[0004] A wearable device according to an embodiment may include a communication circuit, a display, a camera, a memory storing instructions, and a processor. The instructions, when executed by the processor, may cause the wearable device to identify an external electronic device based on a first object within an image obtained using the camera. The instructions, when executed by the processor, may cause the wearable device to request, based on the identification, information for displaying multimedia content provided by the external electronic device through the communication circuit from the external electronic device. The instructions, when executed by the processor, may cause the wearable device to display a second object in combination with the first object to notify that the external electronic device is selectable in response to information received from the external electronic device through the communication circuit. The instructions, when executed by the processor, may cause the wearable device to display multimedia content obtained from the external electronic device based on the information through the display based on whether a user input regarding the first object is detected.

[0005] A method of a wearable device according to an embodiment may include identifying an external electronic device based on a first object within an image obtained using the camera. The method may include: requesting, based on the identification, information for displaying multimedia content provided by the external electronic device through the communication circuit from the external electronic device. The method may include: displaying a second object in combination with the first object to notify that the external electronic device is selectable in response to information received from the external electronic device through the communication circuit. The method may include: displaying multimedia content obtained from the external electronic device based on the information through the display based on whether a user input regarding the first object is detected.

[0006] A computer-readable storage medium storing one or more programs, which when executed by a processor of a wearable device, can cause the processor of the wearable device to identify an external electronic device based on a first object within an image obtained using a camera. When the one or more programs are executed by the processor of the wearable device, it can cause the processor of the wearable device to request information from the external electronic device via a communication circuit based on the identification to display multimedia content provided by the external electronic device. When the one or more programs are executed by the processor of the wearable device, it can cause the processor of the wearable device to display a second object in combination with the first object in response to receiving information transmitted from the external electronic device via the communication circuit to notify that the external electronic device is selectable. When the one or more programs are executed by the processor of the wearable device, it can cause the processor of the wearable device to display multimedia content obtained from the external electronic device based on the information via a display based on whether a user input regarding the first object is detected. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Figure 1 An example of the usage state of a wearable device according to an embodiment is shown.

[0008] Figure 2 An example of a block diagram of a wearable device according to an embodiment is shown.

[0009] Figure 3a An example of a perspective view of a wearable device according to an embodiment is shown.

[0010] Figure 3b An example of one or more hardware components provided in a wearable device according to an embodiment is shown.

[0011] Figures 4a to 4b An example of the exterior of a wearable device according to an embodiment is shown.

[0012] Figure 5 An example of a screen displayed via a display of a wearable device according to an embodiment is shown.

[0013] Figure 6 An example of a screen displayed via a display of a wearable device according to an embodiment is shown.

[0014] Figure 7 An example of a screen displayed via a display of a wearable device according to an embodiment is shown.

[0015] Figure 8 An example of the usage state of a wearable device according to an embodiment is shown.

[0016] Figure 9 An example of a screen displayed via a display of a wearable device according to an embodiment is shown.

[0017] Figure 10 Shows an example of a screen displayed on a display of a wearable device according to an embodiment.

[0018] Figure 11 Shows an example of a flowchart of operations of a wearable device according to an embodiment.

[0019] Figure 12 Shows an example of a signal flowchart of operations of a wearable device according to an embodiment.

[0020] Figure 13 Is an example diagram of a network environment in which a metaverse service is provided by a server. Detailed Description

[0021] Hereinafter, various embodiments of this document will be described with reference to the accompanying drawings.

[0022] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technology described herein to a specific embodiment, and include various changes, equivalents, or substitutions of the corresponding embodiments. Regarding the description of the drawings, like reference numerals may be used to refer to like elements. It should be understood that unless the relevant context clearly indicates otherwise, the singular form of a noun corresponding to an item may include one or more things. As used herein, the phrases "A or B", "at least one of A and / or B", "A, B, or C", or "at least one of A, B, and / or C" may include all possible combinations of the items listed together. Terms such as "first" and "second" or "1st" and "2nd" may modify the corresponding components regardless of order or importance, and are only used to simply distinguish one component from another, and do not limit the corresponding components. When a (e.g., first) component is referred to as being "connected (functionally or communicatively)" or "accessing" another (e.g., second) component, the component may be directly connected to the other component or may be connected through another component (e.g., a third component).

[0023] The term "module" used in the present disclosure may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic", "logic block", "component", or "circuit"). A module may be a single integrated component or its smallest unit or part adapted to perform one or more functions. For example, a module may be configured as an application-specific integrated circuit (ASIC).

[0024] Figure 1 Shows an example of the usage state of a wearable device according to an embodiment. Refer to Figure 1, the wearable device 101 according to an embodiment may include a head-mounted display (HMD) wearable on a user's head. Although the appearance of the wearable device 101 in the form of glasses is shown, the embodiment is not limited thereto. Refer to Figures 3a to 3b and / or Figures 4a to 4b Examples of the structure of the wearable device 101 wearable on a user's head are described. Refer to Figure 2 One or more hardware components included in the wearable device 101 are exemplarily described. Figure 1 The first object 110 (e.g., an external electronic device) may include a terminal owned by the user. For example, the first object 110 may include smart accessories such as a smart phone, a smart tablet, a tablet personal computer (PC), and a smart watch. For example, the external electronic device may include a controller connected to the wearable device 101 through a communication circuit.

[0025] The wearable device 101 according to an embodiment may perform functions associated with augmented reality (AR) and / or mixed reality (MR). Refer to Figure 1 , in a state where the user wears the wearable device 101, the wearable device 101 may include at least one lens disposed adjacent to the user's eyes. The wearable device 101 may combine ambient light passing through the lens with light radiated from the display of the wearable device 101. The display area of the display may be formed within the lens through which the ambient light passes. Since the wearable device 101 combines ambient light and light radiated from the display, the user may see an image in which a real object recognized by the ambient light and a virtual object formed by the light radiated from the display are mixed.

[0026] The wearable device 101 according to an embodiment may perform functions associated with video see-through (VST) and / or virtual reality (VR). Refer to Figure 1 , in a state where the user wears the wearable device 101, the wearable device 101 may include a housing covering the user's eyes. The wearable device 101 may include a display disposed on a first surface facing the eyes within the state. The wearable device 101 may include a camera disposed on a second surface opposite to the first surface. Using the camera, the wearable device 101 may obtain a frame including ambient light. The wearable device 101 may enable the user to recognize the ambient light through the display by outputting the frame in the display disposed on the first surface. The display area disposed on the first surface of the display may be formed by one or more pixels included in the display. The wearable device 101 may enable the user to recognize a virtual object and a real object recognized by the ambient light by synthesizing the virtual object in the frame output through the display.

[0027] Refer to Figure 1, the wearable device 101 according to an embodiment may obtain an image using a camera. The wearable device 101 may display a screen 100 that expresses (or represents) the image. The wearable device 101 may identify a first object 110 within the image obtained using the camera. The wearable device 101 may identify an external object corresponding to the first object 110 based on the identification of the first object. For example, the external object may be an external electronic device.

[0028] The wearable device 101 according to an embodiment may, based on the identification of the first object 110, request information from an external electronic device through a communication circuit to display multimedia content provided by the external electronic device. For example, the wearable device 101 may request information for displaying multimedia content from a first external electronic device through a second external electronic device (e.g., a server) different from the first external electronic device. For example, the first external electronic device may be a device including a display, such as a TV or a computer monitor. For example, the first external electronic device may be a device including a display, such as a smart phone, a smart tablet, or a tablet PC. For example, the first external electronic device may be a device capable of providing multimedia content through a display. However, it is not limited thereto. The wearable device 101 according to an embodiment may identify first user information logged in to the first external electronic device corresponding to the first object 110 and second user information logged in to the wearable device 101. For example, the wearable device 101 may identify the sameness of the first user information and the second user information. For example, the wearable device 101 may request information for displaying multimedia content provided by the external electronic device based on the sameness of the first user information and the second user information. For example, the wearable device 101 may request information based on the fact that the first user information and the second user information are at least partially the same.

[0029] The wearable device 101 according to an embodiment may receive information sent from the first external electronic device at least partially based on the request for information for displaying multimedia content. For example, the wearable device 101 may receive the information through a communication circuit. For example, the wearable device 101 may receive the information sent from the first external electronic device through a second external electronic device. In response to receiving the information, the wearable device 101 may display a second object 115 to notify that the external electronic device is selectable. For example, the wearable device 101 may display the second object 115 in combination with the first object 110. For example, the wearable device 101 may notify that the first object 110 is selectable through the first object 110 or a third object 120 different from the first object 110. For example, the third object 120 may be displayed in a region different from the first object 110 and the second object 120. For example, the second object 115 may be displayed along the edge of the first object 110. For example, although the second object 115 is in Figure 1is displayed as the boundary of the first object 110, but the second object 115 can be an object superimposed on the first object 110. The wearable device 101 can be displayed by flashing the second object 115 superimposed on the first object 110. For example, the wearable device 101 can display the second object 115 along the edge of the first object 110. For example, the wearable device 101 can superimpose the second object 115 on the first object 110 and display it by flashing. The wearable device 101 can highlight that the first object 110 can be selected by the third object 120. For example, the third object 120 can be displayed in a different area from the first object 110. For example, the first object 110 can be visually highlighted relative to at least one third object within the image. For example, the wearable device 101 can highlight the third object 120 in a state where information for displaying multimedia content provided from an external electronic device can be requested. For example, in this state, the wearable device 101 can indicate that the external electronic device can be selected by flashing the third object 120 or changing the third object 120 to a different color.

[0030] The wearable device 101 according to an embodiment can receive an input regarding the first object 110. The wearable device 101 can recognize an input regarding the third object 120. The wearable device 101 can display multimedia content through a display based on information for displaying multimedia content in response to an input regarding the first object 110 and / or the third object 120. For example, the wearable device 101 can provide multimedia content through a display after the multimedia content provided by an external electronic device. The operation of displaying multimedia content through the display will be described later in Figure 5 is described.

[0031] As described above, the wearable device 101 according to an embodiment may identify a first object 110 within an image obtained using a camera. The wearable device 101 may identify an external electronic device corresponding to the first object 110 based on the first object 110. Based on this identification, the wearable device 101 may request information from the first external electronic device via a communication circuit to display multimedia content provided by the first external electronic device. The wearable device 101 may display a second object 115 and / or a third object 120 to notify that the first external electronic device is selectable in response to receiving information sent from the first external electronic device via the communication circuit at least partially based on the request. The wearable device 101 may display multimedia content via a display based on information in response to an input received regarding the first object 110 and / or the third object 120. For example, the wearable device 101 may display multimedia content based on the entire area of the display and / or an area exceeding a specified ratio of the entire area. The wearable device 101 may enhance the user experience of the wearable device 101 by displaying multimedia content based on receiving information associated with the multimedia content provided by the first external electronic device.

[0032] Figure 2 An example of a block diagram of a wearable device according to an embodiment is shown. Figure 2 The wearable device 101 may include Figure 1 The wearable device 101.

[0033] Reference Figure 2 , the wearable device 101 according to an embodiment may include at least one of a processor 210, a memory 220, a display 230, a communication circuit 240, or a camera 250. The processor 210, the memory 220, the display 230, the communication circuit 240, and the camera 250 may be electronically and / or operably coupled to each other via an electronic component (such as a communication bus 205). Hereinafter, hardware being operably coupled may mean establishing a direct or indirect connection between the hardware in a wired or wireless manner so that a second hardware can be controlled by a first hardware among the hardware. Although shown in different boxes, the embodiment is not limited thereto. Figure 2 A part of the hardware (e.g., at least a part of the processor 210, the memory 220, and the communication circuit 240) may be included in a single integrated circuit (such as a system on a chip (SoC)). The type and / or quantity of the hardware included in the wearable device 101 are not limited to Figure 2 the hardware shown in Figure 2 For example, the wearable device 101 may only include

[0034] The wearable device 101 according to an embodiment may include hardware for processing data based on one or more instructions. For example, the hardware for processing data may include a processor 210. For example, the hardware for processing data may include an arithmetic and logic unit (ALU), a floating point unit (FPU), a field programmable gate array (FPGA), a central processing unit (CPU), and / or an application processor (AP). The processor 210 may have a structure of a single-core processor, or may have a structure of a multi-core processor such as a dual-core, quad-core, hex-core, or octa-core processor. Figure 1 The operations and / or the operations described later may be executed by the processor 210.

[0035] The memory 220 of the wearable device 101 according to an embodiment may include components for storing data and / or instructions input to the processor 210 and / or output from the processor 210 of the wearable device 101. For example, the memory 220 may include a volatile memory (such as a random access memory (RAM)) and / or a non-volatile memory (such as a read-only memory (ROM)). For example, the volatile memory may include at least one of a dynamic RAM (DRAM), a static RAM (SRAM), a cache RAM, and a pseudo SRAM (PSRAM). For example, the non-volatile memory may include at least one of a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), a flash memory, a hard disk, an optical disk, a solid state drive (SSD), and an embedded multimedia card (eMMC).

[0036] The display 230 of the wearable device 101 according to an embodiment may output visual information to a user. For example, the display 230 may output visual information to a user under the control of the processor 210 including a circuit such as a graphics processing unit (GPU). The display 230 may include a flat panel display (FPD) and / or an electronic paper. The FPD may include a liquid crystal display (LCD), a plasma display panel (PDP), and / or one or more light emitting diodes (LEDs). The LED may include an organic LED (OLED). The wearable device 101 according to an embodiment may provide virtual reality and / or augmented reality through the display 230. The virtual reality may include synthesizing a virtual object on an image obtained through the camera 250. For example, the virtual reality may include mixed reality. For example, the wearable device 101 may display an image obtained through the camera 250 through the display 230. For example, the operation of displaying an image obtained through the camera 250 may be referred to as a video see-through (VST) mode.

[0037] The communication circuit 240 of the wearable device 101 according to an embodiment may include hardware components to support the transmission and / or reception of electrical signals between the wearable device 101 and an external electronic device 103. For example, the communication circuit 240 may include at least one of a modem, an antenna, and an optical / electrical (O / E) converter. The communication circuit 240 may support the transmission and / or reception of electrical signals based on various types of protocols such as Ethernet, local area network (LAN), wide area network (WAN), wireless fidelity (WiFi), Bluetooth®, Bluetooth low energy (BLE), ZigBee, long term evolution (LTE), and fifth generation new radio (5G NR). The wearable device 101 may establish a communication link with the external electronic device through the communication circuit 240. For example, the wearable device 101 may transmit and / or receive electrical signals through the communication circuit 240 to request information. For example, the wearable device 101 may request information from the external electronic device through the communication circuit 240 to display multimedia content provided by the external electronic device. The wearable device 101 may send second user information logged in to the wearable device 101 to the external electronic device to request first user information logged in to the external electronic device. The wearable device 101 may encrypt the second user information and send the encrypted second user information to the external electronic device. The external electronic device may identify the identity of the first user information and the second user information based on the received second user information. For example, the wearable device 101 may identify the identity of the first user information and the second user information by decrypting the second user information. The external electronic device and the wearable device 101 may establish a communication link based on the identification of the identity of the first user information and the second user information. The external electronic device may send information associated with the multimedia content provided by the external electronic device sent from the wearable device 101 to the wearable device 101 based on the identification of the identity. The wearable device 101 may display the multimedia content through the display 230 based on the received information associated with the multimedia content. For example, the information associated with the multimedia content may include information associated with the provision of the multimedia content, such as the name of the multimedia content and / or the playback time of the multimedia content.

[0038] The camera 250 of the wearable device 101 according to an embodiment may include a lens assembly or an image sensor. The lens assembly may collect light emitted from an object that is an image capture target. The lens assembly may include one or more lenses. The camera 250 according to an embodiment may include a plurality of lens assemblies. For example, in the camera 350, a part of the plurality of lens assemblies may have the same lens properties (e.g., viewing angle, focal length, autofocus, f-number, or optical zoom), or at least one lens assembly may have one or more lens properties different from those of other lens assemblies. The lens assembly may include a wide-angle lens or a telephoto lens. The image sensor according to an embodiment may include, for example, one image sensor selected from image sensors having different properties (such as an RGB sensor, a black-and-white (BW) sensor, an IR sensor, or a UV sensor), a plurality of image sensors having the same properties, or a plurality of image sensors having different properties. Each image sensor included in the image sensor may be implemented using, for example, a charge-coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor. The wearable device 101 according to an embodiment may obtain an image through the camera 250. The wearable device 101 may perform an operation of displaying the image obtained through the camera 250. For example, the operation of the wearable device 101 of displaying the image obtained through the camera 250 within a VR environment may be referred to as a VST mode. The wearable device 101 may display a visual object on at least a part of the image when operating in the VST mode. For example, the visual object may be a virtual object generated by the processor 210 of the wearable device 101. For example, the wearable device 101 may display the visual object and / or the virtual object by superimposing the image. The wearable device 101 may identify a real object identified in the image. The wearable device 101 may display the visual object to notify that the real object is selectable by superimposing the real object. The wearable device 101 according to an embodiment may provide an actual reality through the display 230. For example, within an AR environment, the wearable device 101 may provide the actual reality seen through the display 230. The wearable device 101 may display a virtual object in the display 230 within the AR environment.

[0039] The wearable device 101 according to an embodiment may display a second object (e.g., Figure 1 second object 115) to be combined with a first object corresponding to an external electronic device (e.g., Figure 1It is optional to notify an external electronic device by the first object 110). The wearable device 101 may receive an input regarding the first object based on the display of the second object. For example, the wearable device 101 may use a controller that establishes a communication link with the wearable device 101 to receive an input regarding the first object. For example, the wearable device 101 may receive an input regarding the first object based on tracking the user's gaze. The wearable device 101 may, in response to receiving the input, display multimedia content provided by the external electronic device from the external electronic device through the display 230. The input regarding the first object is not limited to the above.

[0040] As described above, the wearable device 101 according to an embodiment may obtain an image through the camera 250. The wearable device 101 may identify an external electronic device corresponding to the first object based on the first object included in the image. Based on this identification, the wearable device 101 may request information from the external electronic device through the communication circuit 240 to display multimedia content provided by the external electronic device. The wearable device 101 may receive information sent from the external electronic device at least partially based on this request. In response to receiving this information, the wearable device 101 may display a second object in combination with the first object to notify the selectable external electronic device. The wearable device 101 may display multimedia content based on the information received in response to an input regarding the combination of the second object with the first object. For example, the wearable device 101 may display multimedia content provided by the external electronic device corresponding to the first object in association with the external electronic device. The wearable device 101 may provide multimedia content starting from the time when the multimedia content is reproduced in the external electronic device. The wearable device 101 may enhance the user experience of the wearable device 101 by continuously providing multimedia content provided by the external electronic device.

[0041] Figure 3a An example of a perspective view of a wearable device according to an embodiment is shown. Figure 3b An example of one or more hardware components provided in a wearable device according to an embodiment is shown. Figures 3a to 3b The wearable device 300 may include Figure 1 and / or Figure 2 The wearable device 101. As Figure 3a shown, the wearable device 300 according to an embodiment may include at least one display 350 and a frame that supports the at least one display 350.

[0042] According to an embodiment, the wearable device 300 may be worn on a part of the user's body. The wearable device 300 may provide augmented reality (AR), virtual reality (VR), or mixed reality (MR) that combines augmented reality and virtual reality to the user wearing the wearable device 300. For example, in response to passing through Figure 3bBased on the preset gestures of the user obtained by the motion recognition camera 340-2, the wearable device 300 can output virtual reality images through at least one display 350.

[0043] According to an embodiment, at least one display 350 in the wearable device 300 can provide visual information to the user. The at least one display 350 can include Figure 2 the display 230. For example, the at least one display 350 can include a transparent or translucent lens. The at least one display 350 can include a first display 350-1 and / or a second display 350-2 spaced apart from the first display 350-1. For example, the first display 350-1 and the second display 350-2 can be respectively disposed at positions corresponding to the left and right eyes of the user.

[0044] Referring to Figure 3b , the at least one display 350 can form a display area on the lens to provide visual information included in the ambient light passing through the lens and other visual information different from the visual information to the user wearing the wearable device 300. The lens can be formed based on at least one of a Fresnel lens, a pancake lens, or a multi-channel lens. The display area formed by the at least one display 350 can be formed on the second surface 332 of the first surface 331 and the second surface 332 of the lens. When the user wears the wearable device 300, the ambient light can be transmitted to the user by being incident on the first surface 331 and penetrating the second surface 332. Again, for example, the at least one display 350 can display a virtual reality image that is to be coupled with the real screen transmitted through the ambient light. The virtual reality image output from the at least one display 350 can be transmitted to the user's eyes through one or more hardware components (such as optical devices 382 and 384 and / or at least one waveguide 333 and 334) included in the wearable device 300.

[0045] According to an embodiment, the wearable device 300 may include waveguides 333 and 334 that transmit light transmitted from at least one display 350 and relayed by at least one optical device 382 and 384 to a user by diffraction. The waveguides 333 and 334 may be formed based on at least one of glass, plastic, or polymer. Nano-patterns may be formed on at least a part of the outside or inside of the waveguides 333 and 334. The nano-patterns may be formed based on a grating structure having a polygonal or curved shape. Light incident on one end of the waveguides 333 and 334 may propagate through the nano-patterns to the other end of the waveguides 333 and 334. The waveguides 333 and 334 may include at least one of at least one diffractive element (e.g., diffractive optical element (DOE), holographic optical element (HOE)) and a reflective element (e.g., a mirror). For example, the waveguides 333 and 334 may be disposed in the wearable device 300 to guide a screen displayed by at least one display 350 to the user's eyes. For example, the screen may be transmitted to the user's eyes by total internal reflection (TIR) generated in the waveguides 333 and 334.

[0046] According to an embodiment, the wearable device 300 may analyze an object included in a real image collected by the capture camera 340-1, combine the object with a virtual object corresponding to the object that becomes an object provided in augmented reality among the analyzed objects, and display the combined object on at least one display 350. The virtual object may include at least one of text and an image for various information associated with the object included in the real image. The wearable device 300 may analyze the object based on a multi-camera such as a stereo camera. For object analysis, the wearable device 300 may perform time-of-flight (ToF) and / or simultaneous localization and mapping (SLAM) supported by the multi-camera. A user wearing the wearable device 300 may view an image displayed on at least one display 350.

[0047] According to an embodiment, the frame may be configured with a physical structure on which the wearable device 300 may be worn on a user's body. According to an embodiment, the frame may be configured such that when the user wears the wearable device 300, the first display 350-1 and the second display 350-2 may be positioned corresponding to the user's left and right eyes. The frame may support at least one display 350. For example, the frame may support the first display 350-1 and the second display 350-2 being positioned at positions corresponding to the user's left and right eyes.

[0048] Refer to Figure 3a, according to an embodiment, when the user wears the wearable device 300, the frame may include an area 320 that at least partially contacts a part of the user's body. For example, the area 320 of the frame that contacts a part of the user's body may include areas that contact a part of the user's nose, a part of the user's ear, and a part of the side of the user's face that are in contact with the wearable device 300. According to an embodiment, the frame may include a nose pad 310 that contacts a part of the user's body. When the user wears the wearable device 300, the nose pad 310 may contact a part of the user's nose. The frame may include a first temple 304 and a second temple 305 that contact another part of the user's body that is different from this part of the user's body.

[0049] According to an embodiment, the frame may include a first border 301 surrounding at least a part of the first display 350-1, a second border 302 surrounding at least a part of the second display 350-2, a bridge 303 disposed between the first border 301 and the second border 302, a first gasket 311 disposed along a part of the edge of the first border 301 from one end of the bridge 303, a second gasket 312 disposed along a part of the edge of the second border 302 from the other end of the bridge 303, a first temple 304 extending from the first border 301 and fixed to a part of the wearer's ear, and a second temple 305 extending from the second border 302 and fixed to a part of the ear opposite to the ear. The first gasket 311 and the second gasket 312 may contact a part of the user's nose, and the first temple 304 and the second temple 305 may contact a part of the user's face and a part of the user's ear. The temples 304 and 305 may be rotatably connected to the border through Figure 3b hinge units 306 and 307. The first temple 304 may be rotatably connected to the first border 301 relative to the first border 301 through a first hinge unit 306 disposed between the first border 301 and the first temple 304. The second temple 305 may be rotatably connected to the second border 302 relative to the second border 302 through a second hinge unit 307 disposed between the second border 302 and the second temple 305. According to an embodiment, the wearable device 300 may use touch sensors, grip sensors, and / or proximity sensors formed on at least a part of the surface of the frame to identify an external object (e.g., the user's fingertip) that touches the frame and / or a gesture performed by the external object.

[0050] According to an embodiment, the wearable device 300 may include hardware that performs various functions (e.g., based on the above Figure 2(hardware described by the block diagram). For example, the hardware may include a battery module 370, an antenna module 375, optical devices 382 and 384, speakers 392-1 and 392-2, microphones 394-1, 394-2, and 394-3, a depth sensor module (not shown), and / or a printed circuit board 390. Various hardware may be disposed in the frame.

[0051] According to an embodiment, the microphones 394-1, 394-2, and 394-3 of the wearable device 300 may obtain sound signals by being disposed on at least a part of the frame. Figure 3b The first microphone 394-1 disposed on the nose pad 310, the second microphone 394-2 disposed on the second frame 302, and the third microphone 394-3 disposed on the first frame 301 are shown, but the number and arrangement of the microphones 394 are not limited to Figure 3b the embodiments shown. In the case where the number of microphones 394 included in the wearable device 300 is two or more, the wearable device 300 may use multiple microphones arranged on different parts of the frame to identify the direction of a sound signal.

[0052] According to an embodiment, the optical devices 382 and 384 may transmit a virtual object transmitted from at least one display 350 to the waveguides 333 and 334. For example, the optical devices 382 and 384 may be projectors. The optical devices 382 and 384 may be disposed adjacent to at least one display 350, or may be included as a part of at least one display 350 in at least one display 350. The first optical device 382 may correspond to the first display 350-1, and the second optical device 384 may correspond to the second display 350-2. The first optical device 382 may transmit the light output from the first display 350-1 to the first waveguide 333, and the second optical device 384 may transmit the light output from the second display 350-2 to the second waveguide 334.

[0053] In one embodiment, the camera 340 may include an eye tracking camera (ET CAM) 340-1, a motion recognition camera 340-2, and / or a shooting camera 340-3. The shooting camera 340-3, the eye tracking camera 340-1, and the motion recognition camera 340-2 may be disposed at different positions on the frame and may perform different functions. The shooting camera 340-3, the eye tracking camera 340-1, and the motion recognition camera 340-2 may be Figure 2 examples of the camera 225. The eye tracking camera 340-1 may output data indicating the gaze of a user wearing the wearable device 300. For example, the wearable device 300 may detect the gaze from an image including the user's pupil obtained through the eye tracking camera 340-1. Figure 3bAn example is shown in which the eye tracking camera 340-1 is set to face the user's right eye, but the embodiment is not limited thereto, and the eye tracking camera 360-1 can be individually set to face the user's left eye or can be set to face both eyes.

[0054] In one embodiment, the capture camera 340-3 can capture a real image or a background to be matched with a virtual image to implement augmented reality or mixed reality content. The capture camera can capture an image of a specific object existing at the position where the user is viewing, and can provide the image to at least one display 350. The at least one display 350 can display an image in which the virtual image provided by the optical devices 382 and 384 overlaps with information on the real image or background including the image of the specific object obtained using the capture camera. In an embodiment, the capture camera can be provided on the nose bridge 303, and the nose bridge 303 is provided between the first frame 301 and the second frame 302.

[0055] In one embodiment, the eye tracking camera 340-1 can achieve more realistic augmented reality by tracking the gaze of the user wearing the wearable device 300 and matching the user's gaze with the visual information provided on at least one display 350. For example, when the user looks forward, the wearable device 300 can naturally display environmental information associated with the front of the user at the position where the user is located on at least one display 350. The eye tracking camera 340-1 can be configured to capture an image of the user's pupil to determine the user's gaze. For example, the eye tracking camera 340-1 can receive the gaze detection light reflected from the user's pupil, and can track the user's gaze based on the position and movement of the received gaze detection light. In an embodiment, the eye tracking camera 340-1 can be provided at positions corresponding to the user's left and right eyes. For example, the eye tracking camera 340-1 can be provided in the first frame 301 and / or the second frame 302 to face the direction where the user wearing the wearable device 300 is located.

[0056] The motion recognition camera 340-2 can provide a specific event to the screen provided by at least one display 350 by recognizing the motion of the whole or part of the user's body, such as the user's torso, hand or face. The motion recognition camera 340-2 can obtain a signal corresponding to the motion by recognizing the user's gesture, and can provide a display corresponding to the signal to at least one display 350. The processor can recognize the signal corresponding to the operation, and can execute a preset function based on the recognition. In one embodiment, the motion recognition camera 340-2 can be provided on the first frame 301 and / or the second frame 302.

[0057] In an embodiment, the camera 340 included in the wearable device 300 is not limited to the above-described eye-tracking camera 340-1 and motion-recognition camera 340-2. For example, the wearable device 300 may use a shooting camera 340-3 set with a FoV facing the user to identify an external object included in the FoV. The wearable device 300 may identify the external object based on sensors (such as a depth sensor and / or a time-of-flight (ToF) sensor) for identifying the distance between the wearable device 300 and the external object. The camera 340 set with the FoV may support an autofocus function and / or an optical image stabilization (OIS) function. For example, the wearable device 300 may include a camera 340 (e.g., a face-tracking (FT) camera) set facing the face to obtain an image including the face of the user wearing the wearable device 300.

[0058] Although not shown, the wearable device 300 according to an embodiment may further include a light source (e.g., an LED) that emits light toward an object (e.g., the user's eyes, face, and / or an external object in the FoV) photographed by the camera 340. The light source may include an LED having an infrared wavelength. The light source may be provided on at least one of the frame and the hinge units 306 and 307.

[0059] According to an embodiment, the battery module 370 may supply power to the electronic components of the wearable device 300. In an embodiment, the battery module 370 may be provided in the first temple 304 and / or the second temple 305. For example, the battery module 370 may be a plurality of battery modules 370. The plurality of battery modules 370 may be respectively provided on each of the first temple 304 and the second temple 305. In an embodiment, the battery module 370 may be provided at the end of the first temple 304 and / or the second temple 305.

[0060] In an embodiment, the antenna module 375 may transmit a signal or power to the outside of the wearable device 300, or may receive a signal or power from the outside. The antenna module 375 may be electrically connected and / or operably connected to a communication circuit (e.g., Figure 2 the communication circuit 235) in the wearable device 300. In an embodiment, the antenna module 375 may be provided in the first temple 304 and / or the second temple 305. For example, the antenna module 375 may be provided close to one surface of the first temple 304 and / or the second temple 305.

[0061] In an embodiment, speakers 392-1 and 392-2 may output sound signals to the outside of the wearable device 300. The sound output module may be referred to as a speaker. In an embodiment, speakers 392-1 and 392-2 may be disposed in the first temple 304 and / or the second temple 305 so as to be adjacent to the ears of a user wearing the wearable device 300. For example, the wearable device 300 may include a second speaker 392-2 disposed in the first temple 304 and adjacent to the left ear of the user, and a first speaker 392-1 disposed in the second temple 305 and adjacent to the right ear of the user.

[0062] In an embodiment, a light-emitting module (not shown) may include at least one light-emitting element. The light-emitting module may emit light of a color corresponding to a specific state, or may emit light through an operation corresponding to a specific state, so as to visually provide information about a specific state of the wearable device 300 to the user. For example, when the wearable device 300 needs to be charged, it may emit red light at a constant period. In an embodiment, the light-emitting module may be disposed on the first frame 301 and / or the second frame 302.

[0063] Referring to Figure 3b , according to an embodiment, the wearable device 300 may include a printed circuit board (PCB) 390. The PCB 390 may be included in at least one of the first temple 304 or the second temple 305. The PCB 390 may include an interposer disposed between at least two sub-PCBs. On the PCB 390, one or more hardware components included in the wearable device 300 (e.g., the hardware shown by the blocks described above with reference to Figure 2 may be disposed. The wearable device 300 may include a flexible PCB (FPCB) for interconnecting the hardware.

[0064] According to an embodiment, the wearable device 300 may include at least one of a gyro sensor, a gravity sensor, and / or an acceleration sensor for detecting the posture of the wearable device 300 and / or the posture of a body part (e.g., the head) of a user wearing the wearable device 300. Each of the gravity sensor and the acceleration sensor may measure the gravitational acceleration and / or the acceleration based on preset three-dimensional axes (e.g., the x-axis, the y-axis, and the z-axis) perpendicular to each other. The gyro sensor may measure the angular velocity of each of the preset three-dimensional axes (e.g., the x-axis, the y-axis, and the z-axis). At least one of the gravity sensor, the acceleration sensor, and the gyro sensor may be referred to as an inertial measurement unit (IMU). According to an embodiment, the wearable device 300 may identify a user's movement and / or gesture performed to execute or stop a specific function of the wearable device 300 based on the IMU.

[0065] As described above, the wearable device 300 according to an embodiment may identify a first object (e.g., Figure 1 the first object 110) displayed through the display 350. The wearable device 300 may identify an external electronic device corresponding to the first object. The wearable device 300 may request information related to multimedia content provided by the external electronic device based on the identification of the external electronic device. In response to receiving the information, the wearable device 300 may display, in association with the first object, a second object for notifying that the external electronic device is selectable. The wearable device 300 may receive an input for the first object associated with the second object. For example, the wearable device 300 may use the camera 340 to identify the input. For example, the wearable device 300 may identify the input based on the user's gaze tracked by using the camera 340. For example, the wearable device 300 may identify the input based on the user's gesture identified by using the camera 340. For example, the user's gesture may include a gesture indicating the external electronic device or the first object corresponding to the external electronic device. For example, the user's gesture may include an air gesture for indicating the first object. The wearable device 300 may display multimedia content through the display 350 based on information related to the multimedia content transmitted from the external electronic device in response to the input for the first object. For example, the wearable device 300 may display the multimedia content provided when the input is recognized.

[0066] Figures 4a to 4b An example of the exterior of the wearable device 400 according to an embodiment is shown. Figures 4a to 4b The wearable device 400 may include Figure 1 and Figure 2 the wearable device 101. According to an embodiment, an example of the exterior of the first surface 410 of the housing of the wearable device 400 may be shown in Figure 4a and an example of the exterior of the second surface 420 opposite to the first surface 410 may be shown in Figure 4b .

[0067] Referring to Figure 4a , according to an embodiment, the first surface 410 of the wearable device 400 may have an attachable shape on a body part of the user (e.g., the user's face). Although not shown, the wearable device 400 may further include a strap and / or one or more temple pieces for fixing on the body part of the user (e.g., Figures 3a to 3bThe first temple 304 and / or the second temple 305). The first display 350-1 for outputting an image to the left eye of the user's two eyes and the second display 350-2 for outputting an image to the right eye of the user's two eyes may be provided on the first surface 410. The wearable device 400 may further include a rubber or silicon package formed on the first surface 410 to prevent interference from light different from the light emitted from the first display 350-1 and the second display 350-2 (e.g., ambient light).

[0068] According to an embodiment, the wearable device 400 may include cameras 440-1 and 440-2 for photographing and / or tracking the two eyes of the user adjacent to each of the first display 350-1 and the second display 350-2. The cameras 440-1 and 440-2 may be referred to as ET cameras. According to an embodiment, the wearable device 400 may include cameras 440-3 and 440-4 for photographing and / or identifying the face of the user. The cameras 440-3 and 440-4 may be referred to as FT cameras.

[0069] Reference Figure 4b , cameras (e.g., cameras 440-5, 440-6, 440-7, 440-8, 440-9, and 440-10) and / or sensors (e.g., depth sensor 430) for obtaining information associated with the external environment of the wearable device 400 may be provided on the second surface 420 opposite to Figure 4a the first surface 410. For example, the cameras 440-5, 440-6, 440-7, 440-8, 440-9, and 440-10 may be provided on the second surface 420 to identify external objects different from the wearable device 400. For example, using the cameras 440-9 and 440-10, the wearable device 400 may obtain images and / or videos to be sent to each of the two eyes of the user. The camera 440-9 may be provided on the second surface 420 of the wearable device 400 to obtain an image to be displayed through the second display 350-2 corresponding to the right eye of the two eyes. The camera 440-10 may be provided on the second surface 420 of the wearable device 400 to obtain an image to be displayed through the first display 350-1 corresponding to the left eye of the two eyes.

[0070] According to an embodiment, the wearable device 400 may include a depth sensor 430 provided on the second surface 420 to identify the distance between the wearable device 400 and an external object. Using the depth sensor 430, the wearable device 400 may obtain spatial information (e.g., a depth map) of at least a part of the FoV of the user wearing the wearable device 400.

[0071] Although not shown, a microphone for obtaining sound output from an external object may be provided on the second surface 420 of the wearable device 400. According to an embodiment, the number of microphones may be one or more.

[0072] As described above, according to an embodiment, the wearable device 400 may display, through the display 350, images obtained by the cameras 440-5, 440-6, 440-7, 440-8, 440-9, and 440-10. The wearable device 400 may display a first object (e.g., Figure 1 the first object 110) in the image. The wearable device 400 may identify an external electronic device corresponding to the first object. The wearable device 400 may, based on the identification of the external electronic device, request, through a communication circuit (e.g., Figure 2 the communication circuit 240), information for displaying multimedia content provided by the external electronic device. For example, the wearable device 400 may receive information sent from the external electronic device at least partially based on the request. In response to receiving the information, the wearable device 400 may display a second object (e.g., Figure 2 the second object 115) associated with the first object to notify that the external electronic device is selectable. The wearable device 400 may receive an input to the first object while displaying the first object and the second object. For example, an input to the first object may be identified based on the cameras 440-1 and 440-2. For example, the wearable device 400 may identify an input to the first object based on tracking the gaze of the user of the wearable device 400 using the cameras 440-1 and 440-2. For example, the wearable device 400 may identify gestures of the user of the wearable device 400 based on the cameras 440-5, 440-6, 440-7, 440-8, 440-9, and 440-10. The wearable device 400 may identify an input to the first object based on the user's gesture. Based on the input, the wearable device 400 may display multimedia content based on the information sent from the external electronic device. When displaying the multimedia content, the wearable device 400 may provide the multimedia content at a time corresponding to the input. The wearable device 400 may enhance the user experience of the wearable device 400 by providing multimedia content played at a time corresponding to the input.

[0073] Figure 5 An example of a screen displayed through the display of a wearable device according to an embodiment is shown. Figure 5 The wearable device 101 may include Figure 1 and / or Figure 2 the wearable device 101. Figure 5 The wearable device 101 may include Figures 3a to 3b the wearable device 300 and / or Figures 4a to 4bWearable device 400. Figure 5 The operation can be performed by Figure 2 processor 210.

[0074] Refer to Figure 5 , in the first example 500, the wearable device 101 according to the embodiment can display, through a display (e.g., Figure 2 display 230), an image obtained by a camera (e.g., Figure 2 camera 250). The wearable device 101 can identify a first object 110 within the image. For example, the wearable device 101 can identify an external electronic device corresponding to the first object 110 based on the identification of the first object 110. The wearable device 101 can display a second object (e.g., Figure 2 second object 115) in combination with the first object 110 based on the identification of the external electronic device. For example, the wearable device 101 can display the second object to notify that the first object 110 is selectable in combination with the first object 110. The wearable device 101 can identify an input regarding the first object 110 while displaying the first object 110 and / or the second object 115.

[0075] The wearable device 101 according to the embodiment can identify an input regarding the first object 110 and / or the second object 115. In response to the input regarding the first object 110 and / or the second object 115, the wearable device 101 can switch to a screen 520 for displaying multimedia content provided by the external electronic device corresponding to the first object 110. The screen 520 can represent substantially the same timing as the multimedia content provided by the external electronic device.

[0076] The wearable device 101 according to the embodiment can identify an input regarding the first object 110 and / or the second object 115. For example, the input can be identified based on a gesture of the user on the wearable device 101. For example, the input can be received based on a controller of the wearable device 101. For example, the wearable device 101 can identify an input of dragging the first object 110 and / or the second object 115. For example, the drag input can use the controller to maintain a pressed input on the first object 110 and / or the second object 115 and includes an input of moving the first object 110 and / or the second object 115. The input regarding the first object 110 and / or the second object 115 is not limited to the above examples. The wearable device 101 can display the screen 520 through the display in response to the input. The wearable device 101 can display the screen 520 associated with the multimedia content provided by the external electronic device corresponding to the first object 110.

[0077] The wearable device 101 according to an embodiment may display, on at least a portion of a display, a screen associated with multimedia content provided by an external electronic device corresponding to a first object 110, based on recognition of an input regarding the first object 110. For example, the wearable device 101 may display a third object 510 associated with the multimedia content on at least a portion of the display. For example, the third object 510 may be a visual object and / or a virtual object to display the multimedia content.

[0078] The wearable device 101 according to an embodiment may recognize an input regarding a third object 510 associated with the multimedia content. The wearable device 101 may recognize an input with respect to the third object 510 based on a signal received from a controller. For example, the controller may send a signal to indicate a virtual object and / or a visual object within the display, such as a pointer. The wearable device 101 according to an embodiment may recognize an input regarding the third object 510 based on tracking a user's gaze. The wearable device 101 may display the multimedia content based on the entire area of the display, based on the recognition of the input.

[0079] Referring to a second example 505, the wearable device 101 according to an embodiment may display the multimedia content through a screen 520 of the display. For example, the wearable device 101 may change to the second example 505 such that the multimedia content provided in the first example 500 may be continuously viewed. The wearable device 101 according to an embodiment may display a fourth object 530 within the screen 520 to switch to the first example 500. For example, the wearable device 101 may display the fourth object 530 by superimposing the screen 520 associated with the multimedia content. The wearable device 101 may stop displaying the fourth object 530 based on exceeding a specified duration while the screen 520 is being displayed. For example, the wearable device 101 may at least temporarily stop displaying the fourth object 530 to provide the multimedia content through the entire area of the display.

[0080] As described above, the wearable device 101 according to an embodiment may identify an external electronic device when operating in the VST mode. The wearable device 101 may display a second object to notify that the first object 110 regarding the external electronic device is selectable. The wearable device 101 may display multimedia content provided by the external electronic device corresponding to the first object 110 in at least a partial area of the display. For example, the wearable device 101 may display the multimedia content through a visual object such as a third object 510. The wearable device 101 may display a screen 520 associated with the multimedia content based on an input regarding the third object 510. For example, the screen 520 associated with the multimedia content may be the entire area of the display. For example, the wearable device 101 may display a fourth object 530 while displaying the screen 520 to reduce the size of the screen 520. The wearable device 101 may change the size of the screen 520 to the size of the third object 510 based on an input regarding the fourth object 530. The size of the screen 520, the size of the third object 510, and / or the position of the third object 510 are not limited. The wearable device 101 may perform switching between the third object 510 and the screen 520. The wearable device 101 may enhance the user experience of the wearable device 101 by performing switching based on a user input.

[0081] Figure 6 An example of a screen displayed through a display of a wearable device according to an embodiment is shown. Figure 6 The wearable device 101 may include Figure 1 , Figure 2 and / or Figure 5 the wearable device 101. Figure 6 The wearable device 101 may include Figures 3a to 3b the wearable device 300 and / or Figures 4a to 4b the wearable device 400. Figure 6 The operation may be performed by Figure 2 the processor 210.

[0082] Reference Figure 7, in the first example 600, the wearable device 101 according to the embodiment can obtain an image through a camera. The wearable device 101 can identify a first object 110 within the image. For example, the wearable device 101 can identify an external electronic device corresponding to the first object 110. The wearable device 101 can identify a second object 620 and / or a third object 630 that is different from the first object while identifying the first object 110. For example, the second object 620 and / or the third object 630 can be an object displayed based on the execution of a software application. For example, when the external electronic device corresponding to the first object 110 provides multimedia content, the wearable device 101 can identify the second object 620 and / or the third object 630. The wearable device 101 can move the superimposed object based on identifying the second object 620 and / or the third object 630 superimposed on the first object corresponding to the external electronic device that provides multimedia content to it. For example, in the first example 600, the wearable device 101 can move the third object 630 superimposed on the first object 110. For example, the wearable device 101 can move the third object 630 based on identifying the superimposed area 610 of the first object 110 and the third object 630. The second example 605 can be an example of moving the third object 630 superimposed on the first object 110. The wearable device 101 can move the third object 630 to an area 635 where the superimposed area 610 is not recognized.

[0083] The wearable device 101 according to the embodiment can identify multiple objects 620 and 630. For example, the wearable device 101 can highlight the third object 630 among the multiple objects 620 and 630 that includes the superimposed area 610 with the first object 110. For example, the highlighting operation can include an operation of making the third object 630 blink. For example, the highlighting operation can include an operation of displaying the third object 630 in a different color. However, it is not limited thereto. The wearable device 101 according to the embodiment can receive an input regarding the third object 630 while highlighting and displaying the third object 630. For example, the input can include an input of dragging the third object 630. The wearable device 101 can move the third object 630 based on the input.

[0084] As described above, the wearable device 101 according to an embodiment may identify a first object 110 corresponding to an external electronic device that provides multimedia content. The wearable device 101 may identify a third object 630 that at least partially overlaps the first object 110. The wearable device 101 may move the third object 630 to an area 635 that does not overlap the first object 110. The wearable device 101 may move the third object 630 based on an input regarding the third object 630. The wearable device 101 may provide multimedia content provided from the external electronic device corresponding to the first object 110 to a user by moving the third object 630 that overlaps the first object 110. The wearable device 101 may assist the user in viewing multimedia content provided through the external electronic device corresponding to the first object 110 by moving the third object 630 that overlaps the first object 110.

[0085] Figure 7 An example of a screen displayed through a display of a wearable device according to an embodiment is shown. Figure 7 The wearable device 101 may include Figure 1 , Figure 2 , Figure 5 and / or Figure 6 the wearable device 101. Figure 7 The wearable device 101 may include Figures 3a to 3b the wearable device 300 and / or Figures 4a to 4b the wearable device 400. Figure 7 The operation of may be performed by Figure 2 the processor 210.

[0086] Referring to Figure 7 , the wearable device 101 according to an embodiment may obtain an image through a camera (e.g., Figure 2 the camera 250). Referring to the first example 700, the wearable device 101 may display an object and an image generated by a processor (e.g., Figure 2 the processor 210).

[0087] The wearable device 101 can identify a first object 110 within an image. The wearable device 101 can identify an external electronic device corresponding to the first object 110 based on the first object 110. Based on this identification, the wearable device 101 can request information from the external electronic device to display multimedia content provided by the external electronic device. The wearable device 101 can receive the information sent from the external electronic device at least partially based on this request. In response to receiving the information, the wearable device 101 can display a second object 115 to notify that the external electronic device is selectable. For example, the wearable device 101 can display the second object 115 in combination with the first object 110. For example, the wearable device 101 can display the second object 115 along the edge of the first object 110.

[0088] The wearable device 101 according to an embodiment can identify an input regarding the first object 110 and / or the second object 115. The wearable device 101 can display a third object 710 and a fourth object 720 within at least a partial area 730 of the display based on the input regarding the first object 110 and / or the second object 115. For example, the third object 710 can be a button for at least temporarily stopping the multimedia content provided by the external electronic device corresponding to the first object 110 and initiating an execution operation to display the multimedia content through the display of the wearable device 101. For example, the third object 710 can include text such as "Continue watching on the App". For example, the fourth object 720 can be a button for simultaneously providing multimedia content through the external electronic device corresponding to the first object 110 and the display of the wearable device 101. For example, the fourth object 720 can include text such as "TV / App play simultaneously". In Figure 7 Example 700, the third object 710 and the fourth object 720 are shown, but the embodiment is not limited thereto. For example, the wearable device 101 can display an image including visual information within the third object 710 and / or the fourth object 720. For example, the wearable device 101 can execute the specified function of the object displayed on the screen.

[0089] As described above, the wearable device 101 according to an embodiment may display a first object 110 and / or a second object 115 corresponding to an external electronic device. The wearable device 101 may recognize an input regarding the first object 110 and / or the second object 115. The wearable device 101 may display objects (or objects 710 and 720) to perform a function (or operation) based on the input regarding the first object 110 and / or the second object 115. The wearable device 101 may perform an operation corresponding to the function represented by the object based on the input regarding the object. By performing the function (or operation) corresponding to the object, the wearable device 101 may provide multimedia content through the wearable device 101, or may provide multimedia content through the wearable device 101 and an external electronic device. The wearable device 101 may enhance the user experience of the wearable device 101 by providing multimedia content.

[0090] Figure 8 An example of a usage state of a wearable device according to an embodiment is shown. Figure 8 The wearable device 101 may include Figure 1 , Figure 2 , Figure 5 , Figure 6 and / or Figure 7 the wearable device 101. Figure 8 The wearable device 101 may include Figures 3a to 3b the wearable device 300 and / or Figures 4a to 4b the wearable device 400. Figure 8 The operation of Figure 2 may be executed by the processor 210 of

[0091] Referring to Figure 8 , the wearable device 101 according to an embodiment may recognize the position of the wearable device 101. For example, the wearable device 101 may recognize the position of the wearable device 101 based on a GPS sensor. For example, the wearable device 101 may recognize the position of the wearable device 101 based on scene recognition. For example, the wearable device 101 may perform scene recognition based on recognizing a specified event. For example, the specified event may include initiating an operation to provide multimedia content 820. For example, the wearable device 101 may store the scene 810 recognized when providing multimedia content 820 in a memory (e.g., Figure 2in the memory 220). For example, the wearable device 101 may provide the multimedia content 820 at the location of the recognition scenario 810 more than a specified number of times based on the recognition scenario 810 (recognized when providing the multimedia content 820). For example, the wearable device 101 may recognize whether the scenario 810 stored when providing the multimedia content 820 is the same as the image obtained by the camera. For example, the wearable device 101 may provide the multimedia content 820 based on the scenario 810 and the image being the same.

[0092] The wearable device 101 according to an embodiment may identify the position of the wearable device 101 based on Simultaneous Localization and Mapping (SLAM). For example, the wearable device 101 may identify the position of the wearable device 101 when providing the multimedia content 820 based on SLAM. The wearable device 101 may identify the position where the multimedia content 820 is repeatedly provided based on SLAM and / or scenario recognition. The wearable device 101 may store the position where the multimedia content 820 is repeatedly provided in the memory. Although not shown in Figure 8 the wearable device 101 may display an object to guide the provision of the multimedia content 820 based on identifying the position of the wearable device 101 corresponding to the position stored in the memory. For example, the wearable device 101 may provide the multimedia content 820 based on an input regarding the object for guiding the provision of the multimedia content 820.

[0093] The wearable device 101 according to an embodiment may identify a first position of the wearable device 101 based on an image obtained by the camera. The wearable device 101 may display the multimedia content based on identifying the first position corresponding to a second position stored in the memory. For example, the second position may be the position where the multimedia content is repeatedly provided.

[0094] As described above, the wearable device 101 according to an embodiment may identify the position of the wearable device 101. The wearable device 101 may identify the position of the wearable device 101 based on the repeatedly identified scenario 810 and / or SLAM. The wearable device 101 may identify the position of the wearable device 101 while providing the multimedia content 820. The wearable device 101 may store the position of the wearable device 101 while providing the multimedia content 820 in a memory. The wearable device 101 may provide the multimedia content 820 based on identifying the position of the wearable device 101 corresponding to the position stored in the memory. The wearable device 101 may display an object to guide the provision of the multimedia content 820 based on identifying the position of the wearable device 101 corresponding to the position stored in the memory. The wearable device 101 may help a user to easily receive the multimedia content 820 by providing the multimedia content 820 based on the position of the wearable device 101 corresponding to the position stored in the memory. The wearable device 101 may enhance the user experience of the wearable device 101 by providing the multimedia content 820 based on identifying the position of the wearable device 101 identified at a specified position.

[0095] Figure 9 An example of a screen displayed on a display of a wearable device according to an embodiment is shown. Figure 9 The wearable device 101 may include Figure 1 , Figure 2 , Figure 5 , Figure 6 , Figure 7 and / or Figure 8 the wearable device 101. Figure 9 The wearable device 101 may include Figures 3a to 3b the wearable device 300 and / or Figures 4a to 4b the wearable device 400. Figure 9 The operation of Figure 2 may be executed by the processor 210.

[0096] Referring to Figure 9 , in the first example 900, the wearable device 101 according to an embodiment may provide the multimedia content 910. For example, the first example 900 may be an example in which the user of the wearable device 101 is provided with the multimedia content 910 while wearing the wearable device 101 and not moving. The wearable device 101 may display the multimedia content 910 through a display (e.g., Figure 2 the display 230). The wearable device 101 according to an embodiment may identify that the position of the wearable device 101 has changed while providing the multimedia content 910. For example, the wearable device 101 may be based on a camera (e.g., Figure 2The movement of the wearable device 101 is recognized based on an image obtained by the camera 250). For example, the wearable device 101 can recognize the movement of the wearable device 101 based on the difference in the images obtained by the camera. For example, the wearable device 101 can recognize the movement of the wearable device 101 based on the GPS sensor.

[0097] According to an embodiment, the wearable device 101 can reduce the size of the multimedia content 910 based on the recognition of the movement of the wearable device 101. For example, the wearable device 101 can display a screen such as the second example 905. For example, the wearable device 101 can display an object 930 corresponding to the multimedia content 910 by reducing the size of the multimedia content 910 based on the movement of the wearable device 101. The wearable device 101 can display the image 920 obtained by the camera while displaying the object 930 reduced from the multimedia content 910. The wearable device 101 can display the object 930 superimposed on the image 920. For example, the wearable device 101 can provide the multimedia content 910 through the object 930.

[0098] According to an embodiment, the wearable device 101 can adjust the size of the object 930. For example, the wearable device 101 can adjust the size of the object 930 based on an input regarding the object 930. For example, the input regarding the object 930 can include an operation of dragging the object 930. For example, the input regarding the object 930 can include a pinching operation to scale the object 930. The input regarding the object 930 can be received by the controller. The input regarding the object 930 through the user's gesture can be received by the camera of the wearable device 101. The wearable device 101 can enlarge or reduce the size of the object 930 based on the input.

[0099] As described above, according to an embodiment, the wearable device 101 can display the multimedia content 910. The wearable device 101 can recognize the movement of the wearable device 101 while displaying the multimedia content 910. The wearable device 101 can display the image 920 obtained by the camera based on the recognition of the movement. While displaying the image 920, the wearable device 101 can superimpose and display an object 930 corresponding to the multimedia content 910 on the image 920. The wearable device 101 can provide the multimedia content 910 through the object 930. The wearable device 101 can help the user of the wearable device 101 receive the multimedia content 910 in a safe state by converting the multimedia content 910 into the object 930 based on the recognition of the user's movement and displaying the image 920 obtained by the camera.

[0100] Figure 10 An example of a screen displayed through the display of a wearable device according to an embodiment is shown. Figure 10 The wearable device 101 can includeFigure 1 , Figure 2 , Figure 5 , Figure 6 , Figure 7 , Figure 8 and / or Figure 9 the wearable device 101. Figure 10 The wearable device 101 may include Figures 3a to 3b the wearable device 300 and / or Figures 4a to 4b the wearable device 400. Figure 10 The operation of may be executed by Figure 2 the processor 210.

[0101] Refer to Figure 10 , the wearable device 101 according to an embodiment may provide a screen 1010 within a first location 1000 through a display (e.g., Figure 2 the display 230). For example, the screen 1010 may be provided based on an image obtained by a camera of the wearable device 101 in a VR state (e.g., Figure 2 the camera 220). For example, the screen 1010 may be a screen provided by penetrating the display within an AR state. The wearable device 101 may identify multimedia content 1020 provided by a first external electronic device while providing the screen 1010. The wearable device 101 may receive an input regarding an area including the multimedia content 1020 based on the identification of the multimedia content 1020. For example, the input may be identified based on a controller of the wearable device 101 and / or a gaze of a user of the wearable device 101. For example, the wearable device 101 may identify an input regarding an area including the multimedia content 1020 by tracking the gaze of the user using a gaze tracking camera. The wearable device 101 may search for the multimedia content 1020 using a second external electronic device (e.g., a server) based on the input. For example, the wearable device 101 may display the multimedia content 1020 in at least a partial area of the screen 1010 based on the search for the multimedia content 1020.

[0102] The wearable device 101 according to an embodiment may display an object 1030 to provide the multimedia content 1020 within the screen 1010 during a change in the position of the wearable device 101. For example, the wearable device 101 may use the object 1030 to display the multimedia content 1020 within a second location 1005 different from the first location 1000. The wearable device 101 may receive an input for adjusting the size of the object 1030 while displaying the object 1030. For example, the input for adjusting the size of the object 1030 may include an operation of dragging the object 1030. For example, the input for adjusting the size of the object 1030 may include an operation of pinching to scale the object 1030. The wearable device 101 may adjust the size of the object 1030 based on the input.

[0103] As described above, the wearable device 101 according to an embodiment may identify the multimedia content 1020 provided from a first external electronic device. The wearable device 101 may receive an input regarding an area including the multimedia content 1020 based on the identification of the multimedia content 1020. The wearable device 101 may search for the multimedia content 1020 using a second external electronic device different from the first external electronic device in response to the input. The wearable device 101 may display the multimedia content 1020 in at least a partial area of the screen 1010 based on the search for the multimedia content 1020. The wearable device 101 may enhance the user experience of the wearable device 101 by providing the multimedia content 1020 identified within the screen 1010 based on the user's input.

[0104] Figure 11 An example of a flowchart regarding the operation of a wearable device according to an embodiment is shown. Figure 11 The wearable device may include Figure 1 , Figure 2 , Figure 5 , Figure 6 , Figure 7 , Figure 8 , Figure 9 and / or Figure 10 the wearable device 101. Figure 11 The wearable device may include Figures 3a to 3b the wearable device 300 and / or Figures 4a to 4b the wearable device 400. Figure 11 The operation may be performed by Figure 2 the processor 210.

[0105] Referring to Figure 11 , in operation 1101, the wearable device according to an embodiment may identify an external electronic device based on a first object (e.g., Figure 2 the camera 250) within an image obtained using a camera (e.g., Figure 1 the first object 110). For example, the wearable device 101 may identify the external electronic device corresponding to the first object 110.

[0106] In operation 1103, the wearable device according to an embodiment may request information for displaying multimedia content provided by the external electronic device based on the identification of the external electronic device. For example, through a communication circuit (e.g., Figure 2 the communication circuit 240), the wearable device may request information from the external electronic device corresponding to the first object to display the multimedia content provided by the external electronic device.

[0107] In operation 1105, a wearable device according to an embodiment may receive information sent from an external electronic device based at least in part on a request for information for displaying multimedia content. For example, the wearable device may receive the information through a communication circuit. In response to receiving the information, the wearable device may display a second object to notify that the external electronic device can be selected in combination with the first object. For example, the wearable device may display the second object along the edge of the first object. For example, the wearable device may superimpose the second object on the first object and display it by flashing.

[0108] In operation 1107, a wearable device according to an embodiment may identify an input received regarding the first object associated with the second object. For example, the input received regarding the first object may be received based on a controller that has established a communication link with the wearable device. For example, the input received regarding the first object may be received based on the identification of the user's gaze on the wearable device. The wearable device may display multimedia content through a display (e.g., Figure 2 display 230) based on the information for displaying multimedia content sent from the external electronic device in response to the input.

[0109] As described above, a wearable device according to an embodiment may identify an external electronic device based on a first object in an image obtained using a camera. The wearable device may request information from the external electronic device through a communication circuit to display multimedia content provided by the external electronic device based on the identification of the external electronic device. In response to receiving, through the communication circuit, at least a part of the information sent from the external electronic device based on the request, the wearable device may display a second object to notify that the external electronic device can be selected in combination with the first object. The wearable device may display multimedia content through a display based on the information in response to an input received regarding the first object associated with the second object. The wearable device may provide multimedia content by receiving information associated with the multimedia content provided by the external electronic device, thereby enhancing the user experience of the wearable device.

[0110] Figure 12 An example of a signal flow diagram regarding the operation of a wearable device according to an embodiment is shown. Figure 12 The wearable device 101 may include Figure 1 , Figure 2 , Figure 5 , Figure 6 , Figure 7 , Figure 8 , Figure 9 and / or Figure 10 The wearable device 101 and / or Figure 11 The wearable device. Figure 12 The wearable device 101 may include Figures 3a to 3b The wearable device 300 and / orFigures 4a to 4b wearable device 400. Figure 12 The operation of can be performed by Figure 2 processor 210. Figure 12 The first external electronic device 1201 of can include means for providing multimedia content through a display included in the first external electronic device 1201. Figure 12 The second external electronic device 1203 of can be referred to as a server.

[0111] Referring to Figure 12 , in operation 1210, the wearable device 101 according to an embodiment can identify the shape of a first object (e.g., Figure 2 camera 250) within an image obtained by a camera (e.g., Figure 1 first object 110) and the multimedia content provided by the first object. For example, the first object can be referred to as the first external electronic device 1201. For example, the wearable device 101 can encrypt the shape of the first object based on the recognition of the shape of the first object. For example, the wearable device 101 can perform encryption on the shape of the first object to identify the consistency between the first user account information logged in to the first external electronic device and the second user account information logged in to the wearable device 101.

[0112] In operation 1220, the first external electronic device 1201 according to an embodiment can send the first user account information to the second external electronic device 1203. For example, the first external electronic device 1201 can encrypt the first user account information. The first external electronic device 1201 can send the encrypted first user account information to the second external electronic device 1203. For example, the first external electronic device 1201 can send information associated with the shape of the first external electronic device together with the first user account information to the second external electronic device 1203.

[0113] In operation 1230, the wearable device 101 according to an embodiment can send a signal for identifying the consistency between the first user account and the second user account to the second external electronic device 1203. For example, the signal can include information associated with the shape of the first object and user information logged in to the wearable device 101. For example, the signal can include a signal sent to the second external electronic device 1203 requesting the user account information of the first external electronic device 1201.

[0114] In operation 1240, the wearable device 101 according to an embodiment may receive a signal to identify the consistency of a user account. For example, the second external electronic device 1203 may send a signal for identifying the consistency of the account based on the consistency between the first user information logged in to the first external electronic device 1201 and the second user information logged in to the wearable device 101. For example, the second external electronic device 1203 may decrypt the information (or signal) sent from the wearable device 101 and the first external electronic device 1201. The second external electronic device 1203 may identify the consistency between the first user information and the second user information based on decrypting the information. For example, the second external electronic device 1203 may initiate an operation to identify the consistency of the user information based on the consistency between the information associated with the shape of the first object sent from the wearable device 101 and the information associated with the shape of the first external electronic device 1201 sent from the first external electronic device 1201. The second external electronic device 1203 may identify the consistency between the second user information of the wearable device 101 and the first user information of the first external electronic device based on this initiation. The second external electronic device 1203 may send a signal to the wearable device 101 based on the consistency to confirm the consistency of the user account.

[0115] In operation 1250, the wearable device 101 according to an embodiment may display a second object (e.g., Figure 1 the second object 115) based on the consistency between the second user information of the wearable device 101 and the first user information of the first external electronic device 1201 to notify that the first external electronic device is selectable in combination with the first object. The wearable device 101 may display the second object along the edge of the first object. The wearable device 101 may display the second object by superimposing it on the first object.

[0116] In operation 1260, the wearable device 101 according to an embodiment may receive an input regarding the first object. The wearable device 101 may display multimedia content provided by the first external electronic device 1201 in response to the received input regarding the first object.

[0117] As described above, the wearable device 101 according to an embodiment may perform an operation to identify the consistency between the first user information logged in to the first external electronic device 1201 and the second user information logged in to the wearable device 101. The wearable device 101 may execute a request to the second external electronic device 1203 to identify the consistency between the first user information and the second user information. The wearable device 101 may display multimedia content provided by the first external electronic device 1201 based on the consistency between the first user information and the second user information. The wearable device 101 may enhance the user experience of the wearable device 101 by displaying the multimedia content provided by the first external electronic device 1201.

[0118] The metaverse is a compound word of the English words "Meta" (which means "virtual" and "transcendence") and "Universe" (which means universe), and refers to a three-dimensional virtual world in which social, economic, and cultural activities similar to those in the real world occur. The metaverse is a concept that further develops from virtual reality (VR, a state-of-the-art technology that enables people to experience real-life experiences in a virtual world created by a computer), and is characterized by using avatars to not only enjoy games or virtual reality, but also participate in social and cultural activities as in the real world. Metaverse services can provide media content based on augmented reality (AR), virtual reality environments (VR), mixed environments (MR), and / or extended reality (XR) to enhance the immersion in the virtual world.

[0119] For example, the media content provided by metaverse services may include social interaction content, which includes avatar-based games, concerts, parties, and / or conferences. For example, the media content may include information for economic activities, such as advertisements, user-created content, and / or sales and / or purchases of products. The ownership of user-created content can be proven by blockchain-based non-fungible tokens (NFTs). Metaverse services can support economic activities based on real currency and / or cryptocurrency. Virtual content associated with the real world, such as digital twins or life logs, may be provided by metaverse services.

[0120] Figure 13 It is an example diagram of a network environment 1301 in which metaverse services are provided by a server 1310.

[0121] Reference Figure 13 , the network environment 1301 may include a server 1310, user terminals 1320 (e.g., a first terminal 1320-1 and a second terminal 1320-2), and a network connecting the server 1310 and the user terminals 1320. Within the network environment 1301, the server 1310 may provide metaverse services to the user terminals 1320. The network may be formed by at least one intermediate node 1330 including an access point (AP) and / or a base station. The user terminal 1320 may output a user interface (UI) associated with the metaverse service to a user of the user terminal 1320 by accessing the server 1320 via the network. Based on the UI, the user terminal 1320 may obtain information to be input as a metaverse service from the user, or output information (e.g., multimedia content) associated with the metaverse service to the user.

[0122] At this time, the server 1310 enables the user terminal 1320 to move in the virtual space by providing the virtual space. In addition, by installing a software (S / W) agent to access the virtual space provided by the server 1310, the user terminal 1320 expresses the information provided by the server 1310 to the user, or sends the information that the user wants to express in the virtual space to the server. The S / W agent can be directly provided by the server 1310, downloaded from a public server, or embedded when purchasing the terminal.

[0123] In an embodiment, the server 1310 can be used to provide a metaverse service to the user terminal 1320 and / or the user. The embodiment is not limited thereto, and the metaverse service can be provided through separate contact between users. For example, within the network environment 1301, the metaverse service can be provided independently of the server 1310 by a direct connection between the first terminal 1320-1 and the second terminal 1320-2. Refer to Figure 13 , within the network environment 1301, the first terminal 1320-1 and the second terminal 1320-2 can be connected to each other through a network formed by at least one intermediate node 1330. In an embodiment where the first terminal 1320-1 and the second terminal 1320-2 are directly connected, either the first terminal 1320-1 or the second terminal 1320-2 can perform the role of the server 1310. For example, the metaverse environment can be configured only by device-to-device connections (e.g., peer-to-peer (P2P) connections).

[0124] In an embodiment, the user terminal 1320 (or the user terminal 1320 including the first terminal 1320-1 and the second terminal 1320-2) can be made of various form factors, and is characterized by including an output device for providing images or / and sounds to the user and an input device for inputting information to the metaverse service. Examples of various form factors of the user terminal 1320 can include a smart phone (e.g., the second terminal 1320-2), an AR device (e.g., the first terminal 1320-1), a VR device, an MR device, a video see-through (VST) device, an optical see-through (OST) device, a smart lens, a smart mirror, a TV or a projector capable of input / output.

[0125] The network (e.g., the network formed by at least one intermediate node 1330) includes various broadband networks, including 3G, 4G, and 5G, and short-range networks including Wi-Fi and BT (e.g., a wired or wireless network directly connecting the first terminal 1320-1 and the second terminal 1320-2).

[0126] A method for displaying multimedia content provided by an external electronic device may be required. As described above, the wearable device 101 according to an embodiment may include a communication circuit 240, a display 230, a camera 250, a memory 220 storing instructions, and a processor 210. When executed by the processor, the instructions may cause the wearable device to identify an external electronic device based on a first object 110 within an image obtained using the camera 250. When executed by the processor, the instructions may cause the wearable device to request information from the external electronic device via the communication circuit 240 based on the identification to display multimedia content provided by the external electronic device. When executed by the processor, the instructions may cause the wearable device to display a second object 115 in combination with the first object 110 in response to receiving information sent from the external electronic device via the communication circuit 240 to notify that the external electronic device is selectable. When executed by the processor, the instructions may cause the wearable device to display multimedia content obtained from the external electronic device based on the information via the display 230 based on whether a user input regarding the first object 110 is detected.

[0127] According to an embodiment, the first object 110 in combination with the second object 115 may be visually highlighted relative to at least one third object 120 within the image, where the at least one third object 120 is displayed in a different region from the first object 110.

[0128] The second object 115 according to an embodiment may be displayed along the edge of the first object 110 or may be displayed flickeringly as superimposed on the first object 110.

[0129] According to an embodiment, the processor 210 may display a fourth object 720 that receives an input for providing multimedia content in combination with an external electronic device.

[0130] When executed by the processor, the instructions according to an embodiment may cause the wearable device to identify a first position of the wearable device 101 based on an image obtained using the camera 250. When executed by the processor, the instructions may cause the wearable device to display multimedia content via the display 230 based on the identification corresponding to a second position stored in the wearable device 101 with the first position.

[0131] According to an embodiment, the second position may be a position set to repeatedly provide multimedia content.

[0132] When executed by the processor, the instructions according to an embodiment may cause the wearable device to display the second object 115 in combination with the first object 110 based on the identification of the consistency between the first user account of the wearable device 101 and the second user account of the external electronic device.

[0133] Instructions according to an embodiment, when executed by a processor, may cause the wearable device to display multimedia content in a portion of the display 230 based on recognizing a user's movement while displaying the multimedia content.

[0134] As described above, according to an embodiment, a method of the wearable device 101 may include identifying an external electronic device based on a first object 110 within an image obtained using the camera 250. The method may include, based on the identification, requesting information for displaying multimedia content provided by the external electronic device via the communication circuit 240. The method may include, in response to receiving the information transmitted from the external electronic device via the communication circuit 240, displaying a second object 115 in combination with the first object 110 to notify that the external electronic device is selectable. The method may include displaying multimedia content obtained from the external electronic device based on the information via the display 230 based on whether a user input relative to the first object 110 is detected.

[0135] According to an embodiment, the first object 110 in combination with the second object 115 may be displayed in a region different from the first object 110 and visually highlighted relative to at least one third object 120 within the image.

[0136] According to an embodiment, the second object 115 may be displayed along the edge of the first object 110 or may be displayed blinking as superimposed on the first object 110.

[0137] The method according to an embodiment may include displaying a fourth object that receives an input to provide multimedia content in combination with the external electronic device.

[0138] The method according to an embodiment may include identifying a first position of the wearable device 101 based on an image obtained by the camera 250. The method may include: based on identifying the first position corresponding to a second position stored in the wearable device 101, displaying multimedia content via the display 230.

[0139] According to an embodiment, the second position may be a position set to repeatedly provide multimedia content.

[0140] The method according to an embodiment may include displaying the second object 115 in combination with the first object 110 based on recognizing the consistency of a first user account of the wearable device 101 and a second user account of the external electronic device.

[0141] The method according to an embodiment may include: based on recognizing a user's movement while displaying multimedia content, displaying multimedia content on a portion of the display 230 and displaying an image obtained by the camera 250.

[0142] As described above, a computer-readable storage medium storing one or more programs according to an embodiment, when the one or more programs are executed by a processor 210 of the wearable device 101, can cause the processor 210 of the wearable device 101 to identify an external electronic device based on a first object 110 within an image obtained using a camera 250. When the one or more programs are executed by the processor 210 of the wearable device 101, it can cause the processor 210 of the wearable device 101 to request information from the external electronic device through a communication circuit 240 based on the identification to display multimedia content provided by the external electronic device. When executed by the processor 210 of the wearable device 101, the one or more programs can cause the processor 210 of the wearable device 101 to display a second object 115 in combination with the first object 110 in response to receiving information transmitted from the external electronic device through the communication circuit 240 to notify that the external electronic device is selectable. When executed by the processor 210 of the wearable device 101, the one or more programs can cause the processor 210 of the wearable device 101 to display multimedia content obtained from the external electronic device based on the information through a display 230 based on whether a user input regarding the first object 110 is detected.

[0143] According to an embodiment, the first object 110 in combination with the second object 115 can be displayed in an area different from the first object 110 and visually highlighted relative to at least one third object 120 within the image.

[0144] The second object 115 according to an embodiment can be displayed along the edge of the first object 110 or can be displayed blinking as superimposed on the first object 110.

[0145] One or more programs according to an embodiment, when executed by the processor 210 of the wearable device 101, can cause the processor 210 of the wearable device 101 to display a fourth object for receiving an input for combining multimedia content provided by an external electronic device.

[0146] An electronic device according to various embodiments can be one of various types of electronic devices. The electronic device can include, for example, a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a household appliance. According to an embodiment of the present disclosure, the electronic device is not limited to the above devices.

[0147] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to a particular embodiment, and include various changes, equivalents or substitutions of the corresponding embodiments. Regarding the description of the drawings, like reference numerals may be used to refer to like or related elements. It should be understood that unless the relevant context clearly indicates otherwise, the singular form of a noun corresponding to an item may include one or more things. As used herein, each of the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "at least one of A, B or C" may include any one or all possible combinations of the items listed together in the corresponding phrase. As used herein, terms such as "first" and "second" or "primary" and "secondary" may be used simply to distinguish the corresponding components from another component, and do not limit the components in other respects (e.g., importance or order). It should be understood that if an element (e.g., a first element) is referred to as being "coupled" or "connected" to another element (e.g., a second element), with or without the terms "operatively" or "communicatively", it means that the element can be coupled to the other element directly (e.g., wired), wirelessly, or via a third element.

[0148] As used in connection with the various embodiments of the present disclosure, the term "module" may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with other terms such as "logic", "logic block", "part", or "circuit". A module may be a single integrated component or its smallest unit or part suitable for performing one or more functions. For example, according to an embodiment, a module may be implemented in the form of an application specific integrated circuit (ASIC).

[0149] The various embodiments described herein may be implemented as software including one or more instructions stored in a machine-readable storage medium (e.g., memory 220) of a machine (e.g., wearable device 101). For example, a processor (e.g., processor 210) of a machine (e.g., wearable device 101) may invoke at least one of the one or more instructions stored in the storage medium and execute the instruction with or without using one or more other components under the control of the processor. This allows the machine to be operated to perform at least one function in accordance with the at least one instruction invoked. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Herein, the term "non-transitory" simply means that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but the term does not distinguish between the case where data is stored semi-permanently in the storage medium and the case where data is stored temporarily in the storage medium.

[0150] According to an embodiment, a method according to various embodiments of the present disclosure may be included and provided in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)), or distributed online (e.g., downloaded or uploaded) via an application store (e.g., PlayStore™), or directly distributed between two user devices (e.g., a smart phone). If distributed online, at least a part of the computer program product may be temporarily generated or at least temporarily stored in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0151] According to various embodiments, each of the above components (e.g., a module or a program) may include a single entity or multiple entities, and some of the multiple entities may be separately provided in different components. According to various embodiments, one or more of the above components may be omitted, or one or more other components may be added. Alternatively or additionally, multiple components (e.g., modules or programs) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform one or more functions of each of the multiple components in the same or similar manner as performed by the corresponding one of the multiple components before integration. According to various embodiments, operations performed by a module, a program, or another component may be performed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations may be performed in a different order or omitted, or one or more other operations may be added.

Claims

1. A wearable device, comprising: A communication circuit; A display; A camera; A memory storing instructions; And A processor, Wherein, when the instructions are executed by the processor, the wearable device can: Identify an external electronic device based on a first object within an image obtained using the camera; Based on the identification, request, via the communication circuit, information for displaying multimedia content provided by the external electronic device from the external electronic device; In response to receiving, via the communication circuit, the information transmitted from the external electronic device, display a second object in combination with the first object to notify that the external electronic device is selectable; and Based on whether a user input for the first object is detected, display, via the display, the multimedia content obtained from the external electronic device based on the information.

2. The wearable device according to claim 1, wherein, The first object in combination with the second object is visually highlighted relative to at least one third object displayed in a region different from the first object within the image.

3. The wearable device according to claim 2, wherein, The second object is displayed along the edge of the first object or is displayed as flickering and superimposed on the first object.

4. The wearable device according to claim 1, wherein, When the instructions are executed by the processor, the wearable device is caused to: Display a fourth object for receiving an input for combining the external electronic device to provide the multimedia content.

5. The wearable device according to claim 1, wherein When the instructions are executed by the processor, the wearable device is caused to: Identify a first position of the wearable device based on an image obtained using the camera; Based on identifying the first position corresponding to a second position stored in the wearable device, display the multimedia content via the display.

6. The wearable device according to claim 5, wherein, The second position is a position set to repeatedly provide the multimedia content.

7. The wearable device according to claim 1, wherein, When the instructions are executed by the processor, the wearable device is caused to: Display the second object in combination with the first object based on identifying the consistency between a first user account of the wearable device and a second user account of the external electronic device.

8. The wearable device according to claim 1, wherein, When the instructions are executed by the processor, the wearable device is caused to: Based on identifying the movement of the user when the multimedia content is displayed, display the multimedia content in a part of the display.

9. A method for a wearable device, comprising: Identifying an external electronic device based on a first object within an image obtained using a camera; Based on the identification, requesting, via a communication circuit, information for displaying multimedia content provided by the external electronic device from the external electronic device; In response to receiving, via the communication circuit, the information transmitted from the external electronic device, displaying a second object in combination with the first object to notify that the external electronic device is selectable; And Based on whether a user input for the first object is detected, displaying, via the display, the multimedia content obtained from the external electronic device based on the information.

10. The method according to claim 9, wherein, The first object in combination with the second object may be displayed in a region different from the first object and is visually highlighted relative to at least one third object within the image.

11. The method according to claim 10, wherein The second object is displayed along an edge of the first object or is displayed as flickeringly superimposed on the first object.

12. The method according to claim 9, further comprising: displaying a fourth object that receives an input for providing the multimedia content in combination with the external electronic device.

13. The method according to claim 9, further comprising: identifying a first position of the wearable device based on an image obtained by the camera; and displaying the multimedia content through the display based on identifying the first position corresponding to a second position stored in the wearable device.

14. The method according to claim 13, wherein, The second position is a position set to repeatedly provide the multimedia content.

15. The method according to claim 9, further comprising: displaying the second object in combination with the first object based on identifying a consistency between a first user account of the wearable device and a second user account of the external electronic device.

Images