Wearable device for communicating with external electronic device on basis of positional relationship with respect to external electronic device, and method for same

Abstract

A wearable device is provided. The at least one processor of the wearable device receives advertisement packets through a first communication circuit. In response to receiving the advertisement packets, the at least one processor uses at least one camera to identify vehicles corresponding to each of the advertisement packets. In response to identifying, using the at least one camera, at least one vehicle among the vehicles, the at least one processor executes a function that identifies at least one of the distance or location of the at least one vehicle relative to the wearable device on the basis of a second communication circuit.

Description

Wearable device and method for communicating with an external electronic device based on a positional relationship with respect to the external electronic device

[0001] The present disclosure relates to a wearable device and method for communicating with an external electronic device based on a positional relationship with respect to the external electronic device.

[0002] To provide an enhanced user experience, electronic devices are being developed that provide augmented reality (AR) services, which display computer-generated information in conjunction with external objects in the real world. These electronic devices may be wearable devices worn by the user. For example, these electronic devices may be AR glasses and / or head-mounted devices (HMDs).

[0003] Meanwhile, BLE (Bluetooth® low energy) can support reduced power consumption compared to legacy Bluetooth (or classic Bluetooth) and at least one similar, and often greater, communication range (i.e., the distance between interconnectable electronic devices). BLE can be provided on the ISM (industrial, scientific, and medical) radio band.

[0004] According to an embodiment, a wearable device may include at least one camera, a first communication circuit for Bluetooth low energy (BLE), a second communication circuit for ultra-wideband (UWB), and at least one processor. The at least one processor may be configured to receive advertisement packets via the first communication circuit. The at least one processor may be configured to, in response to receiving the advertisement packets, identify vehicles corresponding to each of the advertisement packets using the at least one camera. The at least one processor may be configured to, in response to identifying at least one of the vehicles using the at least one camera, execute a function of identifying at least one of a location or a distance of the at least one vehicle relative to the wearable device based on the second communication circuit.

[0005] In one embodiment, a method of a wearable device may include receiving advertisement packets using a first communication circuit for BLE. The method may include, in response to receiving the advertisement packets, identifying vehicles corresponding to each of the advertisement packets using at least one camera of the wearable device. The method may include, in response to identifying at least one of the vehicles using the at least one camera, executing a function of identifying at least one of a location or a distance of the at least one vehicle relative to the wearable device based on a second communication circuit for UWB.

[0006] According to one embodiment, a wearable device may include at least one camera, a first communication circuit for BLE, a second communication circuit for UWB, and at least one processor. The at least one processor may be configured to receive an advertisement packet through the first communication circuit. The at least one processor may be configured to obtain information related to an external electronic device that transmitted the advertisement packet based on authentication of the advertisement packet. The at least one processor may be configured to switch a state of the second communication circuit from an inactive state to an active state in response to a visual object included in an image output from the at least one camera and corresponding to the external electronic device. The visual object may be identified based on the information. The at least one processor may be configured to identify a positional relationship between the external electronic device and the wearable device using the second communication circuit in the active state.

[0007] In one embodiment, a method of a wearable device may include receiving an advertisement packet via a first communication circuit for Bluetooth low energy (BLE). The method may include obtaining information related to an external electronic device that transmitted the advertisement packet based on authentication of the advertisement packet. The method may include switching a state of a second communication circuit for ultra-wideband (UWB) from an inactive state to an active state in response to a visual object included in an image output from at least one camera of the wearable device and corresponding to the external electronic device. The visual object may be identified based on the information. The method may include identifying a positional relationship between the external electronic device and the wearable device using the second communication circuit in the active state.

[0008] FIG. 1 is a drawing illustrating one embodiment of a wearable device for communicating with an external electronic device including a vehicle.

[0009] FIG. 2 illustrates an example block diagram of a wearable device according to one embodiment.

[0010] FIGS. 3A and 3B illustrate an example of a flowchart of a wearable device according to one embodiment.

[0011] FIG. 4 illustrates an example of a flowchart of a wearable device that identifies an external electronic device based on BLE.

[0012] FIG. 5 illustrates an example of a flowchart of a wearable device performing secure ranging based on UWB.

[0013] Figures 6a and 6b illustrate an example of the operation of a wearable device based on a positional relationship with respect to an external electronic device.

[0014] Figures 7a and 7b illustrate an example of the operation of a wearable device based on a positional relationship with respect to an external electronic device.

[0015] Figure 8 illustrates an example of the operation of a wearable device based on a positional relationship with respect to an external electronic device.

[0016] FIG. 9 illustrates an example of a user interface (UI) provided by a wearable device that communicates with an external electronic device.

[0017] FIG. 10 illustrates an example of a flowchart of a wearable device according to one embodiment.

[0018] FIG. 11A illustrates an example of a perspective view of a wearable device, according to one embodiment.

[0019] FIG. 11B illustrates an example of one or more hardware elements disposed within a wearable device, according to one embodiment.

[0020] FIGS. 12A and 12B illustrate an example of an appearance of a wearable device according to one embodiment.

[0021] FIG. 13 is a block diagram of an electronic device within a network environment according to various embodiments.

[0022] Hereinafter, various embodiments of this document are described with reference to the attached drawings.

[0023] The various embodiments of this document and the terminology used therein are not intended to limit the technology described in this document to a specific embodiment, but should be understood to include various modifications, equivalents, and / or substitutes of the embodiment. In connection with the description of the drawings, similar reference numerals may be used for similar components. The singular expression may include plural expressions unless the context clearly indicates otherwise. In this document, expressions such as "A or B", "at least one of A and / or B", "A, B, or C", or "at least one of A, B, and / or C" may include all possible combinations of the items listed together. Expressions such as "first", "second", "first", or "second" may modify the corresponding components regardless of order or importance, and are only used to distinguish one component from another, but do not limit the corresponding components. When it is said that a component (e.g., a first component) is “(functionally or communicatively) connected” or “connected” to another component (e.g., a second component), said component may be directly connected to said other component, or may be connected via another component (e.g., a third component).

[0024] The term "module" as used in this document includes a unit composed of hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimal unit or portion thereof that performs one or more functions. For example, a module may be composed of an application-specific integrated circuit (ASIC).

[0025] FIG. 1 is a diagram illustrating an embodiment of a wearable device (101) for communicating with an external electronic device (140) including a vehicle. The wearable device (101) may include a head-mounted display (HMD) that is wearable on the head of a user (110). The wearable device (101) may be referred to as a head-mounted device (HMD), a headgear electronic device, a glasses-type electronic device, a video see-through (VST) device, an extended reality (XR) device, a virtual reality (VR) device, and / or an augmented reality (AR) device. Although the external appearance of the wearable device (101) in the form of glasses is illustrated, the embodiment is not limited thereto. An example of a hardware configuration included in the wearable device (101) is exemplarily described with reference to FIG. 2. An example of the structure of a wearable device (101) that can be worn on the head of a user (110) is described with reference to FIGS. 11A, 11B, 12A, and / or 12B. The wearable device (101) may be referred to as an electronic device. For example, the electronic device may be combined with an accessory to be attached to the head of a user to form an HMD.

[0026] According to one embodiment, the wearable device (101) can perform functions related to augmented reality (AR) and / or mixed reality (MR). For example, when a user (110) wears the wearable device (101), the wearable device (101) can include at least one lens positioned adjacent to the eyes of the user (110). The wearable device (101) can combine light emitted from a display of the wearable device (101) with ambient light passing through the lens. The display area of ​​the display can be formed within the lens through which the ambient light passes. Since the wearable device (101) combines the ambient light and the light emitted from the display, the user (110) can see an image that is a mixture of a real object recognized by the ambient light and a virtual object or imaginary object formed by the light emitted from the display. The augmented reality, mixed reality, and / or virtual reality described above may be referred to as extended reality (XR).

[0027] In one embodiment, a wearable device (101) may perform functions related to video see-through (VST) and / or virtual reality (VR). For example, when a user (110) wears the wearable device (101), the wearable device (101) may include a housing that covers the eyes of the user (110). The wearable device (101), in this state, may include a display disposed on a first side of the housing facing the eyes. The wearable device (101) may include a camera disposed on a second side opposite the first side. Using the camera, the wearable device (101) may acquire images and / or videos representing ambient light. The wearable device (101) can output the image and / or video within the display disposed on the first surface, thereby allowing the user (110) to recognize the ambient light through the display. The displaying area (or active area) of the display disposed on the first surface can be formed by one or more pixels included in the display. The wearable device (101) can synthesize a virtual object into the image and / or video output through the display, thereby allowing the user (110) to recognize the virtual object together with a real object recognized by the ambient light.

[0028] According to one embodiment, a wearable device (101) can wirelessly communicate with an external electronic device (140). Referring to FIG. 1, as an example of the external electronic device (140), a plurality of vehicles (e.g., a first vehicle (141), a second vehicle (142), and / or a third vehicle (143)) are illustrated. The operation of the wearable device (101) communicating with at least one of the first vehicle (141), the second vehicle (142), or the third vehicle (143) is described, but the embodiment is not limited thereto. For example, the external electronic device (140) capable of communicating with the wearable device (101) can include a gate (e.g., a gate of a public transportation means such as a subway), a point of sale (POS) device, or a door lock (or door handle). The operation of a wearable device (101) communicating with an external electronic device (140) including a first vehicle (141) to a third vehicle (143) is described with reference to FIG. 3a and / or FIG. 3b.

[0029] In one embodiment, the wearable device (101) may perform authorization for an external electronic device (140) that transmits a wireless signal based on authentication information. The authentication information (or key information) may include information for identifying or authenticating a vehicle, such as a digital car key. The wearable device (101) may communicate with the external electronic device (140) based on a wireless communication protocol, such as BLE (Bluetooth Low Energy), to authenticate the external electronic device (140) including the vehicle. The wearable device (101) may determine whether to perform authentication for the external electronic device (140) identified by the wireless communication protocol based on a positional relationship of the external electronic device (140) with respect to the wearable device (101) (e.g., a direction of the external electronic device (140) with respect to the wearable device (101).

[0030] Referring to FIG. 1, a wearable device (101) can communicate with a user terminal (160), such as a smartphone (or tablet PC), to perform authentication on an external electronic device (140). For example, the wearable device (101) can communicate with the user terminal (160) and confirm the result of authenticating the external electronic device (140). The user terminal (160) can store key information related to the external electronic device (140). Based on the key information, the user terminal (160) can authenticate the external electronic device (140) and transmit the result of the authentication to the wearable device (101).

[0031] Referring to FIG. 1, an example of a wearable device (101) and a plurality of vehicles (e.g., a first vehicle (141), a second vehicle (142), and / or a third vehicle (143)) adjacent to the wearable device (101) according to one embodiment is illustrated. Each of the plurality of vehicles may transmit a wireless signal to notify the existence of the vehicle. The wireless signal may include an advertisement packet based on BLE. The wireless signal may include a wake-up packet based on BLE. The wireless signal may include a beacon signal to notify an external electronic device (140) including the vehicle. The wearable device (101) can identify an external electronic device (e.g., the first vehicle (141), the second vehicle (142), and the third vehicle (143) of FIG. 1) that has transmitted the advertisement packet using an advertisement packet based on BLE. The wearable device (101) can exchange information with the identified external electronic device for control and / or authentication of the external electronic device. The exchange of information can be performed based on BLE. An exemplary operation of the wearable device (101) communicating with the external electronic device (140) based on BLE is described with reference to FIG. 4.

[0032] In one embodiment, a wearable device (101) that identifies an external electronic device (140) using BLE can identify a location relationship between the external electronic device (140) and the wearable device (101) using UWB. The wearable device (101) can determine whether to measure a location relationship based on UWB by using the strength (e.g., reception sensitivity) of a wireless signal based on BLE. Based on BLE, the wearable device (101) can communicate with the external electronic device (140) and set up measuring a location relationship based on UWB. For example, the wearable device (101) can stop measuring a location relationship based on UWB when the strength of a wireless signal based on BLE is below a threshold strength. When the strength of the above wireless signal exceeds a threshold strength, the wearable device (101) can initiate measurement of a positional relationship based on UWB.

[0033] The wearable device (101) identifying the positional relationship may include an operation of acquiring information representing at least one of a distance between the wearable device (101) and the external electronic device (140), a relative position of the external electronic device (140) with respect to the wearable device (101), a direction of the external electronic device (140) with respect to the wearable device (101), a moving speed (or velocity) of the external electronic device (140), and / or an azimuth angle of the external electronic device (140) with respect to the wearable device (101). The relative position between the external electronic device (140) and the wearable device (101) may include an operation of acquiring and / or calculating coordinate values ​​of the external electronic device (140) within a coordinate space formed based on the wearable device (101). An exemplary operation of a wearable device (101) that obtains the above location relationship based on UWB is described with reference to FIG. 5.

[0034] An embodiment of a wearable device (101) identifying a location relationship between an external electronic device (140) and the wearable device (101) using UWB is described, but the embodiment is not limited thereto. For example, the wearable device (101) may identify the location relationship based on BLE and / or Wi-Fi.

[0035] Within the exemplary state of FIG. 1, the wearable device (101) may receive advertisement packets from each of a first vehicle (141), a second vehicle (142), and a third vehicle (143) adjacent to the wearable device (101). Based on the authentication of the advertisement packets, the wearable device (101) may identify a vehicle among the first vehicle (141) to the third vehicle (143) that corresponds to authentication information (e.g., a digital car key) stored in the wearable device (101). In one embodiment, based on the authentication of the advertisement packet, the wearable device (101) may determine whether to use UWB to identify the location relationship of the external electronic device (140) that transmitted the advertisement packet. For example, if all of the first vehicle (141) to the third vehicle (143) correspond to the authentication information stored in the wearable device (101), the wearable device (101) may, instead of activating UWB for each of the first vehicle (141) to the third vehicle (143), selectively (or conditionally) activate UWB based on whether each of the first vehicle (141) to the third vehicle (143) is identified via a sensor of the wearable device (101). The sensor may include a camera (or image sensor) positioned toward the front direction of the wearable device (101). The embodiment is not limited thereto, and the sensor may be positioned on the front, side, top, and / or bottom of the wearable device (101). The sensor may be positioned toward the front and / or side of the wearable device.

[0036] Referring to FIG. 1, an exemplary case is illustrated in which a user (110) wearing a wearable device (101) faces a second vehicle (142). A wearable device (101) providing a user experience based on VST can display a screen (130) including an image or video acquired from a camera (or image sensor) positioned toward the front of the wearable device (101) on a display. A wearable device (101) providing a user experience based on AR and / or MR can provide a screen (130) including external light (e.g., external light reflected from a vehicle (142)) on a lens to a user (110) wearing the wearable device (101). A user (110) wearing the wearable device (101) on the head can recognize the environment in front of the wearable device (101) through the screen (130). In the exemplary case of FIG. 1 where the user (110) is facing the second vehicle (142), a visual object (152) representing the second vehicle (142) may be displayed at the center of a screen (130) displayed by the wearable device (101). The visual object (152) may be a portion corresponding to the second vehicle (142) within an image and / or video included in the screen (130). The visual object (153) may be a portion corresponding to the third vehicle (143) within an image and / or video included in the screen (130).

[0037] Within a screen (130) including images and / or videos acquired from a camera positioned toward the front of a wearable device (101), images and / or videos of an external space included in a field-of-view (FoV) (120) of the camera may be displayed. The FoV (120) may be formed based on the front of the wearable device (101). While displaying the screen (130) of FIG. 1, the wearable device (101) may identify a second vehicle (142) and a third vehicle (143) included in the FoV (120). According to one embodiment, the wearable device (101) may perform an operation to identify a positional relationship based on UWB for an external electronic device positioned in a reference direction (e.g., forward) of the wearable device (101) among a plurality of external electronic devices (e.g., a first vehicle (141), a second vehicle (142), and a third vehicle (143)) authenticated based on advertisement packets. The embodiment is not limited thereto, and the wearable device (101) may perform an operation to identify a positional relationship between a specific external electronic device (e.g., an external electronic device toward which the gaze is directed) among the plurality of external electronic devices and the wearable device (101) based on a direction of a gaze of a user (110) wearing the wearable device (101).

[0038] In the exemplary case of FIG. 1, the wearable device (101) may activate the communication circuit for UWB to identify a positional relationship with respect to a second vehicle (142) and / or a third vehicle (143), and may not identify a positional relationship with respect to a first vehicle (141) located away from the FoV (120). For example, the communication circuit for UWB may be selectively activated to identify a positional relationship with respect to the second vehicle (142) and the third vehicle (143) included in the FoV (120). In the case, since the communication circuit for UWB of the wearable device (101) is not activated for all of the first vehicle (141) to the third vehicle (143) that transmitted the advertisement packets, the power consumption of the wearable device (101) may be reduced. The embodiment is not limited thereto, and the operation and / or criteria for determining an external electronic device to measure a positional relationship using a camera by a wearable device (101) are described with reference to FIGS. 6a, 6b, 7a, 7b, and 8.

[0039] As described above, according to one embodiment, the wearable device (101) can receive a wireless signal (e.g., an advertisement packet) based on BLE from an external electronic device (140), such as a first vehicle (141) to a third vehicle (143). Based on the authentication of the advertisement packet, the wearable device (101) can identify the external electronic device (140) corresponding to the advertisement packet using a sensor, such as a camera. In the exemplary case of FIG. 1, among the first vehicle (141) to the third vehicle (143) that transmitted the advertisement packets, the second vehicle (142) and the third vehicle (143) can be identified by the sensor (e.g., a camera) of the wearable device (101). The wearable device (101) can identify the location and / or distance of the identified second vehicle (142) and third vehicle (143) using UWB.

[0040] For example, a communication circuit for UWB may not be activated to identify the location and / or distance of all of the first vehicle (141) to the third vehicle (143) that transmitted the advertisement packets, but may be activated to identify the location and / or distance of a specific vehicle (e.g., the second vehicle (142) and / or the third vehicle (143)) identified by a sensor (e.g., a camera). A user interface (UI) of a wearable device (101) provided based on the location and / or distance identified using the communication circuit for UWB is described with reference to FIG. 9. By selectively activating the communication circuit for UWB, the wearable device (101) can reduce the power consumption of the communication circuit for UWB.

[0041] Hereinafter, with reference to FIG. 2, an exemplary hardware configuration of a wearable device (101) performing the operation described with reference to FIG. 1 is described.

[0042] FIG. 2 illustrates an example block diagram of a wearable device (101) according to one embodiment. The wearable device (101) described with reference to FIG. 1 may include at least one of the hardware components of the wearable device (101) distinguished by different blocks in FIG. 2.

[0043] Referring to FIG. 2, a wearable device (101) according to one embodiment may include at least one of a processor (210), a memory (215), a display (220), a camera (225), a sensor (230), and a communication circuit (235). The processor (210), the memory (215), the display (220), the camera (225), the sensor (230), and / or the communication circuit (235) may be electrically and / or operably coupled with each other by an electronic component such as a communication bus (202). The type and / or number of hardware components included in the wearable device (101) are not limited to those illustrated in FIG. 2. For example, the wearable device (101) may include only some of the hardware components illustrated in FIG. 2.

[0044] According to one embodiment, the processor (210) of the wearable device (101) may include a hardware component for processing data based on one or more instructions. The hardware component for processing data may include, for example, an arithmetic and logic unit (ALU), a field programmable gate array (FPGA), a central processing unit (CPU), and / or an application processor (AP). In one embodiment, the wearable device (101) may include one or more processors. The processor (210) may have a multi-core processor structure, such as a dual core, a quad core, a hexa core, and / or an octa core.

[0045] According to one embodiment, the memory (215) of the wearable device (101) may include a hardware component for storing data and / or instructions input and / or output to the processor (210). The memory (215) may include, for example, a volatile memory such as a random-access memory (RAM) and / or a non-volatile memory such as a read-only memory (ROM). The volatile memory may include, for example, at least one of a dynamic RAM (DRAM), a static RAM (SRAM), a cache RAM, and a pseudo SRAM (PSRAM). The non-volatile memory may include, for example, at least one of a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), a flash memory, a hard disk, a compact disc, and an embedded multi media card (eMMC). In one embodiment, the memory (215) may be referred to as storage.

[0046] In one embodiment, the display (220) of the wearable device (101) can output visualized information (e.g., the screen (130) of FIG. 1) to a user of the wearable device (101) (e.g., the user (110) of FIG. 1). For example, the display (220) can be controlled by a processor (210) including a circuit such as a graphic processing unit (GPU) to output visualized information to the user. The display (220) can include a flexible display, a flat panel display (FPD), and / or electronic paper. The FPD can include a liquid crystal display (LCD), a plasma display panel (PDP), and / or one or more light emitting diodes (LEDs). The LEDs can include organic LEDs (OLEDs). Embodiments are not limited thereto, and for example, if the wearable device (101) includes a lens for transmitting external light (or ambient light), the display (220) may include a projector (or projection assembly) for projecting light onto the lens. In one embodiment, the display (220) may be referred to as a display panel and / or a display module.

[0047] In one embodiment, the camera (225) of the wearable device (101) may include one or more optical sensors (e.g., a charged coupled device (CCD) sensor, a complementary metal oxide semiconductor (CMOS) sensor) that generate electrical signals representing the color and / or brightness of light. The camera (225) may be referred to as an image sensor and may be included in the sensor (230) of FIG. 2. The plurality of optical sensors included in the camera (225) may be arranged in the form of a two-dimensional grid. The camera (225) may acquire electrical signals of each of the plurality of optical sensors substantially simultaneously, and generate two-dimensional frame data corresponding to light reaching the optical sensors of the two-dimensional grid. For example, photographic data captured using the camera (225) may mean one (a) two-dimensional frame data acquired from the camera (225). For example, video data captured using a camera (225) may mean a sequence of a plurality of two-dimensional frame data acquired from the camera (225) according to a frame rate. The camera (225) may further include a flash light that is positioned toward the direction in which the camera (225) receives light and outputs light toward the direction.

[0048] According to one embodiment, the wearable device (101) may include a plurality of cameras, for example, cameras (225), arranged facing different directions. Referring to FIG. 2, the camera (225) included in the wearable device (101) may include a gaze tracking camera (225-1) and / or an outward camera (225-2). The gaze tracking camera (225-1) may be arranged toward at least one of the two eyes of a user wearing the wearable device (101). The processor (210) may identify the direction of the user's gaze using images and / or videos acquired from the gaze tracking camera (225-1). The gaze tracking camera (225-1) may include an infrared (IR) sensor. The gaze tracking camera (225-1) may be referred to as an eye sensor, a gaze tracker, and / or an eye tracker.

[0049] Referring to FIG. 2, the external camera (225-2) may be positioned to face the front of a user wearing the wearable device (101) (e.g., in a direction in which both eyes may face). Using images and / or videos acquired from the external camera (225-2), the processor (210) may identify an external object (e.g., the external electronic device (120) of FIG. 1). The embodiment is not limited thereto, and the processor (210) may identify a position, shape, and / or gesture (e.g., a hand gesture) of a hand based on images and / or videos acquired from the external camera (225-2).

[0050] According to one embodiment, a sensor (230) of a wearable device (101) may generate electrical information from non-electronic information related to the wearable device (101), which may be processed and / or stored by a processor (210) and / or a memory (215) of the wearable device (101). The information may be referred to as sensor data. The sensor (230) may include a global positioning system (GPS) sensor, an image sensor, an ambient light sensor, and / or a time-of-flight (ToF) sensor for detecting a geographic location of the wearable device (101), an inertial measurement unit (IMU) (e.g., an acceleration sensor, a geomagnetic sensor, a gravity sensor, or any combination thereof) for detecting a physical motion of the wearable device (101).

[0051] An IMU for detecting motion of a wearable device (101) may include an acceleration sensor, a geomagnetic sensor, a gyro sensor, or a combination thereof. The acceleration sensor may output an electrical signal representing gravitational acceleration and / or acceleration along each of a plurality of axes (e.g., x-axis, y-axis, and z-axis) that are perpendicular to each other and based on the origin of the wearable device (101). In one embodiment, the gyro sensor may output an electrical signal representing an angular velocity of each of the plurality of axes. In one embodiment, the geomagnetic sensor may output an electrical signal representing a magnitude of a magnetic field formed in the wearable device (101) along each of the plurality of axes (e.g., x-axis, y-axis, and / or z-axis). For example, an acceleration sensor, a gyro sensor, and / or a geomagnetic sensor may repeatedly output sensor data including accelerations, angular velocities, and / or magnitudes of magnetic fields of said plurality of axes based on a specified period (e.g., about 1 millisecond).

[0052] In one embodiment, the communication circuit (235) of the wearable device (101) may include circuitry for supporting transmission and / or reception of electrical signals between the wearable device (101) and an external electronic device. The communication circuit (235) may include, for example, at least one of a modem, an antenna, and an optical / electronic (O / E) converter. The communication circuit (235) may support transmission and / or reception of electrical signals based on various types of protocols, such as Ethernet, a local area network (LAN), a wide area network (WAN), wireless fidelity (WiFi), Bluetooth, Bluetooth low energy (BLE), ZigBee, long term evolution (LTE), 5G new radio (NR), 6G and / or above-6G. In one embodiment, the communication circuit (235) may be referred to as a communication processor and / or a communication module.

[0053] In one embodiment, the communication circuit (235) of the wearable device (101) may include a BLE communication circuit (235-1) for supporting a communication function based on BLE. The communication circuit (235) may include a UWB communication circuit (235-2) for supporting a communication function based on UWB. Although only the BLE communication circuit (235-1) is illustrated, the embodiment is not limited thereto, and for example, the communication circuit (235) may further include a communication circuit for legacy Bluetooth. The BLE communication circuit (235-1) may be referred to as a first communication circuit, and the UWB communication circuit (235-2) may be referred to as a second communication circuit. The processor (210) of the wearable device (101) may individually control the states of each of the BLE communication circuit (235-1) and the UWB communication circuit (235-2).

[0054] For example, the state of the BLE communication circuit (235-1) may be classified into a disabled state or an enabled state depending on the power consumption of the BLE communication circuit (235-1) and / or the magnitude of the voltage and / or current input to the BLE communication circuit (235-1). In the disabled state, the power consumption of the BLE communication circuit (235-1) may be relatively low. In the disabled state, the voltage and / or current of the power signal input to the BLE communication circuit (235-1) may be lower than a specified threshold and / or may be substantially 0. In the enabled state, the power consumption of the BLE communication circuit (235-1) may be relatively high, and the magnitude of the voltage and / or current input to the BLE communication circuit (235-1) may also be greater than a specified threshold.

[0055] Similarly, the processor (210) can control the state of the UWB communication circuit (235-2) between an inactive state and an active state. In the inactive state, the voltage and / or current of the power signal input to the UWB communication circuit (235-1) may be below a specified threshold. In the inactive state, the power consumption of the UWB communication circuit (235-2) may be relatively low. In the active state, the voltage and / or current of the power signal input to the UWB communication circuit (235-1) may exceed a specified threshold. In the active state, the power consumption of the UWB communication circuit (235-1) may be relatively high. Hereinafter, an embodiment in which the processor (210) controls the state of the UWB communication circuit (235-2) is described, but the embodiment is not limited thereto. For example, the processor (210) may switch or control the state of other communication circuits (e.g., Wi-Fi and / or BLE) capable of identifying a location relationship to either an inactive state or an active state.

[0056] According to one embodiment, one or more instructions (or commands) representing data to be processed, calculations to be performed, and / or operations to be performed by the processor (210) of the wearable device (101) may be stored in the memory (215) of the wearable device (101). A set of one or more instructions may be referred to as firmware, an operating system, a process, a routine, a sub-routine, and / or a software application (hereinafter, “application”). For example, the wearable device (101) and / or the processor (210) may perform at least one of the operations of FIGS. 3A, 3B to 5, and / or 10 when a set of a plurality of instructions distributed in the form of an operating system, firmware, a driver, and / or an application is executed. Hereinafter, the fact that an application is installed in a wearable device (101) may mean that one or more instructions provided in the form of an application are stored in a memory (215), and that the one or more applications are stored in a format executable by the processor (210) (e.g., a file having an extension specified by the operating system of the wearable device (101)). For example, an application may include a program and / or a library related to a service provided to a user.

[0057] Referring to FIG. 2, programs installed in the wearable device (101) may be classified into any one of different layers, including an application layer (240), a framework layer (250), and / or a hardware abstraction layer (HAL) (280), based on the target. For example, programs (e.g., modules or drivers) designed to target the hardware of the wearable device (101) (e.g., the display (220), the camera (225), the sensor (230), and / or the communication circuit (235)) may be classified within the hardware abstraction layer (280). The framework layer (250) may be referred to as an XR framework layer in terms of including one or more programs for providing an XR (extended reality) service. For example, the layers illustrated in FIG. 2 may be logically (or for convenience of explanation) separated, and may not mean that the address space of the memory (215) is separated by the layers.

[0058] For example, within the framework layer (250), programs designed to target at least one of the hardware abstraction layer (280) and / or the application layer (240) (e.g., a position tracker (271), a space recognizer (272), a gesture tracker (273), an eye-gaze tracker (274), and / or a face tracker (275)) may be classified. Programs classified within the framework layer (250) may provide an executable API (application programming interface) based on other programs.

[0059] For example, within the application layer (240), programs designed to target users of the wearable device (101) may be classified. As examples of programs classified into the application layer (240), an extended reality (XR) system user interface (UI) (241) and / or an XR application (242) are exemplified, but the embodiment is not limited thereto. For example, programs (e.g., software applications) classified into the application layer (240) may call an application programming interface (API) to cause execution of functions supported by programs classified into the framework layer (250).

[0060] For example, the wearable device (101) may display one or more visual objects on the display (220) for performing interaction with a user for using a virtual space based on the execution of the XR system UI (241). A visual object may refer to an object that can be deployed within a screen for transmitting and / or interacting with information, such as text, an image, an icon, a video, a button, a checkbox, a radio button, a text box, a slider, and / or a table. A visual object may be referred to as a visual guide, a virtual object, a visual element, a UI element, a view object, and / or a view element. The wearable device (101) may provide the user with functions available within the virtual space based on the execution of the XR system UI (241).

[0061] Referring to FIG. 2, a lightweight renderer (243) and / or an XR plug-in (244) are illustrated to be included within the XR system UI (241), but are not limited thereto. For example, based on the XR system UI (241), the processor (210) may execute a lightweight renderer (243) and / or an XR plug-in (244) within the framework layer (250).

[0062] According to one embodiment, the wearable device (101) may receive an input for controlling whether to display a screen including an external environment on the display (220). The input may include at least one of a virtual object displayed on the display (220), a button (or dial) disposed on the housing of the wearable device (101), a touch pad, and / or a user's voice command. Based on the input, the wearable device (101) may switch from a mode providing VR to a mode providing AR. A wearable device (101) operating in a mode providing AR may, in response to the input, switch to a mode providing VR.

[0063] For example, the wearable device (101) may obtain resources (e.g., APIs, system processes, and / or libraries) used to define, create, and / or execute a rendering pipeline that allows partial changes based on the execution of a lightweight renderer (243). The lightweight renderer (243) may be referred to as a lightweight render pipeline in terms of defining a rendering pipeline that allows partial changes. The lightweight renderer (243) may include a renderer built prior to the execution of a software application (e.g., a prebuilt renderer). For example, the wearable device (101) may obtain resources (e.g., APIs, system processes, and / or libraries) used to define, create, and / or execute an entire rendering pipeline based on the execution of an XR plug-in (244). The XR plugin (244) can be referred to as an open XR native client from the perspective of defining (or setting up) the entire rendering pipeline.

[0064] For example, the wearable device (101) may display a screen representing at least a portion of a virtual space on the display (220) based on the execution of the XR application (242). The XR plug-in (244-1) included in the XR application (242) may include instructions that support functions similar to those of the XR plug-in (244) of the XR system UI (241). Descriptions of the XR plug-in (244-1) that overlap with those of the XR plug-in (244) may be omitted. The wearable device (101) may cause the execution of the virtual space manager (251) based on the execution of the XR application (242).

[0065] According to one embodiment, the wearable device (101) may provide a virtual space service based on the execution of the virtual space manager (251). For example, the virtual space manager (251) may include a platform for supporting the virtual space service. The wearable device (101) may identify a virtual space formed based on the user's location indicated by data acquired through the sensor (230) based on the execution of the virtual space manager (251), and may display at least a portion of the virtual space on the display (220). The virtual space manager (251) may be referred to as a composition presentation manager (CPM).

[0066] For example, the virtual space manager (251) may include a runtime service (252). As an example, the runtime service (252) may be referred to as an OpenXR runtime module (or an OpenXR runtime program). The wearable device (101) may execute at least one of a user's pose prediction function, a frame timing function, and / or a spatial input function based on the execution of the runtime service (252). As an example, the wearable device (101) may perform rendering for a virtual space service to the user based on the execution of the runtime service (252). For example, a function related to a virtual space, executable by the application layer (240), may be supported based on the execution of the runtime service (252).

[0067] For example, the virtual space manager (251) may include a pass-through manager (253). Based on the execution of the pass-through manager (253), the wearable device (101) may display a screen representing a virtual space on the display (220), while superimposing another screen representing an actual space obtained through the camera (225) on at least a portion of the screen.

[0068] For example, the virtual space manager (251) may include an input manager (254). The wearable device (101) may identify data (e.g., sensor data) obtained by executing one or more programs included in the recognition service layer (270) based on the execution of the input manager (254). The wearable device (101) may use the obtained data to identify user input related to the wearable device (101). The user input may be related to a motion (e.g., hand gesture), gaze, and / or speech of the user identified by the sensor (230).

[0069] For example, the perception abstract layer (260) can be used for data exchange between the virtual space manager (251) and the perception service layer (270). From the perspective of being used for data exchange between the virtual space manager (251) and the perception service layer (270), the perception abstract layer (260) can be referred to as an interface. For example, the perception abstract layer (260) can be referenced as OpenPX. The perception abstract layer (260) can be used for a perception client and a perception service.

[0070] According to one embodiment, the recognition service layer (270) may include one or more programs for processing data acquired from a sensor (230) (or a camera (225)). The one or more programs may include at least one of a position tracker (271), a space recognizer (272), a gesture tracker (273), an eye tracker (274), and / or a face tracker (273). The type and / or number of the one or more programs included in the recognition service layer (270) are not limited to those illustrated in FIG. 2.

[0071] For example, the wearable device (101) can identify the pose of the wearable device (101) using the sensor (230) based on the execution of the position tracker (271). The wearable device (101) can identify the 6 degrees of freedom pose (6 dof pose) of the wearable device (101) using data acquired using the camera (225) and the sensor (230) (e.g., IMU) based on the execution of the position tracker (271). The position tracker (271) may be referred to as a head tracking (HeT) module (or head tracking program).

[0072] For example, the wearable device (101) may be used to construct a three-dimensional virtual space around the wearable device (101) (or a user of the wearable device (101)) based on the execution of the space recognizer (272). The wearable device (101) may reconstruct the three-dimensional surroundings of the wearable device (101) using data acquired using the camera (225) based on the execution of the space recognizer (272). The wearable device (101) may identify at least one of a plane, a slope, and stairs based on the three-dimensionally reconstructed surroundings of the wearable device (101) based on the execution of the space recognizer (272). The space recognizer (272) may be referred to as a scene understanding (SU) module (or a scene understanding program).

[0073] For example, the wearable device (101) may identify (or recognize) a pose and / or gesture of a hand of a user of the wearable device (101) based on the execution of the gesture tracker (273). As an example, the wearable device (101) may identify a pose and / or gesture of a hand of a user using data acquired from a sensor (230) based on the execution of the gesture tracker (273). As an example, the wearable device (101) may identify a pose and / or gesture of a hand of a user based on data (or images) acquired using a camera (225) based on the execution of the gesture tracker (273). The gesture tracker (273) may be referred to as a hand tracking (HaT) module (or hand tracking program) and / or a gesture tracking module.

[0074] For example, the wearable device (101) can identify (or track) eye movements of a user of the wearable device (101) based on the execution of the gaze tracker (274). As an example, the wearable device (101) can identify eye movements of the user using data acquired from at least one sensor based on the execution of the gaze tracker (274). As an example, the wearable device (101) can identify eye movements of the user based on data acquired using a camera (e.g., an gaze tracking camera (225-1)) and / or an infrared light emitting diode (IR LED) based on the execution of the gaze tracker (274). The gaze tracker (274) may be referred to as an eye tracking (ET) module (or eye tracking program), and / or a gaze tracking module.

[0075] For example, the recognition service layer (270) of the wearable device (101) may further include a face tracker (275) for tracking the user's face. For example, the wearable device (103) may identify (or track) the movement of the user's face and / or the user's expression based on the execution of the face tracker (275). The wearable device (101) may estimate the user's expression based on the movement of the user's face based on the execution of the face tracker (275). As an example, the wearable device (101) may identify the movement of the user's face and / or the user's expression based on data (e.g., an image) acquired using the camera (225) based on the execution of the face tracker (275).

[0076] According to one embodiment, the processor (210) of the wearable device (101) can identify an external electronic device (e.g., the external electronic device (140) of FIG. 1) that has transmitted a wake-up packet (e.g., an advertisement packet) using the BLE communication circuit (235-1). The external electronic device may include a vehicle (e.g., the first vehicle (141) to the third vehicle (143) of FIG. 1) and / or an electronic control unit (ECU) included in the vehicle, a door handle, and / or an Internet of Things (IoT) device that supports a function related to ranging. The processor (210) that has identified the wake-up packet through the BLE communication circuit (235-1) can search for authentication information (e.g., key information including a digital car key) about the external electronic device that has transmitted the wake-up packet in the memory (215). The above authentication information may be stored in a dedicated area (or dedicated region) of memory (215), referred to as a secure element. The secure element may be formed within the memory (215) and / or the processor (210), or may be formed within a coprocessor separate from the processor (210).

[0077] When the authentication information corresponding to the external electronic device that transmitted the wake-up packet is identified from the secure element, the processor (210) may perform object recognition of an image and / or video of the camera (225) (e.g., an external camera (225-2)) based on information of the external electronic device corresponding to the authentication information (e.g., information indicating the exterior or appearance of the external electronic device). Based on the object recognition, the processor (210) may determine whether the external electronic device that transmitted the wake-up packet was captured by the camera (225). The processor (210) may identify the user's gaze directed toward the external electronic device that transmitted the wake-up packet using the sensor (230) and / or the gaze tracking camera (225-1). The wearable device (101) that identifies an external electronic device based on an image and / or video acquired by an external camera (225-1) and / or identifies a user's gaze toward the external electronic device can activate the UWB communication circuit (235-2). By controlling the activated UWB communication circuit (235-2), the wearable device (101) can obtain information indicating a positional relationship between the external electronic device and the wearable device (101). The wearable device (101) can obtain the information indicating the positional relationship by using a different means from the UWB communication circuit (235-2), such as a ToF camera.

[0078] As described above, according to one embodiment, the processor (210) of the wearable device (101) may determine whether to activate the UWB communication circuit (235-2) using data from the camera (225) and / or the sensor (230) within a state in which an external electronic device has been identified using the BLE communication circuit (235-1). For example, the UWB communication circuit (235-2) may be conditionally activated within a state in which the external electronic device has been identified using the camera (225) and / or the motion of the wearable device (101) associated with the external electronic device has been identified using the sensor (230). By conditionally activating the UWB communication circuit (235-2), the processor (210) may reduce power consumption of the UWB communication circuit (235-2) and reduce heat generated by the activated UWB communication circuit (235-2). In one embodiment where the wearable device (101) includes a battery, a reduction in the power consumption of the UWB communication circuit (235-2) may result in an increase in the operating duration of the wearable device (101) based on the battery.

[0079] Hereinafter, with reference to FIG. 3a and / or FIG. 3b, the operation of a wearable device (101) and / or a processor (210) that processes a wake-up packet received through a BLE communication circuit (235-1) is described.

[0080] FIGS. 3A and 3B illustrate an example of a flowchart of a wearable device according to one embodiment. The wearable device (101) of FIGS. 1 and 2 and / or the processor (210) of FIG. 2 may perform the operations described with reference to FIGS. 3A and / or 3B.

[0081] Referring to FIG. 3A, in operation (310), a processor of a wearable device according to an embodiment may receive an advertisement packet. The advertisement packet may be periodically transmitted from an external electronic device (e.g., the external electronic device (140) of FIG. 1). The advertisement packet may be an example of a wake-up packet. When the distance between the wearable device and the external electronic device is reduced to a distance at which the advertisement packet can be received, the processor may receive the advertisement packet of operation (310) via a BLE communication circuit (e.g., the BLE communication circuit (235-1) of FIG. 2). The distance at which the advertisement packet can be received may vary depending on the wireless communication environment between the wearable device and the external electronic device.

[0082] Referring to FIG. 3A, in operation (320), a processor of a wearable device according to one embodiment may authenticate an external electronic device (e.g., a vehicle) that has transmitted an advertisement packet. In response to receiving the advertisement packet of operation (310), the processor may perform operation (320). The processor may perform authentication for the advertisement packet based on authentication information stored in a memory (e.g., memory (215) of FIG. 2). When receiving an advertisement packet from a vehicle, the processor may perform authentication of operation (320) based on key information stored in the memory.

[0083] For example, an advertisement packet may store an address (e.g., an advertisement (ADV) address) of an external electronic device (e.g., a vehicle) that transmitted the advertisement packet. The address may be defined by the Car Connectivity Consortium (CCC). The address may be encrypted using key information previously exchanged between the wearable device and the external electronic device. The address may be scrambled using the key information previously exchanged between the wearable device and the external electronic device.

[0084] For example, an advertisement packet may include a resolving private address (RPA) of an external electronic device (e.g., a vehicle) that transmitted the advertisement packet. The RPA may be encrypted based on an identity resolving key (IRK) of the external electronic device. The RPA may be associated with an address assigned to the external electronic device (e.g., a randomly assigned address). A processor that receives the advertisement packet may decrypt the advertisement packet based on authentication information stored in a memory. The decryption may include resolving the advertisement packet based on an IRK included in the authentication information. A processor that identifies an RPA from the advertisement packet based on the authentication information may communicate with the external electronic device based on the RPA.

[0085] The authentication information used for authentication of operation (320) may be pre-registered in the wearable device prior to operation (310). The authentication information may be exchanged in advance between the wearable device and the external electronic device prior to operation (310). The embodiment is not limited thereto, and the authentication information may be provided from a server connected to the wearable device. Based on the authentication information, the address information (e.g., the ADV address and / or RPA) included in the advertisement packet may be decrypted. If the decrypted address information matches the address information of the external electronic device indicated by the authentication information, the wearable device may determine the external electronic device that transmitted the advertisement packet of operation (310) as the external electronic device corresponding to the authentication information.

[0086] Referring to FIG. 3A, in operation (330), a processor of a wearable device according to an embodiment may identify an external electronic device using a camera (e.g., camera 225 of FIG. 2 and / or external camera 225-2) and / or a sensor (e.g., sensor 230 of FIG. 2). Based on the authentication of operation (320), the processor may perform operation (330). The processor may perform operation (330) using information stored in a memory and used to identify the external electronic device. The information may include parameters for identifying a vehicle, which is an example of the external electronic device (e.g., a model name of the vehicle). The embodiment is not limited thereto, and the information may include information indicating the appearance, type, and / or color of the external electronic device.

[0087] In operation (330), the processor may identify at least one external electronic device captured by the camera based on at least one visual object identified in an image acquired from the camera. If the external electronic device is not identified using the camera and / or sensor (330-No), the processor may search for the external electronic device without performing operation (340). If the external electronic device is identified using the camera and / or sensor (330-Yes), the processor may perform operation (340). The processor performing operation (340) may be related to whether the external electronic device is identified using the camera. The embodiment is not limited thereto, and the processor may determine whether to perform operation (340) based on the location and / or size of the visual object corresponding to the external electronic device within the image. The processor may determine whether to perform an action (340) based on the motion of the wearable device and / or the user wearing the wearable device, identified by the sensor, within a state in which the external electronic device has been identified using the camera.

[0088] Referring to FIG. 3A, in operation (340), a processor of a wearable device according to one embodiment may obtain information (e.g., distance, angle, and / or direction) related to a positional relationship between the wearable device and an external electronic device based on UWB. The processor may perform operation (340) using a UWB communication circuit (e.g., the UWB communication circuit (235-2) of FIG. 2). Information that may be identified using the UWB communication circuit may vary depending on the number of UWB antennas included in the external electronic device.

[0089] For example, when communicating with an external electronic device including one UWB antenna, the processor may identify only the distance between the wearable device and the external electronic device based on operation (340). For example, when communicating with an external electronic device including two UWB antennas, the processor may identify the distance, angle, and / or direction between the wearable device and the external electronic device based on operation (340). The angle and / or direction may be identified on a plane including the two UWB antennas. For example, when communicating with an external electronic device including three or more UWB antennas, the processor may identify the distance, angle, and / or direction in three-dimensional space between the wearable device and the external electronic device based on operation (340). The operation of the processor for obtaining information of operation (340) based on UWB is described with reference to FIG. 5.

[0090] As described above, according to one embodiment, the wearable device can determine at least one external electronic device to be preferentially connected among the plurality of external electronic devices (e.g., vehicles) by using a camera and / or a sensor, within a state in which a plurality of connectable external electronic devices (e.g., vehicles) are identified based on authentication of advertisement packets. The wearable device can preferentially connect to the determined at least one external electronic device. Because the wearable device preferentially connects to the at least one external electronic device, the wearable device can control a communication circuit (e.g., the communication circuit (235) of FIG. 2) based on relatively low complexity. Because the wearable device preferentially connects to the at least one external electronic device, the wearable device can reduce delay due to unnecessary connection and improve power consumption.

[0091] For example, referring to FIG. 3B , according to one embodiment, a processor of a wearable device may, within operation (350), use information acquired based on operation (340) to identify whether an external electronic device is moved out of the FoV. Before the external electronic device is moved out of the FoV (e.g., if the external electronic device is visible through the FoV) (330—No), the processor may continue to acquire information related to the positional relationship based on operation (340). If the external electronic device is moved out of the FoV (340—Yes), the processor may perform operation (360).

[0092] Referring to FIG. 3B, in operation (360), according to one embodiment, the processor of the wearable device may at least temporarily suspend acquisition of information based on UWB. The embodiment is not limited thereto, and the processor may increase the cycle of acquiring information based on UWB. For example, the processor may switch the state of the UWB communication circuit (e.g., the UWB communication circuit 235-2 of FIG. 2) from an active state to an inactive state. As the state of the UWB communication circuit is switched to the inactive state, the processor may reduce power consumption by the UWB communication circuit. The suspension of information acquisition based on operation (360) may be maintained until the external electronic device is moved into the FoV. For example, after operation (360), the processor, which has identified the external electronic device moved into the FoV, may resume acquiring information about the positional relationship of the external electronic device based on operation (340). For example, after motion (360), a processor that has identified an external electronic device that has moved into the FoV can reduce the cycle time for obtaining information about the positional relationship.

[0093] Hereinafter, with reference to FIG. 4, an exemplary operation of a wearable device that establishes a communication link based on BLE and performs secure ranging based on UWB is described.

[0094] FIG. 4 illustrates an example of a flowchart of a wearable device (101) that identifies an external electronic device based on BLE. The wearable device (101) of FIGS. 1 and 2 and / or the processor (210) of FIG. 2 can perform the operations described with reference to FIG. 4.

[0095] The operations performed by the wearable device (101) and the external electronic device (140), as described with reference to FIG. 4, may be at least partially related to the standards defined by the Car Connectivity Consortium (CCC). Based at least on the standards, the wearable device (101) may perform authentication for a vehicle (e.g., the first vehicle (141) to the third vehicle (143) of FIG. 1) using BLE and / or UWB, and may perform a function for remotely controlling the vehicle (e.g., unlocking a door) based on the authentication.

[0096] Referring to FIG. 4, according to one embodiment, the processor of the wearable device (101) may receive an advertisement packet (410) of an external electronic device (140) through a BLE communication circuit (e.g., the BLE communication circuit (235-2) of FIG. 2). The external electronic device (140) may periodically transmit the advertisement packet (410). The processor of the wearable device (101) that has received the advertisement packet (410) may identify whether authentication information (e.g., a digital car key) corresponding to the advertisement packet (410) is stored in the memory. If the authentication information (e.g., a digital car key) corresponding to the advertisement packet (410) is stored in the memory, the processor of the wearable device (101) may perform operation (420).

[0097] Referring to FIG. 4, in operation (420), a processor of a wearable device (101) according to one embodiment may establish a communication link based on BLE at least based on identifying an external electronic device using a camera (e.g., camera 225 and / or external camera 225-2 of FIG. 2). The processor, having identified an authenticated external electronic device (140) (e.g., a vehicle) based on an advertisement packet (410), may search for the external electronic device (140) using the camera. The search may include an operation of identifying at least a portion associated with the external electronic device (140) within an image and / or video acquired from the camera. To identify at least a portion associated with the external electronic device (140) within the image and / or video, the processor may utilize information representing the appearance of the external electronic device (140). The information may be stored in conjunction with authentication information for authenticating the advertisement packet (410). The above information may be provided from a server connected to the wearable device (101). The camera of the operation (420) may be placed in front of the wearable device (101).

[0098] A processor that identifies an external electronic device (140) using a camera may initiate the establishment of a communication link in operation (420). The communication link in operation (420) may be established between the wearable device (101) and the external electronic device (140) based on a Bluetooth link layer (e.g., link layer connection establishment). The communication link in operation (420) may be established based on L2CAP (logical link control and adaptation layer protocol). The communication link in operation (420) may be established for a secure connection based on authentication of the external electronic device (140). The embodiment is not limited thereto, and the wearable device (101) may perform an operation related to authentication of the external electronic device (140) (e.g., operation (450) of FIG. 4) based on identifying the external electronic device (140) using a camera while establishing a communication link based on BLE with the external electronic device (140). The embodiment is not limited thereto, and the wearable device (101) can optionally establish a communication link with an external electronic device (140) included within the FoV of the camera, and perform authentication for the external electronic device (140).

[0099] In one embodiment, the processor of the wearable device (101) may determine whether to establish a communication link in operation (420) based on a connection limit. If more than the connection limit have been established based on BLE prior to operation (420), the processor may stop establishing the communication link and / or refrain from doing so based on operation (420). The connection limit may be, for example, 15. If more than the connection limit have been established based on BLE prior to operation (420), the processor may control the BLE communication circuit to transmit a control message (e.g., command complete subevent (DEVICE_SE_BUSY)) containing designated information (e.g., DEVICE_SE_BUSY information) to postpone the establishment of the communication link to the external electronic device (140). Based on the above control message, the external electronic device (140) may transmit a control message (430) related to the communication link to the wearable device (101) after a specified period of time (e.g., 500 milliseconds and / or 2 seconds).

[0100] In one embodiment, in a state where communication links exceeding the connection limit are established based on BLE, a processor of a wearable device (101) that has received an advertisement packet (410) may perform an operation (420) based on whether the external electronic device (140) that transmitted the advertisement packet (410) is an external electronic device (140) that should be preferentially connected. For example, authentication information corresponding to an external electronic device (140) set as an electronic device that should be preferentially connected may include a parameter (or flag), such as preferred, indicating that the external electronic device (140) is an electronic device that should be preferentially connected. The processor that has identified the parameter may release a previously established communication link and perform an operation (420) for the external electronic device (140) in a state where communication links exceeding the connection limit are established.

[0101] Referring to FIG. 4, according to one embodiment, a processor of a wearable device (101) may receive a control message (430) for selecting authentication information, such as a digital key, from an external electronic device (140). The control message (430) may be transmitted from the external electronic device (140) to the wearable device (101) to select authentication information (e.g., a digital car key) corresponding to the external electronic device (140) within a secure element of the wearable device (101). Based on the control message (430), the processor of the wearable device (101) may access the secure element and retrieve authentication information corresponding to the control message (430).

[0102] Referring to FIG. 4, according to one embodiment, the processor of the wearable device (101) may transmit a response message (440) indicating the identification of authentication information, such as a digital key. When the authentication information indicated by the control message (430) is retrieved within the secure element, the processor of the wearable device (101) may transmit a response message (440) to an external electronic device (140) to notify the retrieval and / or selection of the authentication information.

[0103] Referring to FIG. 4, in operation (450), according to one embodiment, the processor of the wearable device (101) may perform authentication on the external electronic device (140) based on authentication information such as a digital key. The wearable device (101) may authenticate the external electronic device (140) using authentication information stored in the secure element and corresponding to the external electronic device (140). The digital key may be generated or may be used to perform secure positioning using UWB. The digital key may be generated based on an authentication chain (or key chain) of the external electronic device (140) and / or a manufacturer of a vehicle including the external electronic device (140).

[0104] Referring to FIG. 4, in operation (460), an external electronic device (140) communicating with a wearable device (101) according to one embodiment may complete processing of a secure element. Operation (460) may be performed in response to completion of authentication based on operation (450). The external electronic device (140) performing operation (460) may transmit a control message (470) to the wearable device (101) for deselecting the secure element.

[0105] Referring to FIG. 4, a processor of a wearable device (101) according to one embodiment may receive a control message (470) for deselection of a security element from an external electronic device (140). The control message (470) may correspond to a designated control message for deselection (e.g., command complete subevent (DESELECT)).

[0106] Referring to FIG. 4, in operation (480), according to one embodiment, a processor of a wearable device (101) may establish secure ranging based on UWB. Based on operation (480), the wearable device (101) and an external electronic device (140) may perform a setup operation for performing secure ranging based on operation (490). The secure ranging may be established based on operation (480) for exclusive transmission of a ranging message transmitted wirelessly based on UWB.

[0107] Referring to FIG. 4, within operation (490), according to one embodiment, the processor of the wearable device (101) may perform secure ranging using a UWB communication circuit (e.g., the UWB communication circuit (235-2) of FIG. 2). The operation of performing secure ranging based on operations (480, 490) of FIG. 4 is described in more detail with reference to FIG. 5.

[0108] As described above, according to one embodiment, the wearable device (101) may prioritize the external electronic device (140) that transmitted the advertisement packet (410) using the camera and / or sensor in response to authentication of the advertisement packet (410). For example, the wearable device (101) may prioritize the external electronic device (140) based on whether the external electronic device (140) is identified using the camera and / or sensor, and / or the number of communication links established based on BLE. Based on the priority of the external electronic device (140), the wearable device (101) may efficiently perform secure positioning related to UWB.

[0109] FIG. 5 illustrates an example of a flowchart of a wearable device (101) performing secure ranging based on UWB. The wearable device (101) of FIGS. 1 and 2 and / or the processor (210) of FIG. 2 may perform the operations described with reference to FIG. 5. The operations of FIG. 5 may be related to at least one of the operations of FIG. 4 (e.g., operations (480, 490) of FIG. 4).

[0110] Referring to FIG. 5, a vehicle (510) is illustrated as an example of an external electronic device (e.g., the external electronic device (140) of FIG. 1) communicating with a wearable device (101). The vehicle (510) may include anchors (e.g., a first anchor (520-1) to an n-th anchor (520-n)) positioned at different locations. The anchors may include antennas (e.g., patch antennas) for wireless communication based on UWB. The anchors may be positioned at points within the vehicle (510) that are spaced apart from each other to support accurate positioning based on UWB.

[0111] Referring to FIG. 5, according to one embodiment, a processor of a wearable device (101) may transmit a positioning control message (530) to anchors of a vehicle (510). The positioning control message (530) may include information for secure positioning. After transmitting the positioning control message (530), the processor may transmit a positioning initiation message (535) to notify the anchors of the vehicle (510) of the initiation of secure positioning. After transmitting the positioning initiation message (535), the processor of the wearable device (101) may receive positioning response messages (540) transmitted from the anchors via a UWB communication circuit (e.g., the UWB communication circuit (235-2) of FIG. 2).

[0112] Referring to FIG. 5, in an exemplary case where a wearable device (101) performs secure positioning for a vehicle (510) including n anchors, a processor of the wearable device (101) may receive n positioning response messages (540) from the n anchors. The processor may identify or calculate a positional relationship of the vehicle (510) with respect to the wearable device (101) based on a time difference (or phase difference) in which the positioning response messages (540) are received.

[0113] The processor of the wearable device (101) that receives the positioning response messages (540) may transmit positioning end messages (545) to the n anchors to indicate the end of positioning. After transmitting the positioning end messages (545), the processor of the wearable device (101) may transmit a measurement report message (550). The measurement report message (550) may be individually transmitted to the n anchors and / or broadcast. The measurement report message (550) may include a round time (e.g., a time difference from the transmission timing of the positioning initiation message (535) to the reception timing of the positioning response message (540) measured by the processor of the wearable device (101)) and / or a replay time associated with the corresponding anchor. An anchor (e.g., a first anchor (520-1) to an n-th anchor (520-n)) that has received the measurement report message (550) can identify a distance between the anchor and the wearable device (101) based on the measurement report message (550). Based on the distances identified in each of the n anchors, the vehicle (510) (or the ECU of the vehicle (510)) can identify a positional relationship between the wearable device (101) and the vehicle (510).

[0114] The UWB-based secure positioning operation described with reference to FIG. 5 may require transmission and / or reception of UWB-based wireless signals, which may result in increased power consumption. In one embodiment, the wearable device (101) may determine whether to perform secure positioning of a vehicle (510) using a camera and / or a sensor. Hereinafter, exemplary operations of the wearable device (101) for determining whether to perform secure positioning of a vehicle (510) using a camera and / or a sensor are described with reference to FIGS. 6A and 6B.

[0115] FIGS. 6A and 6B illustrate an example of an operation of a wearable device (101) based on a positional relationship with respect to an external electronic device (140). The wearable device (101) of FIGS. 1 and 2 and / or the processor (210) of FIG. 2 may perform the operations described with reference to FIGS. 6A and / or 6B.

[0116] Referring to FIGS. 6A and / or 6B , exemplary states (601, 602) of a wearable device (101) worn by a user (110) are illustrated. In the state (601) of being worn by a user (110) located at a point (p1), the wearable device (101) can receive advertisement packets based on BLE from an external electronic device (140), such as a first vehicle (141), a second vehicle (142), and a third vehicle (143). The wearable device (101) that has received the advertisement packets can perform the operations described with reference to FIGS. 3A to 5 . For example, the wearable device (101) can perform authentication for the advertisement packets. When the authentication information of all of the first vehicle (141) to the third vehicle (143) is registered in the wearable device (101), the wearable device (101) can identify all of the first vehicle (141) to the third vehicle (143) based on the authentication of the advertisement packets. The embodiment is not limited thereto, and the authentication of the wearable device (101) can be performed based on whether the vehicle that transmitted the advertisement packet (e.g., the first vehicle (141) to the third vehicle (143)) is included in the FoV (120) of the camera.

[0117] In response to authentication of advertisement packets of the first vehicle (141) to the third vehicle (143), the wearable device (101) can search for the first vehicle (141) to the third vehicle (143) using a camera (e.g., the camera (225) and / or the external camera (225-2) of FIG. 2). The wearable device (101) can search for the first vehicle (141) to the third vehicle (143) based on model information (e.g., information including the model names of the first vehicle (141) to the third vehicle (143)) stored in a memory (e.g., the memory (215) of FIG. 2). The wearable device (101) can search for the first vehicle (141) to the third vehicle (143) by performing object recognition on images and / or videos acquired from the camera. For example, the wearable device (101) can identify whether each of the first vehicle (141) to the third vehicle (143) corresponds to an image and / or video acquired from a camera.

[0118] In the exemplary state (601) of FIG. 6A, when a second vehicle (142) and a third vehicle (143) are included in the FoV (120) of the wearable device (101), the wearable device (101) can identify the second vehicle (142) and the third vehicle (143) from images and / or videos corresponding to the FoV (120). The wearable device (101) can identify a vehicle from an image and / or video based on the shape of the vehicle (e.g., the front, side, and / or rear of the vehicle, and / or a portion of the vehicle (e.g., a license plate)) captured in the image and / or video. The wearable device (101) can identify coordinates and / or positions of a plurality of pixels associated with the vehicle among the pixels of the image and / or video. The wearable device (101) can obtain information representing a portion of the image and / or video in which the vehicle is captured. The wearable device (101) can identify a visual object (152) corresponding to a second vehicle (142) within the image and / or video.

[0119] When the wearable device (101) displays a screen (130) including images and / or videos acquired from a camera based on VST, a user (110) wearing the wearable device (101) can recognize a second vehicle (142) located in front of the user (110) based on a visual object (152). Similarly, the user (110) wearing the wearable device (101) can recognize a third vehicle (143) located in front of the user (110) based on a visual object (153). The wearable device (101) can identify a location and / or distance of the second vehicle (142) with respect to the wearable device (101) based on a location and / or size of the visual object (152) (e.g., width, height, aspect ratio and / or area of ​​a bounding box (610) enclosing the visual object (152)).

[0120] Using a camera, the wearable device (101) that has identified the second vehicle (142) and the third vehicle (143) can perform secure positioning on each of the second vehicle (142) and the third vehicle (143). Based on the secure positioning, the wearable device (101) can identify the positional relationship between the second vehicle (142) and the wearable device (101) and / or the positional relationship between the third vehicle (143) and the wearable device (101) using a UWB communication circuit (e.g., the UWB communication circuit (235-2) of FIG. 2). In a state (601) in which advertisement packets are received from the first vehicle (141) to the third vehicle (143), the wearable device (101) can selectively perform secure positioning for the second vehicle (142) and the third vehicle (143) included in the FoV (120), thereby omitting the secure positioning for the first vehicle (141). Referring to FIG. 6A, the wearable device (101) can determine, among the first vehicle (141) to the third vehicle (143), the second vehicle (142) and the third vehicle (143) included in the FoV (120) as objects of interest of the user (110). The wearable device (101) can preferentially perform secure positioning for the objects of interest, thereby omitting the secure positioning for an external electronic device (e.g., the first vehicle (141)) that is not the object of interest. Based on the omission of the above security positioning, the wearable device (101) can reduce power consumption.

[0121] Referring to FIG. 6A, the wearable device (101) that has identified the second vehicle (142) within the FoV (120) may display an indicator (620) having a position linked to a visual object (152) corresponding to the second vehicle (142) within the screen (130). The indicator (620) may include text indicating that authentication of the second vehicle (142) based on the advertisement packet has been completed, such as “Ready” (or “welcome”). Although not shown, the wearable device (101) may display an indicator indicating that authentication of the third vehicle (143) has been completed within the screen (130) at a position adjacent to a visual object (153) corresponding to the third vehicle (143) within the FoV (120).

[0122] Referring to FIG. 6A, in an exemplary state (601) of performing secure positioning for a second vehicle (142) and a third vehicle (143), the wearable device (101) may not establish, suspend, and / or unlink or disconnect a communication link (e.g., the communication link of operation (420) of FIG. 4) with a first vehicle (141) located away from the FoV (120). For example, if the first vehicle (141) is not identified within the FoV (120) for a specified period of time, the wearable device (101) may not establish or disconnect a communication link with the first vehicle (141). The embodiment is not limited thereto, and the wearable device (101) may make the priority of the first vehicle (141) lower than that of the second vehicle (142) to the third vehicle (143). Alternatively, the wearable device (101) may make the priority of the second vehicle (142) and / or the third vehicle (143) included in the FoV (120) higher than the priority of the first vehicle (141). Based on the priority, the wearable device (101) may selectively establish a communication link to any one of the first vehicle (141) to the third vehicle (143). The priority may be used for preferential connection of the communication link when the number of communication links of the wearable device (101) is greater than or equal to the connection limit.

[0123] In one embodiment, the wearable device (101) may establish communication links based on BLE with all vehicles corresponding to the advertisement packets in response to authentication of the advertisement packets. After establishing the communication links, the wearable device (101) may determine whether to maintain each of the communication links based on whether each of the vehicles is included in the FoV (120). For example, the communication links of the second vehicle (142) to the third vehicle (143) included in the FoV (120) may be maintained, and the communication link of the first vehicle (141) located away from the FoV (120) may be released. For example, the wearable device (101) may release the communication link established with the first vehicle (141) if the first vehicle (141) does not enter the FoV (120) for a specified period of time. Based on the release of the communication link between the first vehicle (141) and the wearable device (101), the wearable device (101) may stop secure positioning of the first vehicle (141).

[0124] In one embodiment, the wearable device (101) can change the cycle for performing secure positioning based on whether each vehicle is included in the FoV (120). For example, the wearable device (101) can perform secure positioning for a second vehicle (142) included in the FoV (120) based on a first cycle, and can perform secure positioning for a first vehicle (141) located away from the FoV (120) based on a second cycle that is longer than the first cycle.

[0125] In a state (601) in which secure positioning is performed for the second vehicle (141) and the third vehicle (143), the wearable device (101) can identify a motion moving from a point (p1) to a point (p2). For example, when a user (110) wearing the wearable device (101) walks from a point (p1) to a point (p2) adjacent to the second vehicle (142), the wearable device (101) can identify the current point (p2) of the wearable device (101) using a sensor (e.g., sensor (230) of FIG. 2). Referring to FIG. 6B, a state (602) of the wearable device (101) moving to a point (p2) is illustrated.

[0126] In one embodiment, the wearable device (101) may monitor the distance between the wearable device (101) and an external electronic device (140) identified based on UWB and / or a camera. During a transition from state (601) of FIG. 6A to state (602) of FIG. 6B, the wearable device (101) may identify an increase in the position and / or size of a visual object (152) corresponding to the second vehicle (142) in the image and / or video acquired from the camera. Based on the change in the position and / or size of the second vehicle (142) in the image and / or video, the wearable device (101) may determine that the distance between the second vehicle (142) and the wearable device (101) has decreased.

[0127] The wearable device (101), which identifies an increase in a visual object (152) corresponding to a second vehicle (142) within an image and / or video, can obtain information indicating a positional relationship between the wearable device (101) and the second vehicle (142) using a UWB communication circuit (e.g., a UWB communication circuit (235-2) of FIG. 2). While switching from a state (601) of FIG. 6A to a state (602) of FIG. 6B, the wearable device (101) can identify a decrease in the distance between the wearable device (101) and the second vehicle (142) using the UWB communication circuit. The wearable device (101), which has identified that the distance between the wearable device (101) and the second vehicle (142) has decreased, can transmit a packet (e.g., a wake-up packet such as Device Ranging Intent SubEvent(HIGH_APPROACH_CONFIDENCE)) to the second vehicle (142) through a communication link established based on BLE to notify the approach of the wearable device (101).

[0128] Referring to FIG. 6B, when the distance between the wearable device (101) and the second vehicle (142) is reduced to less than a specified distance at which a specific function provided by the second vehicle (142) can be executed, the wearable device (101) can display a visual object (630) for executing the specific function within the screen (130). When the wearable device (101) has established a communication link based on BLE with other vehicles different from the second vehicle (142), the wearable device (101) that identifies that the distance between the second vehicle (142) and the wearable device (101) is reduced to less than a specified distance can release the communication link established with the other vehicles. Based on the release of the communication link, the wearable device (101) can reduce the communication complexity based on BLE.

[0129] For example, the specific function may include a function for unlocking a door of a second vehicle (142). The wearable device (101) may display a visual object (630) for executing the function at a point within the screen (130) adjacent to a visual object (152) corresponding to the second vehicle (142). In response to an input indicating selection of the visual object (630), the wearable device (101) may transmit a packet to the second vehicle (142) for executing the function mapped to the visual object (630). The packet may be transmitted via a communication link established based on BLE. The input may be identified based on a gaze of a user (110) wearing the wearable device (101) (e.g., a gaze directed toward the visual object (630)), a hand gesture of the user (110), and / or a utterance of the user (110) (e.g., “Open the door”).

[0130] Referring to FIG. 6B, while moving from state (601) to state (602), the distance between the wearable device (101) and the first vehicle (141) may change. Based on the change in the distance, the wearable device (101) may change the priority of the first vehicle (141). For example, the wearable device (101) that identifies that the distance between the wearable device (101) and the first vehicle (141) has increased may change the priority of the first vehicle (141) to a lower priority than the priority of another vehicle (e.g., the second vehicle (142)). For example, the wearable device (101) that identifies that the distance between the wearable device (101) and the first vehicle (141) has decreased may change the priority of the first vehicle (141) to a higher priority than the priority of the other vehicle. Based on the changed priority, the wearable device (101) may release the communication link established based on BLE with the first vehicle (141), change the cycle for performing secure positioning, or at least temporarily suspend communication with the first vehicle (141).

[0131] FIGS. 7A and 7B illustrate an example of an operation of a wearable device (101) based on a positional relationship with respect to an external electronic device. The wearable device (101) of FIGS. 1 and 2 and / or the processor (210) of FIG. 2 may perform the operations described with reference to FIGS. 7A and / or 7B . Referring to FIGS. 7A and / or 7B , an exemplary state (701) of the wearable device (101) at a point (p1) adjacent to external electronic devices such as a first vehicle (711), a second vehicle (712), and a third vehicle (713) is illustrated.

[0132] In the exemplary state (701) of FIG. 7A, the wearable device (101) can receive advertisement packets from each of the first vehicle (711) to the third vehicle (713). The advertisement packets can be received via a BLE communication circuit (e.g., the BLE communication circuit (235-1) of FIG. 2). If authentication information for the first vehicle (711) and the second vehicle (712) among the first vehicle (711) to the third vehicle (713) is stored in the wearable device (101), the wearable device (101) can perform authentication on the advertisement packets transmitted from the first vehicle (711) and the second vehicle (712).

[0133] In response to the above authentication, the wearable device (101) can search for the first vehicle (711) and the second vehicle (712) within the FoV (120) using a camera (e.g., the camera (225) and / or the external camera (225-2) of FIG. 2). The wearable device (101) can store information (e.g., model information) for searching for the first vehicle (711) and the second vehicle (712) together with authentication information of the first vehicle (711) and the second vehicle (712). While displaying a screen (130) including an image and / or a video acquired from the camera based on the VST, the wearable device (101) can identify portions related to the first vehicle (711) and the second vehicle (712) within the image and / or the video. Based on the location and / or size of parts associated with the first vehicle (711) and the second vehicle (712) within the image and / or video, the wearable device (101) can determine whether to perform secure positioning of the first vehicle (711) and the second vehicle (712).

[0134] In the exemplary state (701) of FIG. 7A, when a visual object (721) corresponding to a first vehicle (711) and a visual object (722) corresponding to a second vehicle (712) are identified in an image acquired from a camera, the wearable device (101) may perform secure positioning on the first vehicle (711) and the second vehicle (712). The secure positioning may be performed based on a UWB communication circuit included in the wearable device (101) (e.g., the UWB communication circuit (235-2) of FIG. 2). For example, the wearable device (101) that has identified a visual object (721) corresponding to the first vehicle (711) may switch the state of the UWB communication circuit from an inactive state to an active state. Based on the above-described active UWB communication circuit, the wearable device (101) can perform the operation described with reference to FIG. 5 with respect to the first vehicle (711) to obtain information indicating the positional relationship between the wearable device (101) and the first vehicle (711).

[0135] Within the exemplary state (701) of FIG. 7A, the wearable device (101) that has identified the visual objects (721, 722) may display indicators (731, 732) indicating completion of authentication for the first vehicle (711) and the second vehicle (712), respectively, at points within the screen (130) adjacent to the visual objects (721, 722) (or points within the screen (130) where the first vehicle (711) and the second vehicle (712) are visible). The indicators (731, 732) of FIG. 7A may correspond to the indicator (620) of FIG. 6A. For the visual object (723) within the screen (130) corresponding to the unauthenticated third vehicle (713), the wearable device (101) may not display any indicator.

[0136] In a state (701) where a user (110) wearing a wearable device (101) is standing facing a direction (d1), the wearable device (101) can perform secure positioning of a first vehicle (711) and a second vehicle (712) included in the FoV (120). In the state (701), when the user (110) standing at a point (p1) turns toward a direction (d2) opposite to the direction (d1), the first vehicle (711) and the second vehicle (712) may disappear from the image and / or video acquired from the camera because the camera of the wearable device (101) faces the direction (d2). A wearable device (101) that fails to identify the first vehicle (711) and the second vehicle (712) within the images and / or videos acquired from the camera may increase the frequency of performing secure positioning for the first vehicle (711) and the second vehicle (712), and / or decrease the frequency of performing secure positioning.

[0137] Although the operation of the wearable device (101) for performing secure positioning of the first vehicle (711) and the second vehicle (712) based on the direction (d1) toward the first vehicle (711) and the second vehicle (712) in which the authentication information is registered has been described, the embodiment is not limited thereto. For example, the wearable device (101) may perform the secure positioning based on identifying the motion of the wearable device (101) moving toward the first vehicle (711) and / or the second vehicle (712) based on an acceleration sensor (e.g., an IMU).

[0138] For example, if the user (110) simply gazes at the first vehicle (711) and does not move toward the first vehicle (711), the wearable device (101) may stop activating the UWB communication circuitry to perform secure positioning for the first vehicle (711), change the frequency at which secure positioning is performed, or postpone it. In the above example, the wearable device (101) may activate the UWB communication circuitry based on identifying that the user (110) is moving toward the first vehicle (711). In the above example, the wearable device (101) that identifies that the user (110) is moving toward the first vehicle (711) may transmit a wake-up packet (e.g., device ranging intent subevent(HIGH_APPROACH_CONFIDENCE)) to the first vehicle (711) to notify the user (110) of the approach. The first vehicle (711) that receives the wake-up packet may switch to a mode for secure positioning. For example, the first vehicle (711) in low power mode may switch to a designated mode for secure positioning based on UWB in response to the wake-up packet.

[0139] Referring to FIG. 7B, a state (702) in which the user (110) rotates toward the direction (d2) is illustrated. After the state (701) of FIG. 7A, the wearable device (101), which has identified that the state (702) has been switched due to the rotation of the user (110), can identify that the first vehicle (711) has moved out of the FoV (740). As the first vehicle (711) moves out of the FoV (740), the first vehicle (711) may disappear from the screen (750), or a visual object (721) corresponding to the first vehicle (711) may move out of the screen (750). The wearable device (101) that has identified the first vehicle (711) that has moved out of the FoV (740) may temporarily stop performing secure positioning on the first vehicle (711), increase the cycle for performing the secure positioning, or reduce the frequency for performing the secure positioning.

[0140] After state (702), when the first vehicle (711) moves back into the FoV (740), the wearable device (101) can resume secure positioning for the first vehicle (711), reduce the cycle of performing the secure positioning, or increase the frequency of performing the secure positioning.

[0141] Although the operation of the wearable device (101) based on the direction of the user's (110) head has been described, the embodiment is not limited thereto. For example, the wearable device (101) may perform secure positioning of the first vehicle (711) and the second vehicle (712) or adjust the cycle of the secure positioning based on the direction of the gaze of the user (110) wearing the wearable device (101).

[0142] FIG. 8 illustrates an example of an operation of a wearable device (101) based on a positional relationship with respect to an external electronic device. The wearable device (101) of FIGS. 1 and 2 and / or the processor (210) of FIG. 2 may perform the operation described with reference to FIG. 8. Referring to FIG. 8, an exemplary state (801) of the wearable device (101) at a point (p1) adjacent to external electronic devices such as a first vehicle (811), a second vehicle (812), and a third vehicle (813) is illustrated.

[0143] Within the exemplary state (801) of FIG. 8, the wearable device (101) can receive advertisement packets from each of the first vehicle (811) to the third vehicle (813). The wearable device (101) can perform authentication on the advertisement packets based on the operations described with reference to FIGS. 3A to 4. The wearable device (101) can identify all of the first vehicle (811) to the third vehicle (813) for which authentication based on the advertisement packets has been completed within the FoV (120) of the camera (e.g., the camera (225) and / or the external camera (225-2) of FIG. 2) of the wearable device (101), and can perform secure positioning on each of the first vehicle (811) to the third vehicle (813). The above security positioning can be performed based on a UWB communication circuit (e.g., the UWB communication circuit (235-2) of FIG. 2).

[0144] The wearable device (101) that identifies the positional relationship between an external electronic device (e.g., a first vehicle (811) to a third vehicle (813)) and the wearable device (101) based on the secure positioning can identify an angle between the external electronic device and the reference direction (e.g., the forward direction (d1)) of the wearable device (101) identified by the positional relationship. The angle can correspond to the incident angle of a wireless signal on UWB transmitted from the external electronic device. Referring to FIG. 8, the wearable device (101) can preferentially perform communication with respect to an external electronic device located within a range (830) formed based on the reference direction based on the angle.

[0145] In an exemplary state (801) of FIG. 8, the wearable device (101) can identify a second vehicle (812) included in a range (830) formed based on a reference direction among the first vehicle (811) to the third vehicle (813). The angle between the second vehicle (812) and the reference direction may be less than an angular range for distinguishing the range (830) with respect to the reference direction. The angle between the second vehicle (812) and the reference direction may be included in information indicating a positional relationship between the wearable device (101) identified based on secure positioning and the second vehicle (812). The wearable device (101) that has identified the second vehicle (812) included in the range (830) may increase the frequency of performing secure positioning on the second vehicle (812). The wearable device (101) may increase the frequency with which it performs secure positioning for other vehicles (e.g., the first vehicle (811) and / or the third vehicle (813)) different from the second vehicle (812), and / or decrease the frequency with which it performs the secure positioning.

[0146] FIG. 9 illustrates an example of a user interface (UI) provided by a wearable device (101) communicating with an external electronic device. The wearable device (101) of FIGS. 1 and 2 and / or the processor (210) of FIG. 2 may perform the operations described with reference to FIG. 9. Referring to FIG. 9, an exemplary state (901) of the wearable device (101) at a point (p1) adjacent to an external electronic device, such as a vehicle (910), is illustrated.

[0147] Referring to FIG. 9, within a range (932) capable of receiving an advertisement packet transmitted from a vehicle (910), a wearable device (101) can authenticate the vehicle (910) based on the advertisement packet. The range (932) is illustrated as having a shape of a circle formed around a point (p2) of the vehicle (910) and having a radius r2, but the shape and / or size of the range (932) may vary depending on the wireless communication environment. The wearable device (101) that has identified authentication information corresponding to the vehicle (910) can perform authentication on the advertisement packet based on the authentication information.

[0148] Based on the authentication of the advertisement packet transmitted from the vehicle (910), the wearable device (101) can search for the vehicle (910) within the FoV of the camera. The wearable device (101) that identifies a visual object (912) corresponding to the vehicle (910) within the image and / or video acquired from the camera can perform secure positioning of the vehicle (910). The secure positioning can be performed by activating the UWB communication circuit of the wearable device (101) (e.g., the UWB communication circuit (235-2) of FIG. 2).

[0149] Referring to FIG. 9, the wearable device (101) can execute different functions for remotely controlling the vehicle (910) based on the distance between the vehicle (910) and the wearable device (101). For example, within a range (931) smaller than the range (932) (e.g., a range (931) having a shape of a circle formed around the point (p2) and having a radius r1 less than r2), the wearable device (101) can execute a function for unlocking the vehicle (910). The function can be executed in response to a user input identified by the wearable device (101). The embodiment is not limited thereto, and the wearable device (101) can execute the function based on the location of another user (920) different from the user (110) wearing the wearable device (101).

[0150] Referring to FIG. 9, an exemplary state (901) is illustrated in which a user (920) different from a user (110) wearing a wearable device (101) approaches a vehicle (910) from a point (p3). Within the state (901), the wearable device (101) can identify the user (920) approaching the vehicle (910) based on images and / or videos acquired from a camera. The wearable device (101) that has identified the user (920) can execute a function related to the vehicle (910) based on whether the user (920) is a user associated with the vehicle (910) (e.g., a user permitted to approach the vehicle (910). In a state (901) in which a user (920) approaching a vehicle (910) is identified, the user (110) can view a visual object (912) corresponding to the vehicle (910) and a visual object (922) corresponding to the user (920) through a screen (130) of a wearable device (101) that provides a user experience based on VST.

[0151] Referring to FIG. 9, the wearable device (101) that identifies a user (920) located within a range (931) capable of unlocking a vehicle (910) may display a visual object (930) for unlocking within the screen (130) based on whether the user (920) is a user associated with the vehicle (910). If the user (920) is associated with the vehicle (910) (e.g., registered as a family member of the user (110) wearing the wearable device (101) and / or previously registered as a user of the vehicle (910), the wearable device (101) may display the visual object (930). Although a visual object (930) for unlocking the vehicle (910) (e.g., a visual object (930) including text such as “Door unlock”) is illustrated as an example, the embodiment is not limited thereto. In response to an input indicating selection of a visual object (930), the wearable device (101) may transmit a wireless signal to the vehicle (910) to unlock the vehicle (910). The wireless signal may be transmitted via a communication link established based on operation (420) of FIG. 4.

[0152] FIG. 10 illustrates an example flowchart of a wearable device according to one embodiment. The wearable device (101) of FIGS. 1 and 2 and / or the processor (210) of FIG. 2 may perform the operations described with reference to FIG. 10. At least one of the operations of FIG. 10 may be related to the operations of FIGS. 3A to 5.

[0153] Referring to FIG. 10, in operation (1010), a processor of a wearable device according to an embodiment may receive advertisement packets using a BLE communication circuit (e.g., the BLE communication circuit 235-1 of FIG. 2). The advertisement packets of operation (1010) may include the advertisement packet (410) of FIG. 4. Based on operation (1010), the processor may receive advertisement packets periodically transmitted from an external electronic device (e.g., the external electronic device (140) of FIG. 1) adjacent to the wearable device. When a plurality of external electronic devices are adjacent to the wearable device, the processor may receive advertisement packets of the plurality of external electronic devices based on operation (1010).

[0154] Referring to FIG. 10, in operation 1020, a processor of a wearable device according to an embodiment may obtain information related to external electronic devices that have transmitted advertisement packets based on authentication of advertisement packets. The authentication of operation 1020 may be performed based on operation 320 of FIG. 3A and / or operations of FIG. 4. Based on authentication of advertisement packets, the processor that has identified the authenticated external electronic device may obtain information used to search for the external electronic device using a camera. The information may include data regarding the type of the external electronic device (e.g., in the case of a vehicle, the model name of the vehicle) and / or the appearance of the external electronic device.

[0155] Referring to FIG. 10, in operation (1030), a processor of a wearable device according to an embodiment may activate a UWB communication circuit (e.g., a UWB communication circuit (235-2) of FIG. 2) based on identifying at least one external electronic device matching the acquired information using a camera. The camera of operation (1030) may include a camera positioned toward the front of the wearable device, such as the external camera (225-2) of FIG. 2. The processor may determine whether to activate the UWB communication circuit based on a size and / or location of a portion associated with the external electronic device within an image identified using the camera. For example, if the size of the portion exceeds a specified size or the location is less than a specified distance from the center of the image, the processor may activate the UWB communication circuit to perform secure positioning of the external electronic device.

[0156] Referring to FIG. 10 , in operation 1040, a processor of a wearable device according to an embodiment may obtain information indicating a positional relationship between at least one external electronic device and the wearable device using an activated UWB communication circuit. The positional relationship of operation 1040 may be obtained based on the secure positioning described with reference to FIG. 5 . The positional relationship may include at least one of a distance between the wearable device and the external electronic device, an angle, a direction, and / or an azimuth of the external electronic device with respect to the wearable device. Based on the information, the processor may display a UI (e.g., a UI including a visual object 630 of FIG. 6B , a visual object 930 of FIG. 9 ) for activating and / or executing a function for remotely controlling the at least one external electronic device.

[0157] As described above, instead of performing secure positioning with all external electronic devices corresponding to all of the authenticated advertisement packets, the processor can selectively perform secure positioning with at least one external electronic device identified using the camera. By selectively performing secure positioning, the processor can reduce the period of time during which the UWB communication circuit is activated for the secure positioning, and reduce the power consumption of the UWB communication circuit. Based on the reduction in power consumption, a wearable device including a battery can operate independently using the battery for a longer period of time.

[0158] Hereinafter, exemplary appearances of wearable devices described with reference to FIGS. 1 to 10 are illustrated with reference to FIGS. 11A, 11B, 12A and / or 12B. The wearable device (1100) of FIG. 11A and / or 11B and / or the wearable device (1200) of FIG. 12A and / or 12B may be an example of the wearable device (101) of FIG. 1.

[0159] FIG. 11A illustrates an example of a perspective view of a wearable device according to one embodiment. According to one embodiment, the wearable device (1100) may have the form of glasses that are wearable on a body part of a user (e.g., the head). The wearable device (1100) may include a head-mounted display (HMD). For example, the housing of the wearable device (1100) may include a flexible material, such as rubber and / or silicone, that is configured to fit closely to a portion of the user's head (e.g., a portion of the face surrounding both eyes). For example, the housing of the wearable device (1100) may include one or more straps that are capable of being twined around the user's head, and / or one or more temples that are detachably attachable to the ears of the head.

[0160] Referring to FIG. 11A, according to one embodiment, a wearable device (1100) may include at least one display (1150) and a frame (1100) supporting at least one display (1150).

[0161] According to one embodiment, a wearable device (1100) can be worn on a part of a user's body. The wearable device (1100) can provide augmented reality (AR), virtual reality (VR), or mixed reality (MR) that combines augmented reality and virtual reality to a user wearing the wearable device (1100). For example, the wearable device (1100) can display a virtual reality image provided from at least one optical device (1182, 1184) of FIG. 11B on at least one display (1150) in response to a user's designated gesture acquired through the motion recognition cameras (1160-2, 1160-3) of FIG. 11B.

[0162] According to one embodiment, at least one display (1150) may provide visual information to a user. For example, at least one display (1150) may include a transparent or translucent lens. At least one display (1150) may include a first display (1150-1) and / or a second display (1150-2) spaced apart from the first display (1150-1). For example, the first display (1150-1) and the second display (1150-2) may be positioned at positions corresponding to the user's left and right eyes, respectively.

[0163] Referring to FIG. 11B, at least one display (1150) can provide a user with visual information transmitted from external light and other visual information distinct from the visual information through a lens included in the at least one display (1150). The lens can be formed based on at least one of a Fresnel lens, a pancake lens, or a multi-channel lens. For example, the at least one display (1150) can include a first surface (1131) and a second surface (1132) opposite the first surface (1131). A display area can be formed on the second surface (1132) of the at least one display (1150). When a user wears the wearable device (1100), external light can be transmitted to the user by being incident on the first surface (1131) and transmitted through the second surface (1132). As another example, at least one display (1150) can display an augmented reality image combined with a virtual reality image provided from at least one optical device (1182, 1184) on a real screen transmitted through external light, in a display area formed on the second surface (1132).

[0164] In one embodiment, at least one display (1150) may include at least one waveguide (1133, 1134) that diffracts light emitted from at least one optical device (1182, 1184) and transmits the diffracted light to a user. The at least one waveguide (1133, 1134) may be formed based on at least one of glass, plastic, or polymer. A nano-pattern may be formed on at least a portion of the exterior or interior of the at least one waveguide (1133, 1134). The nano-pattern may be formed based on a grating structure having a polygonal and / or curved shape. Light incident on one end of the at least one waveguide (1133, 1134) may be propagated to the other end of the at least one waveguide (1133, 1134) by the nano-pattern. At least one waveguide (1133, 1134) may include at least one diffractive element (e.g., a diffractive optical element (DOE), a holographic optical element (HOE)) and at least one reflective element (e.g., a reflective mirror). For example, at least one waveguide (1133, 1134) may be arranged within the wearable device (1100) to guide a screen displayed by at least one display (1150) to the user's eyes. For example, the screen may be transmitted to the user's eyes based on total internal reflection (TIR) ​​occurring within the at least one waveguide (1133, 1134).

[0165] The wearable device (1100) can analyze an object included in a real image collected through a shooting camera (1160-4), combine a virtual object corresponding to an object to be provided with augmented reality among the analyzed objects, and display the virtual object on at least one display (1150). The virtual object can include at least one of text and an image regarding various information related to the object included in the real image. The wearable device (1100) can analyze the object based on a multi-camera such as a stereo camera. For the object analysis, the wearable device (1100) can perform spatial recognition (e.g., simultaneous localization and mapping (SLAM)) using the multi-camera and / or time-of-flight (ToF). A user wearing the wearable device (1100) can view an image displayed on at least one display (1150).

[0166] According to one embodiment, the frame (1100) may be configured as a physical structure that allows the wearable device (1100) to be worn on the user's body. According to one embodiment, the frame (1100) may be configured so that, when the user wears the wearable device (1100), the first display (1150-1) and the second display (1150-2) can be positioned corresponding to the user's left and right eyes. The frame (1100) may support at least one display (1150). For example, the frame (1100) may support the first display (1150-1) and the second display (1150-2) to be positioned corresponding to the user's left and right eyes.

[0167] Referring to FIG. 11A, the frame (1100) may include a region (1120) that at least partially contacts a part of the user's body when the user wears the wearable device (1100). For example, the region (1120) of the frame (1100) that contacts a part of the user's body may include a region that contacts a part of the user's nose, a part of the user's ear, and a part of the side of the user's face that the wearable device (1100) makes contact with. According to one embodiment, the frame (1100) may include a nose pad (1110) that contacts a part of the user's body. When the wearable device (1100) is worn by the user, the nose pad (1110) may contact a part of the user's nose. The frame (1100) may include a first temple (1104) and a second temple (1105) that contact another part of the user's body that is distinct from the part of the user's body.

[0168] For example, the frame (1100) may include a first rim (1101) that surrounds at least a portion of the first display (1150-1), a second rim (1102) that surrounds at least a portion of the second display (1150-2), a bridge (1103) that is disposed between the first rim (1101) and the second rim (1102), a first pad (1111) that is disposed along a portion of the edge of the first rim (1101) from one end of the bridge (1103), a second pad (1112) that is disposed along a portion of the edge of the second rim (1102) from the other end of the bridge (1103), a first temple (1104) that extends from the first rim (1101) and is fixed to a portion of the wearer's ear, and a second temple (1105) that extends from the second rim (1102) and is fixed to a portion of the ear opposite the ear. There are. The first pad (1111) and the second pad (1112) can be in contact with a part of the user's nose, and the first temple (1104) and the second temple (1105) can be in contact with a part of the user's face and a part of the user's ear. The temples (1104, 1105) can be rotatably connected to the rim through the hinge units (1106, 1107) of FIG. 11B. The first temple (1104) can be rotatably connected to the first rim (1101) through the first hinge unit (1106) disposed between the first rim (1101) and the first temple (1104). The second temple (1105) can be rotatably connected to the second rim (1102) via a second hinge unit (1107) disposed between the second rim (1102) and the second temple (1105). In one embodiment, the wearable device (1100) can identify an external object (e.g., a user's fingertip) touching the frame (1100) and / or a gesture performed by the external object by using a touch sensor, a grip sensor, and / or a proximity sensor formed on at least a portion of a surface of the frame (1100).

[0169] According to one embodiment, the wearable device (1100) may include hardwares (e.g., hardwares described above based on the block diagram of FIG. 2) that perform various functions. For example, the hardwares may include a battery module (1170), an antenna module (1175), at least one optical device (1182, 1184), speakers (e.g., speakers 1155-1, 1155-2), a microphone (e.g., microphones 1165-1, 1165-2, 1165-3), a light-emitting module, and / or a printed circuit board (PCB) (1190) (e.g., a printed circuit board). The various hardwares may be arranged within the frame (1100).

[0170] According to one embodiment, microphones (e.g., microphones 1165-1, 1165-2, 1165-3) of the wearable device (1100) may be disposed on at least a portion of the frame (1100) to acquire sound signals. A first microphone (1165-1) disposed on the bridge (1103), a second microphone (1165-2) disposed on the second rim (1102), and a third microphone (1165-3) disposed on the first rim (1101) are illustrated in FIG. 11B , but the number and arrangement of the microphones (1165) are not limited to the embodiment of FIG. 11B . When the number of microphones (1165) included in the wearable device (1100) is two or more, the wearable device (1100) can identify the direction of a sound signal by using a plurality of microphones arranged on different parts of the frame (1100).

[0171] According to one embodiment, at least one optical device (1182, 1184) may project a virtual object onto at least one display (1150) to provide various image information to a user. For example, at least one optical device (1182, 1184) may be a projector. At least one optical device (1182, 1184) may be disposed adjacent to at least one display (1150) or may be included within at least one display (1150) as a part of at least one display (1150). According to one embodiment, the wearable device (1100) may include a first optical device (1182) corresponding to a first display (1150-1) and a second optical device (1184) corresponding to a second display (1150-2). For example, at least one optical device (1182, 1184) may include a first optical device (1182) disposed at an edge of a first display (1150-1) and a second optical device (1184) disposed at an edge of a second display (1150-2). The first optical device (1182) may transmit light to a first waveguide (1133) disposed on the first display (1150-1), and the second optical device (1184) may transmit light to a second waveguide (1134) disposed on the second display (1150-2).

[0172] In one embodiment, the camera (1160) may include a recording camera (1160-4), an eye tracking camera (ET CAM) (1160-1), and / or a motion recognition camera (1160-2, 1160-3). The recording camera (1160-4), the eye tracking camera (1160-1), and the motion recognition cameras (1160-2, 1160-3) may be positioned at different locations on the frame (1100) and may perform different functions. The eye tracking camera (1160-1) may output data indicating the position or gaze of the eyes of a user wearing the wearable device (1100). For example, the wearable device (1100) may detect the gaze from an image including the user's pupils obtained through the eye tracking camera (1160-1).

[0173] The wearable device (1100) can identify an object (e.g., a real object and / or a virtual object) focused on by the user using the user's gaze acquired through the gaze tracking camera (1160-1). The wearable device (1100) that has identified the focused object can execute a function (e.g., gaze interaction) for interaction between the user and the focused object. The wearable device (1100) can express a part corresponding to the eye of an avatar representing the user in a virtual space using the user's gaze acquired through the gaze tracking camera (1160-1). The wearable device (1100) can render an image (or screen) displayed on at least one display (1150) based on the position of the user's eyes.

[0174] For example, the visual quality of a first region related to the gaze within an image and the visual quality (e.g., resolution, brightness, saturation, grayscale, PPI) of a second region distinct from the first region may be different from each other. The wearable device (1100) may obtain an image having the visual quality of the first region matching the user's gaze and the visual quality of the second region using foveated rendering. For example, if the wearable device (1100) supports an iris recognition function, user authentication may be performed based on iris information obtained using the gaze tracking camera (1160-1). Although an example in which the gaze tracking camera (1160-1) is positioned toward the user's right eye is illustrated in FIG. 11B, the embodiment is not limited thereto, and the gaze tracking camera (1160-1) may be positioned solely toward the user's left eye, or toward both eyes.

[0175] In one embodiment, the capturing camera (1160-4) can capture an actual image or background to be aligned with a virtual image to implement augmented reality or mixed reality content. The capturing camera (1160-4) can be used to obtain a high-resolution image based on HR (high resolution) or PV (photo video). The capturing camera (1160-4) can capture an image of a specific object existing at a location viewed by the user and provide the image to at least one display (1150). The at least one display (1150) can display a single image in which information about an actual image or background including an image of the specific object obtained using the capturing camera (1160-4) and a virtual image provided through at least one optical device (1182, 1184) are superimposed. The wearable device (1100) can compensate for depth information (e.g., the distance between the wearable device (1100) and an external object acquired through a depth sensor) using an image acquired through the capture camera (1160-4). The wearable device (1100) can perform object recognition using an image acquired using the capture camera (1160-4). The wearable device (1100) can perform a function of focusing on an object (or subject) in an image (e.g., auto focus) and / or an optical image stabilization (OIS) function (e.g., anti-shake function) using the capture camera (1160-4). The wearable device (1100) can perform a pass-through function to display an image acquired through the capture camera (1160-4) by overlapping at least a portion of a screen representing a virtual space on at least one display (1150) while displaying the screen. In one embodiment, the shooting camera (1160-4) may be positioned on a bridge (1103) disposed between the first rim (1101) and the second rim (1102).

[0176] The gaze tracking camera (1160-1) can implement more realistic augmented reality by tracking the gaze of a user wearing a wearable device (1100) and matching the user's gaze with visual information provided to at least one display (1150). For example, when the wearable device (1100) looks straight ahead, the wearable device (1100) can naturally display environmental information related to the user's front at a location where the user is located on at least one display (1150). The gaze tracking camera (1160-1) can be configured to capture an image of the user's pupil to determine the user's gaze. For example, the gaze tracking camera (1160-1) can receive gaze detection light reflected from the user's pupil and track the user's gaze based on the position and movement of the received gaze detection light. In one embodiment, the gaze tracking camera (1160-1) can be positioned at positions corresponding to the user's left and right eyes. For example, the gaze tracking camera (1160-1) may be positioned within the first rim (1101) and / or the second rim (1102) to face the direction in which the user wearing the wearable device (1100) is positioned.

[0177] The gesture recognition camera (1160-2, 1160-3) can recognize the movement of the user's entire body, such as the user's torso, hand, or face, or a part of the body, and thereby provide a specific event on a screen provided on at least one display (1150). The gesture recognition camera (1160-2, 1160-3) can recognize the user's gesture (gesture recognition), obtain a signal corresponding to the gesture, and provide a display corresponding to the signal on at least one display (1150). The processor can identify the signal corresponding to the gesture, and perform a designated function based on the identification. The gesture recognition camera (1160-2, 1160-3) can be used to perform a spatial recognition function using SLAM and / or a depth map for 6 degrees of freedom pose (6 dof pose). The processor may perform gesture recognition and / or object tracking functions using the motion recognition cameras (1160-2, 1160-3). In one embodiment, the motion recognition cameras (1160-2, 1160-3) may be positioned on the first rim (1101) and / or the second rim (1102).

[0178] The camera (1160) included in the wearable device (1100) is not limited to the above-described gaze tracking camera (1160-1) and motion recognition cameras (1160-2, 1160-3). For example, the wearable device (1100) can identify an external object included in the FoV using a camera positioned toward the user's FoV. The wearable device (1100) can identify an external object based on a sensor for identifying the distance between the wearable device (1100) and the external object, such as a depth sensor and / or a time of flight (ToF) sensor. The camera (1160) positioned toward the FoV can support an autofocus function and / or an optical image stabilization (OIS) function. For example, the wearable device (1100) may include a camera (1160) (e.g., a face tracking (FT) camera) positioned toward the face to obtain an image including the face of a user wearing the wearable device (1100).

[0179] Although not shown, in one embodiment, the wearable device (1100) may further include a light source (e.g., an LED) that emits light toward a subject (e.g., a user's eyes, face, and / or an external object within the FoV) being photographed using the camera (1160). The light source may include an LED having an infrared wavelength. The light source may be disposed on at least one of the frame (1100) and the hinge units (1106, 1107).

[0180] According to one embodiment, the battery module (1170) may supply power to electronic components of the wearable device (1100). In one embodiment, the battery module (1170) may be disposed within the first temple (1104) and / or the second temple (1105). For example, the battery module (1170) may be a plurality of battery modules (1170). The plurality of battery modules (1170) may be disposed within each of the first temple (1104) and the second temple (1105). In one embodiment, the battery module (1170) may be disposed at an end of the first temple (1104) and / or the second temple (1105).

[0181] The antenna module (1175) can transmit signals or power to the outside of the wearable device (1100), or receive signals or power from the outside. In one embodiment, the antenna module (1175) can be positioned within the first temple (1104) and / or the second temple (1105). For example, the antenna module (1175) can be positioned close to one surface of the first temple (1104) and / or the second temple (1105).

[0182] The speaker (1155) can output an audio signal to the outside of the wearable device (1100). The audio output module may be referred to as a speaker. In one embodiment, the speaker (1155) may be positioned within the first temple (1104) and / or the second temple (1105) so as to be positioned adjacent to the ear of a user wearing the wearable device (1100). For example, the speaker (1155) may include a second speaker (1155-2) positioned within the first temple (1104) and thus adjacent to the user's left ear, and a first speaker (1155-1) positioned within the second temple (1105) and thus adjacent to the user's right ear.

[0183] The light-emitting module (not shown) may include at least one light-emitting element. The light-emitting module may emit light of a color corresponding to a specific state or emit light with an action corresponding to a specific state in order to visually provide information regarding a specific state of the wearable device (1100) to the user. For example, when the wearable device (1100) requires charging, it may emit red light at a regular cycle. In one embodiment, the light-emitting module may be disposed on the first rim (1101) and / or the second rim (1102).

[0184] Referring to FIG. 11B, according to one embodiment, a wearable device (1100) may include a printed circuit board (PCB) (1190). The PCB (1190) may be included in at least one of the first temple (1104) or the second temple (1105). The PCB (1190) may include an interposer disposed between at least two sub-PCBs. One or more hardwares included in the wearable device (1100) (e.g., hardwares illustrated by different blocks in FIG. 2) may be disposed on the PCB (1190). The wearable device (1100) may include a flexible PCB (FPCB) for interconnecting the hardwares.

[0185] According to one embodiment, a wearable device (1100) may include at least one of a gyro sensor, a gravity sensor, and / or an acceleration sensor for detecting a posture of the wearable device (1100) and / or a posture of a body part (e.g., a head) of a user wearing the wearable device (1100). Each of the gravity sensor and the acceleration sensor may measure gravitational acceleration and / or acceleration based on mutually perpendicular designated three-dimensional axes (e.g., an x-axis, a y-axis, and a z-axis). The gyro sensor may measure an angular velocity of each of the designated three-dimensional axes (e.g., an x-axis, a y-axis, and a z-axis). At least one of the gravity sensor, the acceleration sensor, and the gyro sensor may be referred to as an inertial measurement unit (IMU). According to one embodiment, the wearable device (1100) may identify a user's motion and / or gesture performed to execute or terminate a specific function of the wearable device (1100) based on the IMU.

[0186] Figures 12a and 12b illustrate an example of an exterior appearance of a wearable device according to one embodiment. The wearable device (1200) of Figures 12a and 12b may include at least a portion of the hardware of the wearable device (1100) described with reference to Figures 11a and / or 11b. An example of an exterior appearance of a first side (1210) of a housing of the wearable device (1200) according to one embodiment is illustrated in Figure 12a, and an example of an exterior appearance of a second side (1220) opposite to the first side (1210) may be illustrated in Figure 12b.

[0187] Referring to FIG. 12A, a first surface (1210) of a wearable device (1200) according to one embodiment may have a form attachable to a body part of a user (e.g., the face of the user). Although not shown, the wearable device (1200) may further include a strap for fixing to a body part of a user, and / or one or more temples (e.g., the first temple (1104) and / or the second temple (1105) of FIGS. 11A and 11B). A first display (1150-1) for outputting an image to a left eye among the user's two eyes, and a second display (1150-2) for outputting an image to a right eye among the two eyes, may be disposed on the first surface (1210). The wearable device (1200) may be formed on the first surface (1210) and may further include a rubber or silicone packing to prevent interference from light (e.g., ambient light) different from the light emitted from the first display (1150-1) and the second display (1150-2).

[0188] According to one embodiment, a wearable device (1200) may include cameras (1160-1) for photographing and / or tracking both eyes of a user adjacent to each of the first display (1150-1) and the second display (1150-2). The cameras (1160-1) may be referred to as the gaze tracking camera (1160-1) of FIG. 11B. According to one embodiment, a wearable device (1200) may include cameras (1160-5, 1160-6) for photographing and / or recognizing a face of a user. The cameras (1160-5, 1160-6) may be referred to as FT cameras. The wearable device (1200) can control an avatar representing the user in a virtual space based on the facial motion of the user identified using cameras (1160-5, 1160-6). For example, the wearable device (1200) can change the texture and / or shape of a portion of the avatar (e.g., a portion of the avatar representing a human face) using information obtained by cameras (1160-5, 1160-6) (e.g., FT cameras) and representing the facial expression of the user wearing the wearable device (1200).

[0189] Referring to FIG. 12B, a camera (e.g., cameras (1160-7, 1160-8, 1160-9, 1160-10, 1160-11, 1160-12)) and / or a sensor (e.g., a depth sensor (1230)) for obtaining information related to the external environment of the wearable device (1200) may be disposed on a second surface (1220) opposite to the first surface (1210) of FIG. 12A. For example, the cameras (1160-7, 1160-8, 1160-9, 1160-10) may be disposed on the second surface (1220) to recognize external objects. The cameras (1160-7, 1160-8, 1160-9, 1160-10) of FIG. 12b can correspond to the motion recognition cameras (1160-2, 1160-3) of FIG. 11b.

[0190] For example, using cameras (1160-11, 1160-12), the wearable device (1200) can obtain images and / or videos to be transmitted to each of the user's eyes. The camera (1160-11) can be placed on the second face (1220) of the wearable device (1200) to obtain an image to be displayed through the second display (1150-2) corresponding to the right eye among the two eyes. The camera (1160-12) can be placed on the second face (1220) of the wearable device (1200) to obtain an image to be displayed through the first display (1150-1) corresponding to the left eye among the two eyes. The cameras (1160-11, 1160-12) can correspond to the shooting camera (1160-4) of FIG. 11B.

[0191] According to one embodiment, the wearable device (1200) may include a depth sensor (1230) disposed on the second face (1220) to identify a distance between the wearable device (1200) and an external object. Using the depth sensor (1230), the wearable device (1200) may obtain spatial information (e.g., a depth map) for at least a portion of the FoV of a user wearing the wearable device (1200). Although not shown, a microphone may be disposed on the second face (1220) of the wearable device (1200) to obtain a sound output from an external object. The number of microphones may be one or more, depending on the embodiment.

[0192] Hereinafter, with reference to FIG. 13, an example of a hardware configuration included in a wearable device (101) described with reference to FIGS. 1 to 10 is described.

[0193] FIG. 13 is a block diagram of an electronic device (1301) within a network environment (1300) according to various embodiments. Referring to FIG. 13 , in the network environment (1300), the electronic device (1301) may communicate with the electronic device (1302) via a first network (1398) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (1304) or the server (1308) via a second network (1399) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (1301) may communicate with the electronic device (1304) via the server (1308). According to one embodiment, the electronic device (1301) may include a processor (1320), a memory (1330), an input module (1350), an audio output module (1355), a display module (1360), an audio module (1370), a sensor module (1376), an interface (1377), a connection terminal (1378), a haptic module (1379), a camera module (1380), a power management module (1388), a battery (1389), a communication module (1390), a subscriber identification module (1396), or an antenna module (1397). In some embodiments, the electronic device (1301) may omit at least one of these components (e.g., the connection terminal (1378)), or may have one or more other components added. In some embodiments, some of these components (e.g., sensor module (1376), camera module (1380), or antenna module (1397)) may be integrated into a single component (e.g., display module (1360)).

[0194] The processor (1320) may, for example, execute software (e.g., a program (1340)) to control at least one other component (e.g., a hardware or software component) of the electronic device (1301) connected to the processor (1320) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (1320) may store commands or data received from other components (e.g., a sensor module (1376) or a communication module (1390)) in a volatile memory (1332), process the commands or data stored in the volatile memory (1332), and store result data in a non-volatile memory (1334). According to one embodiment, the processor (1320) may include a main processor (1321) (e.g., a central processing unit or an application processor) or an auxiliary processor (1323) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (1321). For example, when the electronic device (1301) includes the main processor (1321) and the auxiliary processor (1323), the auxiliary processor (1323) may be configured to use less power than the main processor (1321) or to be specialized for a given function. The auxiliary processor (1323) may be implemented separately from the main processor (1321) or as a part thereof.

[0195] The auxiliary processor (1323) may control at least a portion of functions or states associated with at least one component (e.g., the display module (1360), the sensor module (1376), or the communication module (1390)) of the electronic device (1301), for example, on behalf of the main processor (1321) while the main processor (1321) is in an inactive (e.g., sleep) state, or together with the main processor (1321) while the main processor (1321) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (1323) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (1380) or a communication module (1390)). In one embodiment, the auxiliary processor (1323) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (1301) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (1308)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0196] The memory (1330) can store various data used by at least one component (e.g., the processor (1320) or the sensor module (1376)) of the electronic device (1301). The data can include, for example, software (e.g., the program (1340)) and input data or output data for commands related thereto. The memory (1330) can include volatile memory (1332) or non-volatile memory (1334).

[0197] The program (1340) may be stored as software in memory (1330) and may include, for example, an operating system (1342), middleware (1344), or an application (1346).

[0198] The input module (1350) can receive commands or data to be used in a component of the electronic device (1301) (e.g., a processor (1320)) from an external source (e.g., a user) of the electronic device (1301). The input module (1350) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0199] The audio output module (1355) can output audio signals to the outside of the electronic device (1301). The audio output module (1355) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0200] The display module (1360) can visually provide information to an external party (e.g., a user) of the electronic device (1301). The display module (1360) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (1360) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0201] The audio module (1370) can convert sound into an electrical signal, or vice versa. According to one embodiment, the audio module (1370) can acquire sound through the input module (1350), output sound through the sound output module (1355), or an external electronic device (e.g., electronic device (1302)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (1301).

[0202] The sensor module (1376) can detect the operating status (e.g., power or temperature) of the electronic device (1301) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (1376) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0203] The interface (1377) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (1301) with an external electronic device (e.g., the electronic device (1302)). In one embodiment, the interface (1377) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0204] The connection terminal (1378) may include a connector through which the electronic device (1301) may be physically connected to an external electronic device (e.g., the electronic device (1302)). In one embodiment, the connection terminal (1378) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0205] The haptic module (1379) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (1379) may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0206] The camera module (1380) can capture still images and videos. In one embodiment, the camera module (1380) may include one or more lenses, image sensors, image signal processors, or flashes.

[0207] The power management module (1388) can manage the power supplied to the electronic device (1301). According to one embodiment, the power management module (1388) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0208] A battery (1389) may power at least one component of the electronic device (1301). In one embodiment, the battery (1389) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0209] The communication module (1390) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (1301) and an external electronic device (e.g., electronic device (1302), electronic device (1304), or server (1308)), and the performance of communication through the established communication channel. The communication module (1390) may operate independently from the processor (1320) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (1390) may include a wireless communication module (1392) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (1394) (e.g., a local area network (LAN) communication module, or a power line communication module). Any of these communication modules may communicate with an external electronic device (1304) via a first network (1398) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (1399) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a local area network or a wide area network)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (1392) may use subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (1396) to verify or authenticate the electronic device (1301) within a communication network such as the first network (1398) or the second network (1399).

[0210] The wireless communication module (1392) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency communications (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (1392) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (1392) may support various technologies for securing performance in high-frequency bands, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (1392) may support various requirements specified in the electronic device (1301), an external electronic device (e.g., the electronic device (1304)), or a network system (e.g., the second network (1399)). According to one embodiment, the wireless communication module (1392) may support a peak data rate (e.g., 20 Gbps or more) for eMBB implementation, a loss coverage (e.g., 164 dB or less) for mMTC implementation, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC implementation.

[0211] The antenna module (1397) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (1397) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (1397) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (1398) or the second network (1399), may be selected from the plurality of antennas by, for example, the communication module (1390). A signal or power may be transmitted or received between the communication module (1390) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (1397).

[0212] According to various embodiments, the antenna module (1397) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.

[0213] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0214] According to one embodiment, commands or data may be transmitted or received between the electronic device (1301) and an external electronic device (1304) via a server (1308) connected to a second network (1399). Each of the external electronic devices (1302 or 1304) may be the same or a different type of device as the electronic device (1301). According to one embodiment, all or part of the operations executed in the electronic device (1301) may be executed in one or more of the external electronic devices (1302, 1304, or 1308). For example, when the electronic device (1301) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (1301) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (1301). The electronic device (1301) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (1301) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (1304) may include an Internet of Things (IoT) device. The server (1308) may be an intelligent server utilizing machine learning and / or a neural network.According to one embodiment, an external electronic device (1304) or server (1308) may be included within the second network (1399). The electronic device (1301) may be applied to intelligent services (e.g., smart homes, smart cities, smart cars, or healthcare) based on 5G communication technology and IoT-related technology.

[0215] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0216] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0217] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0218] Various embodiments of the present document may be implemented as software (e.g., a program (1340)) including one or more instructions stored in a storage medium (e.g., an internal memory (1336) or an external memory (1338)) readable by a machine (e.g., an electronic device (1301)). For example, a processor (e.g., a processor (1320)) of the machine (e.g., an electronic device (1301)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0219] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a commodity between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0220] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0221] In one embodiment, a method for more efficiently performing secure positioning based on an UWB communication circuit may be required. As described above, according to one embodiment, a wearable device (e.g., the wearable device (101) of FIG. 1) may include at least one camera (e.g., the camera (225) of FIG. 2), a first communication circuit for Bluetooth low energy (BLE) (e.g., the BLE communication circuit (235-1) of FIG. 2), a second communication circuit for ultra-wideband (UWB) (e.g., the UWB communication circuit (235-2) of FIG. 2), and at least one processor (e.g., the processor (210) of FIG. 2). The at least one processor may be configured to receive advertisement packets (e.g., the advertisement packet (410) of FIG. 4) via the first communication circuit. The at least one processor may be configured, in response to receiving the advertisement packets, to identify vehicles (e.g., the first vehicle (141), the second vehicle (142), and / or the third vehicle (143) of FIG. 1 ) corresponding to each of the advertisement packets using the at least one camera. The at least one processor may be configured, in response to identifying at least one of the vehicles using the at least one camera, to execute a function of identifying at least one of a location or a distance of the at least one vehicle relative to the wearable device based on the second communication circuit.

[0222] For example, the at least one processor may be configured to identify at least one of the vehicles using the at least one camera disposed on the front or side of the wearable device.

[0223] For example, the at least one processor may be configured to identify the at least one vehicle corresponding to the at least one visual object (e.g., the visual objects (152, 153) of FIG. 1) identified within an image acquired from the at least one camera.

[0224] For example, the at least one processor may be configured to identify at least one of the location or distance of the at least one vehicle relative to the wearable device based on at least one of the location or size of the at least one visual object within the image.

[0225] For example, the at least one processor may be configured to display, within a state of displaying the image on the display of the wearable device, at least one indicator (e.g., indicator (620) of FIG. 6A) associated with the authentication, having a position associated with the at least one visual object.

[0226] For example, the at least one processor may be configured to perform authentication on the advertisement packets based on key information corresponding to the vehicles stored in a memory of the wearable device.

[0227] For example, the at least one processor may be configured to perform authentication on the advertisement packets by decrypting the advertisement packets based on the key information.

[0228] For example, the at least one processor may be configured to identify the key information stored in a portion of the memory corresponding to a secure element.

[0229] For example, the at least one processor may be configured to perform object recognition on an image of the at least one camera based on model information registered in the memory of the wearable device and associated with the vehicles, thereby identifying whether each of the vehicles corresponds to the image.

[0230] For example, the at least one processor may be configured to sequentially perform ranging of the vehicles based on priorities of the vehicles, based on identifying the vehicles using the at least one camera.

[0231] For example, the at least one processor may be configured to stop measuring at least one of a position or a distance of the vehicle using the second communication circuitry based on whether the vehicle identified based on the at least one camera moves out of a field-of-view (FoV) of the at least one camera.

[0232] For example, the at least one processor may be configured to resume measuring at least one of the position or the distance of the vehicle using the second communication circuit based on whether the vehicle that has moved out of the FoV re-enters the FoV.

[0233] According to one embodiment of the present invention, a method of a wearable device as described above may include receiving advertisement packets via a first communication circuit for Bluetooth low energy (BLE). The method may include, in response to receiving the advertisement packets, identifying vehicles corresponding to each of the advertisement packets using at least one camera of the wearable device. The method may include, in response to identifying at least one of the vehicles using the at least one camera, executing a function of identifying at least one of a location or a distance of the at least one vehicle relative to the wearable device based on a second communication circuit for ultra-wideband (UWB).

[0234] For example, the identifying action may include identifying at least one of the vehicles using at least one camera positioned toward the front direction of the wearable device.

[0235] For example, the identifying action may include identifying at least one vehicle corresponding to at least one visual object based on at least one visual object identified within an image acquired from the at least one camera.

[0236] For example, the identifying action may include identifying at least one of the location or distance of the at least one vehicle relative to the wearable device based on at least one of the location or size of the at least one visual object within the image.

[0237] For example, the executing action may include an action of displaying at least one indicator related to the authentication, having a position linked to the at least one visual object, within a state of displaying the image on the display of the wearable device.

[0238] For example, the identifying action may include performing authentication on the advertisement packets based on key information corresponding to the vehicles stored in the memory of the wearable device.

[0239] For example, the operation of performing the authentication may include an operation of performing authentication on the advertisement packets by decrypting the advertisement packets based on the key information.

[0240] For example, the act of performing the authentication may include an act of identifying the key information stored in a portion of the memory corresponding to a secure element.

[0241] For example, the identifying action may include an action of performing object recognition on an image of the at least one camera based on model information associated with the vehicles and registered in the memory of the wearable device, thereby identifying whether each of the vehicles corresponds to the image.

[0242] According to one embodiment of the present invention, a wearable device as described above may include at least one camera, a first communication circuit for Bluetooth low energy (BLE), a second communication circuit for ultra-wideband (UWB), and at least one processor. The at least one processor may be configured to receive an advertisement packet through the first communication circuit. The at least one processor may be configured to obtain information related to an external electronic device that has transmitted the advertisement packet based on authentication of the advertisement packet. The at least one processor may be configured to switch a state of the second communication circuit from an inactive state to an active state in response to a visual object included in an image output from the at least one camera and corresponding to the external electronic device. The visual object may be identified based on the information. The second communication circuit may be configured to identify a positional relationship between the external electronic device and the wearable device using the second communication circuit in the active state.

[0243] For example, the at least one processor may be configured to determine whether to switch the state of the second communication circuit to the active state based on at least one of a position or a size of the visual object within the image.

[0244] For example, the at least one processor may be configured to identify the visual object corresponding to the external electronic device using the at least one camera positioned toward the front direction of the wearable device.

[0245] For example, the at least one processor may be configured to perform authentication for the advertisement packet based on key information corresponding to the external electronic device, stored in a memory of the wearable device.

[0246] According to one embodiment of the present invention, a method of a wearable device as described above may include receiving an advertisement packet via a first communication circuit for Bluetooth low energy (BLE). The method may include obtaining information related to an external electronic device that transmitted the advertisement packet based on authentication of the advertisement packet. The method may include switching a state of a second communication circuit for ultra-wideband (UWB) from an inactive state to an active state in response to a visual object included in an image output from at least one camera of the wearable device and corresponding to the external electronic device. The visual object may be identified based on the information. The method may include identifying a positional relationship between the external electronic device and the wearable device using the second communication circuit in the active state.

[0247] For example, the switching operation may include an operation of determining whether to switch the state of the second communication circuit to the active state based on at least one of a position or a size of the visual object within the image.

[0248] For example, the switching action may include an action of identifying the visual object corresponding to the external electronic device using the at least one camera positioned toward the front direction of the wearable device.

[0249] For example, the acquiring operation may include an operation of performing authentication for the advertisement packet based on key information corresponding to the external electronic device, stored in a memory of the wearable device.

[0250] The devices described above may be implemented as hardware components, software components, and / or a combination of hardware components and software components. For example, the devices and components described in the embodiments may be implemented using one or more general-purpose computers or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing instructions and responding to them. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing device is sometimes described as being used alone; however, one of ordinary skill in the art will recognize that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing unit may include multiple processors, or a processor and a controller. Other processing configurations, such as parallel processors, are also possible.

[0251] Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing device to perform a desired operation or may independently or collectively command the processing device. The software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device for interpretation by the processing device or for providing instructions or data to the processing device. The software may also be distributed over networked computer systems and stored or executed in a distributed manner. The software and data may be stored on one or more computer-readable recording media.

[0252] The method according to the embodiment may be implemented in the form of program commands that can be executed through various computer means and recorded on a computer-readable medium. In this case, the medium may be one that continuously stores a computer-executable program or one that temporarily stores it for execution or download. In addition, the medium may be various recording means or storage means in the form of a single or multiple hardware combinations, and is not limited to a medium directly connected to a computer system, but may also be distributed over a network. Examples of the medium may include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and those configured to store program commands, including ROM, RAM, and flash memory. In addition, examples of other media may include recording media or storage media managed by app stores that distribute applications, sites that supply or distribute various software, servers, etc.

[0253] Although the embodiments described above have been described by way of limited examples and drawings, those skilled in the art will appreciate that various modifications and variations can be made based on the above teachings. For example, appropriate results can still be achieved even if the described techniques are performed in a different order than described, and / or components of the described systems, structures, devices, circuits, etc. are combined or combined in a different manner than described, or are replaced or substituted with other components or equivalents.

[0254] Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims described below.

Claims

1. In a wearable device (101), At least one camera (225); A first communication circuit (235-1) for BLE (bluetooth low energy); Second communication circuit for UWB (ultra-wideband) (235-2); A memory storing instructions, comprising one or more storage media; and At least one processor (210) comprising a processing circuit, The above instructions, when individually and / or collectively executed by the at least one processor, cause the wearable device to: Receive advertisement packets (410) through the first communication circuit; In response to receiving the above advertisement packets, identifying vehicles (141, 142, 143) corresponding to each of the advertisement packets using the at least one camera; and In response to identifying at least one of said vehicles using said at least one camera, cause said second communication circuit to execute a function of identifying at least one of a location or a distance of said at least one vehicle to said wearable device. Wearable devices.

2. In claim 1, the instructions, when individually and / or collectively executed by the at least one processor, cause the wearable device to: Causing at least one of the vehicles to be identified using at least one camera positioned on the front or side of the wearable device; Wearable devices.

3. In claims 1 and 2, the instructions, when individually and / or collectively executed by the at least one processor, cause the wearable device to: Identifying at least one vehicle corresponding to the at least one visual object based on at least one visual object (152, 153) identified in an image acquired from the at least one camera, Wearable devices.

4. In claims 1 to 3, the instructions, when individually and / or collectively executed by the at least one processor, cause the wearable device to: causing at least one of the position or distance of the at least one vehicle to the wearable device to be identified based on at least one of the position or size of the at least one visual object within the image; Wearable devices.

5. In claims 1 to 4, the instructions, when individually and / or collectively executed by the at least one processor, cause the wearable device to: In a state of displaying the image on the display of the wearable device, causing at least one indicator (620) related to the authentication to be displayed, having a position linked to the at least one visual object. Wearable devices.

6. In claims 1 to 5, the instructions, when individually and / or collectively executed by the at least one processor, cause the wearable device to: Causing authentication of the advertisement packets based on key information corresponding to the vehicles stored in the memory of the wearable device. Wearable devices.

7. In claims 1 to 6, the instructions, when individually and / or collectively executed by the at least one processor, cause the wearable device to: Causing authentication of the advertisement packets by performing decryption of the advertisement packets based on the above key information. Wearable devices.

8. In claims 1 to 7, the instructions, when individually and / or collectively executed by the at least one processor, cause the wearable device to: causing said key information stored in a portion of said memory corresponding to a secure element to be identified; Wearable devices.

9. In claim 1, the instructions, when individually and / or collectively executed by the at least one processor, cause the wearable device to: Registered in the memory of the wearable device, and based on model information related to the vehicles, performing object recognition on the image of the at least one camera to identify whether each of the vehicles corresponds to the image, Wearable devices.

10. In claim 1, the instructions, when individually and / or collectively executed by the at least one processor, cause the wearable device to: Based on identifying the vehicles using at least one camera, causing sequential ranging of the vehicles based on the priorities of the vehicles. Wearable devices.

11. In claim 1, the instructions, when individually and / or collectively executed by the at least one processor, cause the wearable device to: Causing the second communication circuit to stop measuring at least one of the position or distance of the vehicle based on whether the vehicle identified based on the at least one camera moves out of the field-of-view (FoV) of the at least one camera; Wearable devices.

12. In claim 11, the instructions, when individually and / or collectively executed by the at least one processor, cause the wearable device to: Causing the second communication circuit to resume measuring at least one of the position or the distance of the vehicle based on whether the vehicle that has moved out of the FoV re-enters the FoV. Wearable devices.

13. In the method of a wearable device, An operation of receiving advertisement packets through a first communication circuit for BLE (bluetooth low energy); In response to receiving the advertisement packets, an operation of identifying vehicles corresponding to each of the advertisement packets using at least one camera of the wearable device; and In response to identifying at least one of the vehicles using the at least one camera, the wearable device comprises an operation of executing a function of identifying at least one of a location or a distance of the at least one vehicle based on a second communication circuit for ultra-wideband (UWB). method.

14. In claim 13, the identifying action comprises: An operation of identifying at least one of the vehicles using at least one camera positioned toward the front direction of the wearable device, method.

15. In claims 13 to 14, the identifying action comprises: An operation of identifying at least one vehicle corresponding to at least one visual object, based on at least one visual object identified in an image acquired from at least one camera, method.

Images