Apparatus and method for providing visual information indicating security level
Patent Information
- Application Number
- PCT/KR2024/010316
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-09-07
- Filing Date
- 2024-07-17
- Publication Date
- 2025-03-13
Smart Images

Figure KR2024010316_13032025_PF_FP_ABST
Abstract
Description
Device and method for providing visual information indicating a security level
[0001] The descriptions below relate to devices and methods for providing visual information indicating a security level.
[0002] To provide an enhanced user experience, electronic devices are being developed that provide extended reality services that display computer-generated information in conjunction with external objects in the real world or virtual objects in the virtual world. The electronic devices may include wearable devices that can be worn by a user. For example, the electronic devices may include user equipment, AR glasses, VR glasses, and / or a head-mounted device (HMD) (e.g., a video see-through (VST) HMD, an optical see-through (OST) HMD).
[0003] A wearable device may include a communication circuit. The wearable device may include a memory that stores instructions and includes one or more storage media. The wearable device may include a display. The wearable device may include at least one processor that includes a processing circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the wearable device to transmit, through the communication circuit, a first signal requesting authentication information of content to the external electronic device in response to a distance between the wearable device and the external electronic device being less than a first reference distance. The instructions, when individually or collectively executed by the at least one processor, may cause the wearable device to receive, from the external electronic device, a second signal including the authentication information in response to the first signal. The instructions, when individually or collectively executed by the at least one processor, may cause the wearable device to display, through the display, a screen having a color associated with the content in a mode for displaying the content executed based on the received second signal. The instructions, when individually or collectively executed by the at least one processor, may cause the wearable device to adjust an alpha value of the color based on a change in the distance from a first distance less than the first reference distance to a second distance less than the first distance while displaying the screen having the color.The instructions, when individually or collectively executed by the at least one processor, may cause the wearable device to execute a software application for displaying the content based on the distance being less than a second reference distance that is less than the first reference distance.
[0004] A method performed by a wearable device may include an operation of transmitting, through the communication circuit, a first signal requesting authentication information of content to an external electronic device in response to a distance between the wearable device and the external electronic device being less than a first reference distance. The method may include an operation of receiving, from the external electronic device, a second signal including the authentication information in response to the first signal. The method may include an operation of displaying a screen having a color related to the content in a mode for displaying the content that is executed based on the received second signal. The method may include an operation of adjusting an alpha value of the color based on a change in the distance from a first distance less than the first reference distance to a second distance less than the first distance while displaying the screen having the color. The method may include executing a software application for displaying the content based on the distance being less than a second reference distance that is less than the first reference distance.
[0005] A non-transitory computer-readable storage medium may store one or more programs comprising instructions that, when individually or collectively executed by at least one processor of a wearable device including a communication circuit and a display, cause the wearable device to transmit, through the communication circuit, a first signal requesting authentication information of content to the external electronic device in response to a distance between the wearable device and the external electronic device being less than a first reference distance. The non-transitory computer-readable storage medium may store one or more programs comprising instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to receive, in response to the first signal, a second signal including the authentication information from the external electronic device. The non-transitory computer-readable storage medium may store one or more programs including instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to display, through the display, a screen having a color associated with the content in a mode for displaying the content executed based on the received second signal. The non-transitory computer-readable storage medium may store one or more programs including instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to adjust an alpha value of the color based on a change in the distance from a first distance less than the first reference distance to a second distance less than the first distance while displaying the screen having the color.The non-transitory computer-readable storage medium may store one or more programs comprising instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to execute a software application for displaying the content based on the distance being less than a second reference distance that is less than the first reference distance.
[0006] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.
[0007] FIG. 2A illustrates an example of a perspective view of a wearable device according to various embodiments.
[0008] FIG. 2b illustrates an example of one or more hardware elements arranged within a wearable device according to various embodiments.
[0009] FIGS. 3A and 3B illustrate examples of the appearance of a wearable device according to various embodiments.
[0010] Figures 4a and 4b illustrate examples of how to display visual information indicating a security level.
[0011] Figure 5 illustrates an exemplary block diagram of a wearable device.
[0012] FIG. 6 illustrates an example of an operational flow for a method of displaying visual information indicating a security level according to the distance between a wearable device and an external electronic device and displaying content requiring authentication.
[0013] Figures 7a and 7b illustrate examples of visual objects indicating security levels.
[0014] Figure 8 illustrates an example of a flow of operations for displaying visual information indicating a security level and executing a software application for displaying content requiring authentication.
[0015] The terms used in this disclosure are used only to describe specific embodiments and may not be intended to limit the scope of other embodiments. The singular expression may include plural expressions unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by those of ordinary skill in the art described in this disclosure. Terms defined in general dictionaries among the terms used in this disclosure may be interpreted as having the same or similar meaning in the context of the relevant technology, and shall not be interpreted in an idealized or overly formal sense unless explicitly defined in this disclosure. In some cases, even if a term is defined in this disclosure, it cannot be interpreted to exclude embodiments of the present disclosure.
[0016] The various embodiments of the present disclosure described below illustrate a hardware-based approach as an example. However, since the various embodiments of the present disclosure include techniques utilizing both hardware and software, the various embodiments of the present disclosure do not exclude a software-based approach.
[0017] In addition, in the present disclosure, expressions such as "more than" or "less than" may be used to determine whether a specific condition is satisfied or fulfilled. However, this is merely a description for expressing an example and does not exclude descriptions such as "more than" or "less than." Conditions described as "more than" may be replaced with "more than," conditions described as "less than," and conditions described as "more than and less than" may be replaced with "more than and less than." In addition, hereinafter, "A" to "B" mean at least one of the elements from A (including A) to B (including B).
[0018] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.
[0019] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).
[0020] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor)) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.
[0021] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.
[0022] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).
[0023] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0024] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0025] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.
[0026] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.
[0027] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).
[0028] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0029] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0030] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0031] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
[0032] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0033] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).
[0034] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0035] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).
[0036] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.
[0037] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).
[0038] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.
[0039] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).
[0040] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0041] FIG. 2A illustrates an example of a perspective view of a wearable device according to various embodiments. FIG. 2B illustrates an example of one or more hardware components arranged within a wearable device according to various embodiments.
[0042] According to one embodiment, the wearable device (103) may have the form of glasses that are wearable on a body part of the user (e.g., the head). The wearable device (103) of FIGS. 2A and 2B may be an example of the electronic device (101) of FIG. 1. The wearable device (103) may include a head-mounted display (HMD). For example, the housing of the wearable device (103) may include a flexible material, such as rubber and / or silicone, that is configured to fit closely to a portion of the user's head (e.g., a portion of the face surrounding both eyes). For example, the housing of the wearable device (103) may include one or more straps that are capable of being twined around the user's head, and / or one or more temples that are detachably attachable to the ears of the head.
[0043] Referring to FIG. 2A, according to one embodiment, a wearable device (103) may include at least one display (250) and a frame (200) supporting at least one display (250).
[0044] According to one embodiment, a wearable device (103) can be worn on a part of a user's body. The wearable device (103) can provide extended reality (XR) to a user wearing the wearable device (103). For example, the extended reality can provide augmented reality (AR), virtual reality (VR), or mixed reality (MR) that combines augmented reality and virtual reality. For example, the wearable device (103) can display a virtual reality image provided from at least one optical device (282, 284) of FIG. 2B on at least one display (250) in response to a user's designated gesture acquired through the motion recognition cameras (260-2, 263) of FIG. 2B.
[0045] According to one embodiment, at least one display (250) may provide visual information to a user. For example, at least one display (250) may include a transparent or translucent lens. At least one display (250) may include a first display (250-1) and / or a second display (250-2) spaced apart from the first display (250-1). For example, the first display (250-1) and the second display (250-2) may be positioned at positions corresponding to the user's left and right eyes, respectively.
[0046] Referring to FIG. 2B, at least one display (250) can provide the user with visual information transmitted from external light and other visual information distinct from the visual information through a lens included in the at least one display (250). The lens can be formed based on at least one of a Fresnel lens, a pancake lens, or a multi-channel lens. For example, the at least one display (250) can include a first surface (231) and a second surface (232) opposite to the first surface (231). A display area can be formed on the second surface (232) of the at least one display (250). When the user wears the wearable device (103), external light can be transmitted to the user by being incident on the first surface (231) and transmitted through the second surface (232). As another example, at least one display (250) can display an augmented reality image combined with a virtual reality image provided from at least one optical device (282, 284) on a real screen transmitted through external light, in a display area formed on the second surface (232).
[0047] In one embodiment, at least one display (250) may include at least one waveguide (233, 234) that diffracts light emitted from at least one optical device (282, 284) and transmits the diffracted light to a user. The at least one waveguide (233, 234) may be formed based on at least one of glass, plastic, or polymer. A nano-pattern may be formed on at least a portion of the exterior or interior of the at least one waveguide (233, 234). The nano-pattern may be formed based on a grating structure having a polygonal and / or curved shape. Light incident on one end of the at least one waveguide (233, 234) may be propagated to the other end of the at least one waveguide (233, 234) by the nano-pattern. At least one waveguide (233, 234) may include at least one diffractive element (e.g., a diffractive optical element (DOE), a holographic optical element (HOE)) and at least one reflective element (e.g., a reflective mirror). For example, at least one waveguide (233, 234) may be arranged within the wearable device (103) to guide a screen displayed by at least one display (250) to the user's eyes. For example, the screen may be transmitted to the user's eyes based on total internal reflection (TIR) occurring within the at least one waveguide (233, 234).
[0048] The wearable device (103) can analyze an object included in a real image collected through a shooting camera (260-4), combine a virtual object corresponding to an object to be provided with augmented reality among the analyzed objects, and display the virtual object on at least one display (250). The virtual object can include at least one of text and an image regarding various information related to the object included in the real image. The wearable device (103) can analyze the object based on a multi-camera such as a stereo camera. For the object analysis, the wearable device (103) can perform spatial recognition (e.g., simultaneous localization and mapping (SLAM)) using a multi-camera and / or time-of-flight (ToF). A user wearing the wearable device (103) can view an image displayed on at least one display (250).
[0049] According to one embodiment, the frame (200) may be configured as a physical structure that allows the wearable device (103) to be worn on the user's body. According to one embodiment, the frame (200) may be configured so that, when the user wears the wearable device (103), the first display (250-1) and the second display (250-2) can be positioned corresponding to the user's left and right eyes. The frame (200) may support at least one display (250). For example, the frame (200) may support the first display (250-1) and the second display (250-2) to be positioned corresponding to the user's left and right eyes.
[0050] Referring to FIG. 2A, the frame (200) may include a region (220) that is in contact with at least a portion of a user's body when the user wears the wearable device (103). For example, the region (220) of the frame (200) that is in contact with a portion of the user's body may include a region that is in contact with a portion of the user's nose, a portion of the user's ear, and a portion of the side of the user's face that the wearable device (103) makes contact with. According to one embodiment, the frame (200) may include a nose pad (210) that is in contact with a portion of the user's body. When the wearable device (103) is worn by the user, the nose pad (210) may be in contact with a portion of the user's nose. The frame (200) may include a first temple (204) and a second temple (205) that are in contact with another portion of the user's body that is distinct from the portion of the user's body.
[0051] For example, the frame (200) may include a first rim (201) that surrounds at least a portion of the first display (250-1), a second rim (202) that surrounds at least a portion of the second display (250-2), a bridge (203) that is disposed between the first rim (201) and the second rim (202), a first pad (211) that is disposed along a portion of the edge of the first rim (201) from one end of the bridge (203), a second pad (212) that is disposed along a portion of the edge of the second rim (202) from the other end of the bridge (203), a first temple (204) that extends from the first rim (201) and is fixed to a portion of the wearer's ear, and a second temple (205) that extends from the second rim (202) and is fixed to a portion of the ear opposite the ear. The first pad (211) and the second pad (212) may be in contact with a portion of the user's nose, and the first temple (204) and the second temple (205) may be in contact with a portion of the user's face and a portion of the user's ear. The temples (204, 205) may be rotatably connected to the rim through the hinge units (206, 207) of FIG. 2B. The first temple (204) may be rotatably connected to the first rim (201) through the first hinge unit (206) disposed between the first rim (201) and the first temple (204). The second temple (205) may be rotatably connected to the second rim (202) through the second hinge unit (207) disposed between the second rim (202) and the second temple (205). According to one embodiment, the wearable device (103) can identify an external object (e.g., a user's fingertip) touching the frame (200) and / or a gesture performed by the external object by using a touch sensor, a grip sensor, and / or a proximity sensor formed on at least a portion of a surface of the frame (200).
[0052] According to one embodiment, the wearable device (103) may include hardwares that perform various functions (e.g., hardwares to be described later based on the block diagram of FIG. 5). For example, the hardwares may include a battery module (270), an antenna module (275), at least one optical device (282, 284), speakers (e.g., speakers 255-1, 255-2), a microphone (e.g., microphones 265-1, 265-2, 265-3), a light-emitting module (not shown), and / or a printed circuit board (PCB) (290) (e.g., a printed circuit board). The various hardwares may be arranged within the frame (200).
[0053] According to one embodiment, the microphones (e.g., microphones 265-1, 265-2, 265-3) of the wearable device (103) may be disposed on at least a portion of the frame (200) to acquire sound signals. A first microphone (265-1) disposed on the bridge (203), a second microphone (265-2) disposed on the second rim (202), and a third microphone (265-3) disposed on the first rim (201) are illustrated in FIG. 2B , but the number and arrangement of the microphones (265) are not limited to the embodiment of FIG. 2B . When the number of microphones (265) included in the wearable device (103) is two or more, the wearable device (103) may identify the direction of the sound signal by using a plurality of microphones disposed on different portions of the frame (200).
[0054] According to one embodiment, at least one optical device (282, 284) can project a virtual object onto at least one display (250) to provide various image information to a user. For example, at least one optical device (282, 284) can be a projector. At least one optical device (282, 284) can be disposed adjacent to at least one display (250) or can be included within at least one display (250) as a part of at least one display (250). According to one embodiment, the wearable device (103) can include a first optical device (282) corresponding to a first display (250-1) and a second optical device (284) corresponding to a second display (250-2). For example, at least one optical device (282, 284) may include a first optical device (282) disposed at an edge of a first display (250-1) and a second optical device (284) disposed at an edge of a second display (250-2). The first optical device (282) may transmit light to a first waveguide (233) disposed on the first display (250-1), and the second optical device (284) may transmit light to a second waveguide (234) disposed on the second display (250-2).
[0055] In one embodiment, the camera (260) may include a recording camera (260-4), an eye tracking camera (ET CAM) (260-1), and / or a motion recognition camera (260-2, 260-3). The recording camera (260-4), the eye tracking camera (260-1), and the motion recognition cameras (260-2, 260-3) may be positioned at different locations on the frame (200) and may perform different functions. The eye tracking camera (260-1) may output data indicating the position or gaze of the eyes of a user wearing the wearable device (103). For example, the wearable device (103) may detect the gaze from an image including the user's pupils obtained through the eye tracking camera (260-1). The wearable device (103) can perform gaze interaction with at least one object using the user's gaze acquired through the gaze tracking camera (260-1). The wearable device (103) can express a portion corresponding to the eye of an avatar representing the user in a virtual space using the user's gaze acquired through the gaze tracking camera (260-1). The wearable device (103) can render an image (or screen) displayed on at least one display (250) based on the position of the user's eyes. For example, the visual quality (e.g., resolution, brightness, saturation, grayscale, PPI) of a first region related to the gaze and a second region distinguished from the first region within the image may be different from each other. For example, if the wearable device (103) supports an iris recognition function, user authentication can be performed based on iris information acquired using the gaze tracking camera (260-1).An example in which the gaze tracking camera (260-1) is positioned toward the user's right eye is illustrated in FIG. 2B, but the embodiment is not limited thereto, and the gaze tracking camera (260-1) may be positioned solely toward the user's left eye, or may be positioned toward both eyes.
[0056] In one embodiment, the capturing camera (260-4) can capture an actual image or background to be aligned with a virtual image in order to implement augmented reality or mixed reality content. The capturing camera (260-4) can capture an image of a specific object existing at a location viewed by the user and provide the image to at least one display (250). The at least one display (250) can display a single image in which information about an actual image or background including an image of the specific object acquired using the capturing camera (260-4) is superimposed on a virtual image provided through at least one optical device (282, 284). The wearable device (103) can compensate for depth information (e.g., the distance between the wearable device (103) and an external object acquired using a depth sensor) using the image acquired using the capturing camera (260-4). The wearable device (103) can perform object recognition using the image acquired using the capturing camera (260-4). The wearable device (103) may perform a pass-through function to display an image acquired through a photographing camera (260-4) by overlaying it on at least a portion of a screen representing a virtual space on at least one display (250). In one embodiment, the photographing camera (260-4) may be positioned on a bridge (203) positioned between a first rim (201) and a second rim (202).
[0057] The gaze tracking camera (260-1) can implement more realistic augmented reality by tracking the gaze of a user wearing the wearable device (103) and thereby matching the user's gaze with visual information provided to at least one display (250). For example, when the wearable device (103) looks straight ahead, the wearable device (103) can naturally display environmental information related to the user's front at a location where the user is located on at least one display (250). The gaze tracking camera (260-1) can be configured to capture an image of the user's pupil to determine the user's gaze. For example, the gaze tracking camera (260-1) can receive gaze detection light reflected from the user's pupil and track the user's gaze based on the position and movement of the received gaze detection light. In one embodiment, the gaze tracking camera (260-1) can be positioned at positions corresponding to the user's left and right eyes. For example, the gaze tracking camera (260-1) may be positioned within the first rim (201) and / or the second rim (202) to face the direction in which the user wearing the wearable device (103) is positioned.
[0058] The motion recognition camera (260-2, 260-3) can recognize the movement of the user's entire body, such as the user's torso, hand, or face, or a part of the body, and thereby provide a specific event on a screen provided on at least one display (250). The motion recognition camera (260-2, 260-3) can recognize the user's motion (gesture recognition), obtain a signal corresponding to the motion, and provide a display corresponding to the signal on at least one display (250). The wearable device (103) can identify the signal corresponding to the motion and perform a designated function based on the identification. The motion recognition camera (260-2, 260-3) can be used to perform a spatial recognition function using SLAM and / or a depth map for 6 degrees of freedom pose (6 dof pose). The wearable device (103) can perform gesture recognition and / or object tracking functions using motion recognition cameras (260-2, 260-3). In one embodiment, the motion recognition cameras (260-2, 260-3) can be positioned on the first rim (201) and / or the second rim (202).
[0059] The camera (260) included in the wearable device (103) is not limited to the above-described gaze tracking camera (260-1) and motion recognition cameras (260-2, 260-3). For example, the wearable device (103) can identify an external object included in the FoV using a camera positioned toward the user's FoV. The wearable device (103) can identify an external object based on a sensor for identifying the distance between the wearable device (103) and the external object, such as a depth sensor and / or a time of flight (ToF) sensor. The camera (260) positioned toward the FoV can support an autofocus function and / or an optical image stabilization (OIS) function. For example, the wearable device (103) may include a camera (260) (e.g., a face tracking (FT) camera) positioned toward the face to obtain an image including the face of a user wearing the wearable device (103).
[0060] Although not shown, in one embodiment, the wearable device (103) may further include a light source (e.g., an LED) that emits light toward a subject (e.g., a user's eyes, face, and / or an external object within the FoV) being photographed using the camera (260). The light source may include an infrared wavelength LED. The light source may be disposed on at least one of the frame (200) and the hinge units (206, 207).
[0061] According to one embodiment, the battery module (270) may supply power to electronic components of the wearable device (103). In one embodiment, the battery module (270) may be disposed within the first temple (204) and / or the second temple (205). For example, the battery module (270) may be a plurality of battery modules (270). The plurality of battery modules (270) may be disposed within each of the first temple (204) and the second temple (205). In one embodiment, the battery module (270) may be disposed at an end of the first temple (204) and / or the second temple (205).
[0062] The antenna module (275) can transmit signals or power to the outside of the wearable device (103), or receive signals or power from the outside. In one embodiment, the antenna module (275) can be positioned within the first temple (204) and / or the second temple (205). For example, the antenna module (275) can be positioned close to one surface of the first temple (204) and / or the second temple (205).
[0063] The speaker (255) can output an audio signal to the outside of the wearable device (103). The audio output module may be referred to as a speaker. In one embodiment, the speaker (255) may be positioned within the first temple (204) and / or the second temple (205) so as to be positioned adjacent to the ear of a user wearing the wearable device (103). For example, the speaker (255) may include a second speaker (255-2) positioned within the first temple (204) and thus positioned adjacent to the user's left ear, and a first speaker (255-1) positioned within the second temple (205) and thus positioned adjacent to the user's right ear.
[0064] The light-emitting module (not shown) may include at least one light-emitting element. The light-emitting module may emit light of a color corresponding to a specific state or emit light with an action corresponding to a specific state, in order to visually provide information regarding a specific state of the wearable device (103) to the user. For example, when the wearable device (103) requires charging, it may emit red light at a regular cycle. In one embodiment, the light-emitting module may be disposed on the first rim (201) and / or the second rim (202).
[0065] Referring to FIG. 2B, according to one embodiment, a wearable device (103) may include a printed circuit board (PCB) (290). The PCB (290) may be included in at least one of the first temple (204) or the second temple (205). The PCB (290) may include an interposer disposed between at least two sub-PCBs. One or more hardwares included in the wearable device (103) (e.g., hardwares illustrated by different blocks in FIG. 5) may be disposed on the PCB (290). The wearable device (103) may include a flexible PCB (FPCB) for interconnecting the hardwares.
[0066] According to one embodiment, the wearable device (103) may include at least one of a gyro sensor, a gravity sensor, and / or an acceleration sensor for detecting a posture of the wearable device (103) and / or a posture of a body part (e.g., a head) of a user wearing the wearable device (103). Each of the gravity sensor and the acceleration sensor may measure gravitational acceleration and / or acceleration based on mutually perpendicular designated three-dimensional axes (e.g., an x-axis, a y-axis, and a z-axis). The gyro sensor may measure an angular velocity of each of the designated three-dimensional axes (e.g., an x-axis, a y-axis, and a z-axis). At least one of the gravity sensor, the acceleration sensor, and the gyro sensor may be referred to as an inertial measurement unit (IMU). According to one embodiment, the wearable device (103) may identify a user's motion and / or gesture performed to execute or terminate a specific function of the wearable device (103) based on the IMU.
[0067] FIGS. 3A and 3B illustrate examples of the appearance of a wearable device according to various embodiments.
[0068] The wearable device (103) of FIGS. 3A and 3B may be an example of the electronic device (101) of FIG. 1. According to one embodiment, an example of the appearance of a first side (310) of a housing of the wearable device (103) may be illustrated in FIG. 3A, and an example of the appearance of a second side (320) opposite to the first side (310) may be illustrated in FIG. 3B.
[0069] Referring to FIG. 3A, according to one embodiment, a first surface (310) of a wearable device (103) may have a form attachable to a body part of a user (e.g., the face of the user). Although not shown, the wearable device (103) may further include a strap for fixing to a body part of a user, and / or one or more temples (e.g., the first temple (204) and / or the second temple (205) of FIGS. 2A and 2B). A first display (250-1) for outputting an image to a left eye among the user's two eyes, and a second display (250-2) for outputting an image to a right eye among the user's two eyes may be disposed on the first surface (310). The wearable device (103) is formed on the first surface (310) and may further include a rubber or silicone packing to prevent interference by light (e.g., ambient light) different from the light emitted from the first display (250-1) and the second display (250-2).
[0070] According to one embodiment, the wearable device (103) may include cameras (260-1) for photographing and / or tracking both eyes of the user adjacent to each of the first display (250-1) and the second display (250-2). The cameras (260-1) may be referred to as the gaze tracking camera (260-1) of FIG. 2B. According to one embodiment, the wearable device (103) may include cameras (260-5, 260-6) for photographing and / or recognizing the face of the user. The cameras (260-5, 260-6) may be referred to as FT cameras. The wearable device (103) may control an avatar representing the user in a virtual space based on the motion of the user's face identified using the cameras (260-5, 260-6).
[0071] Referring to FIG. 3b, a camera (e.g., cameras (260-7, 260-8, 260-9, 260-10, 260-11, 260-12)) and / or a sensor (e.g., a depth sensor (330)) for obtaining information related to the external environment of the wearable device (103) may be disposed on a second surface (320) opposite to the first surface (310) of FIG. 3a. For example, the cameras (260-7, 260-8, 260-9, 260-10) may be disposed on the second surface (320) to recognize external objects. Cameras (260-7, 260-8, 260-9, 260-10) may be referenced to the motion recognition cameras (260-2, 260-3) of FIG. 2B.
[0072] For example, using cameras (260-11, 260-12), the wearable device (103) can obtain images and / or videos to be transmitted to each of the user's eyes. The camera (260-11) can be placed on the second face (320) of the wearable device (103) to obtain an image to be displayed through the second display (250-2) corresponding to the right eye among the two eyes. The camera (260-12) can be placed on the second face (320) of the wearable device (103) to obtain an image to be displayed through the first display (250-1) corresponding to the left eye among the two eyes. The cameras (260-11, 260-12) can be referred to as the shooting camera (260-4) of FIG. 2B.
[0073] According to one embodiment, the wearable device (103) may include a depth sensor (330) disposed on the second face (320) to identify a distance between the wearable device (103) and an external object. Using the depth sensor (330), the wearable device (103) may obtain spatial information (e.g., a depth map) for at least a portion of the FoV of a user wearing the wearable device (103). Although not shown, a microphone may be disposed on the second face (320) of the wearable device (103) to obtain a sound output from an external object. The number of microphones may be one or more, depending on the embodiment.
[0074] Content requiring security can be accessed within restricted spaces. For example, a user can view documents requiring security through devices such as company PCs, but cannot view such documents from outside (e.g., in a remote work environment). Furthermore, for example, a user can view documents requiring security if they are stored on the company's devices, but cannot view them if they are stored on a separate network (e.g., in the cloud). Administrators responsible for managing security can utilize a security system utilizing digital rights management (DRM) to freely access (e.g., create, edit, delete) documents within the restricted space, even on the same device. Conversely, in cases such as those described above where documents are viewed from outside the company or stored within the network, the administrator may have difficulty setting direct policies, making it difficult to ensure the security of the documents, making it difficult to use them.
[0075] However, since the content provided within the XR environment provided through the wearable device (103) is only displayed to the user of the wearable device (103), a certain level of security can be provided. Accordingly, the confidentiality and integrity of the content provided from the wearable device (103) can be guaranteed. Hereinafter, embodiments of the present disclosure can set a security level according to the space (or area) in which the wearable device (103) providing the XR environment is located, and provide visual information indicating the set security level. According to the visual information, the user of the wearable device (103) can recognize the security level and effectively use content requiring security within a safe space.
[0076] Figures 4a and 4b illustrate examples of how to display visual information indicating a security level.
[0077] The wearable device (103) (or wearable device (490)) of FIGS. 4A and 4B may represent an example of the electronic device (101) of FIG. 1 and the wearable device (103) of FIGS. 2A to 3B. In the examples (410, 420, 430, 440) of FIGS. 4A and 4B, the wearable device (103) provides an augmented reality (AR) environment, but the embodiments of the present disclosure are not limited thereto. For example, the wearable device (103) may provide an extended reality (XR) environment including a virtual reality (VR) environment.
[0078] Referring to FIG. 4A, the wearable device (103) can be worn on a body part of a user (401). For example, the body part of the user (401) can include the head part of the user (401). However, the embodiments of the present disclosure are not limited thereto. In addition, the wearable device (490) can be worn on a body part of a user (402). For example, the body part of the user (402) can include the head part of the user (402).
[0079] In the examples (410, 420, 430, 440) of FIGS. 4A and 4B, the user (402) may be a user authorized to view content requiring security (e.g., content (450)). For example, the wearable device (490) may have authentication information corresponding to the authorization. Alternatively, the user (401) may be a user who does not have the authorization to view content requiring security.
[0080] Referring to example (410), the wearable device (103) can recognize a distance (411) between the wearable device (490) and the wearable device (103). For example, the wearable device (103) can measure the distance (411) based on at least one of a communication circuit or a sensor of the wearable device (103). For example, the distance (411) can have a length greater than a first reference distance. For example, the first reference distance can represent a threshold value at which the wearable device (103) executes a content viewing mode.
[0081] In one embodiment, at distance (411), the wearable device (103) may provide a screen (413) through the display of the wearable device (103). For example, the screen (413) may include a user (402). As described above, the screen (413) displayed by the wearable device (103) providing the AR environment includes an actual user (402), but the embodiments of the present disclosure are not limited thereto. For example, the screen (413) may also include a visual object (e.g., an avatar) corresponding to the user (402). In example (410), an example is illustrated in which the wearable device (103) located at distance (411) displays the screen (413), but the embodiments of the present disclosure are not limited thereto. For example, the wearable device (103) may provide a screen for an external environment including the user (402) even when the distance from the wearable device (490) is greater than the distance (411).
[0082] Referring to example (420), the wearable device (103) can recognize the distance (421) between the wearable device (490) and the wearable device (103). For example, the wearable device (103) can measure the distance (421) based on at least one of a communication circuit or a sensor of the wearable device (103). For example, the distance (421) can have a length shorter than the first reference distance.
[0083] According to one embodiment, the wearable device (103) may transmit a first signal to the wearable device (490) to request authentication information based on recognizing that the distance (421) is within the first reference distance. For example, the wearable device (103) may transmit the first signal to the wearable device (490) based on recognizing that the gaze direction of the user (401) is located within a designated range set for the user (402). According to one embodiment, the wearable device (103) may receive a second signal from the wearable device (490) in response to the first signal. For example, the second signal may include the authentication information. For example, the authentication information may include information about content provided by the wearable device (490) and an authentication key of the content. For example, the information about the content may include at least one of the type of the content, the content of the content, or the number of times the content can be viewed. For example, the type may include a document, a video, or an image. In addition, for example, the authentication information may further include an intent for a software application according to the content. For example, the wearable device (103) may execute the content viewing mode in response to receiving the second signal.
[0084] According to one embodiment, in the distance (421), the wearable device (103) may provide a screen (423) through the display of the wearable device (103). Unlike the screen (413), the screen (423) may provide visual information to indicate the security level. For example, the visual information may be provided using a filter to adjust the color of the screen (423) and the transparency of the color. For example, the visual information may be referred to as a filter, a visual object, or a visual effect. For example, the color of the screen (423) may have a first color. For example, the first color may be related to the type of content (e.g., content (450)) to be provided to the wearable device (103). For example, the first color may be determined through information about the content within the authentication information received by the wearable device (103). For example, the color of the screen (423) may have a second color different from the first color when another content is provided. For example, the other content may have a different type than the content (450). However, the embodiments of the present disclosure are not limited thereto. For example, the user (401) may set the color associated with the content (450). In this case, the user (401) may set different colors even for content of the same type.
[0085] According to one embodiment, the wearable device (103) may, when the content is provided, display a screen (423) further including a first visual object indicating the content. When the other content is provided, the wearable device (103) may, when the other content is provided, display a screen (423) further including a second visual object indicating the other content. For example, the first visual object may include text or an icon indicating the content. For example, the second visual object may include text or an icon indicating the other content.
[0086] In one embodiment, the wearable device (103) can adjust the alpha value of the screen (423) to be displayed at a distance (421). For example, the alpha value can indicate the transparency of the color of the screen (423). For example, the screen (423) can display a screen rendered using the first alpha value.
[0087] Referring to the above, the user (401) can recognize that the content viewing mode is being executed based on the color (e.g., the first color) and the alpha value (e.g., the first alpha value) of the screen (423) displayed on the wearable device (103). Accordingly, the user (401) can expect that the content can be viewed when the user (402) approaches closer.
[0088] Referring to example (430) of FIG. 4B, the wearable device (103) can recognize a distance (431) between the wearable device (490) and the wearable device (103). For example, the wearable device (103) can measure the distance (431) based on at least one of a communication circuit or a sensor of the wearable device (103). For example, the distance (431) can have a shorter length than the distance (421) within the first reference distance.
[0089] According to one embodiment, the wearable device (103) can recognize the distance between the wearable device (490) and the wearable device (103). For example, the wearable device (103) can recognize the distance periodically or aperiodically. Or, for example, the wearable device (103) can recognize the distance based on recognizing that the distance changes according to the movement of the user (401). For example, the movement can be measured based on at least one of the communication circuitry or sensors of the wearable device (103).
[0090] In one embodiment, at distance (431), the wearable device (103) may provide a screen (433) through the display of the wearable device (103). Unlike screen (423), screen (433) may be rendered using the adjusted alpha value. For example, the wearable device (103) may adjust the alpha value based on recognizing that the distance has changed from distance (421) to distance (431). For example, the wearable device (103) may change the alpha value from the first alpha value to a second alpha value. For example, the second alpha value may be greater than the first alpha value. In other words, screen (433) having the second alpha value may be more opaque than screen (423) having the first alpha value.
[0091] Referring to the above, the user (401) can recognize that the screen provided by the wearable device (103) changes as the user approaches the wearable device (490) according to the movement. As the screen changes from screen (423) to screen (433), the user (401) can expect that the content can be viewed when the user (402) approaches closer.
[0092] Referring to example (440), the wearable device (103) can recognize a distance (441) between the wearable device (490) and the wearable device (103). For example, the wearable device (103) can measure the distance (441) based on at least one of a communication circuit or a sensor of the wearable device (103). For example, the distance (441) can have a shorter length than the distance (421) within the second reference distance. For example, the second reference distance can represent a threshold value at which the wearable device (103) executes a software application for displaying contents.
[0093] According to one embodiment, the wearable device (103) may execute a software application for displaying content (450) based on recognizing a distance (441) within the second reference distance. For example, if the software application is stored in the wearable device (103), the wearable device (103) may execute the software application based on recognizing a distance (441) within the second reference distance. Alternatively, if the software application is not stored in the wearable device (103), the wearable device (103) may store (or download) the software application based on the intent within the authentication information.
[0094] In one embodiment, the wearable device (103) may display content (450) in response to execution of the software application. For example, the wearable device (103) may display content (450) within a screen (443). Unlike the screen (433), the screen (443) may be rendered using the adjusted alpha value. For example, the wearable device (103) may adjust the alpha value based on recognizing that the distance (431) has changed to the distance (441). For example, the wearable device (103) may change the alpha value from the second alpha value to a third alpha value. For example, the third alpha value may be greater than the second alpha value. In other words, the screen (443) having the third alpha value may be more opaque than the screen (433) having the second alpha value. For example, the screen (443) may not include the external environment. For example, the third alpha value of the screen (443) may indicate a completely opaque state (e.g., when the size of the third alpha value is 255). However, the embodiments of the present disclosure are not limited thereto, and the screen (443) may also include the external environment.
[0095] In FIGS. 4A and 4B, examples (410, 420, 430, 440) are shown in which the distance is changed by a specified interval, but embodiments of the present disclosure are not limited thereto.
[0096] In one embodiment, the wearable device (103) may determine the gaze direction of the user (401) while adjusting the color and the alpha value of the screen, as illustrated in examples (410, 420, 430, and 440). For example, the wearable device (103) may change from the content viewing mode to another mode based on the gaze direction being located outside the specified range for the user (402), even if the distance is reduced, as illustrated in examples (410) to (440). For example, the other mode may be referred to as the default mode. For example, the wearable device (103) may stop displaying the visual information, including the color and the transparency, within the default mode. In other words, the wearable device (103) may display a screen to which the filter is not applied.
[0097] As described above, the device and method according to embodiments of the present disclosure can provide the user (402) with the security level by displaying the visual information (e.g., a filter for applying the color and the alpha value). In the above example, an example of executing the content viewing mode and displaying the content requiring security based on the distance and reference distances between the wearable device (103) and the wearable device (490) is shown, but the embodiments of the present disclosure are not limited thereto. For example, instead of the distance, the content viewing mode may be executed and the content may be displayed based on a range extending from the position of the wearable device (490) or based on the position of the wearable device (490).
[0098] Additionally, although the above example illustrates an example in which the color and alpha value of the screen displayed on the wearable device (103) are adjusted, the embodiments of the present disclosure are not limited thereto. For example, the wearable device (103) may display a visual object including text or a line based on the distance and the reference distances. Specific details related thereto are described below in FIGS. 7A and 7B .
[0099] Figure 5 illustrates an exemplary block diagram of a wearable device.
[0100] The wearable device (103) of FIG. 5 may be an example of the electronic device (101) of FIG. 1, the wearable device (103) of FIGS. 2A to 3B, or the wearable device (103) of FIGS. 4A and 4B. The external electronic device (490) of FIG. 5 may be an example of the external electronic device (490) of FIGS. 4A and 4B.
[0101] Referring to FIG. 5, an exemplary situation is illustrated in which a wearable device (103) and an external electronic device (490) are connected to each other based on a wired network and / or a wireless network. For example, the wired network may include a network such as the Internet, a local area network (LAN), a wide area network (WAN), or a combination thereof. For example, the wireless network may include a network such as long term evolution (LTE), 5g new radio (NR), wireless fidelity (WiFi), Zigbee, near field communication (NFC), Bluetooth, Bluetooth low-energy (BLE), or a combination thereof. Although the wearable device (103) and the external electronic device (490) are illustrated as being directly connected, the wearable device (103) and the external electronic device (490) may be indirectly connected via one or more routers and / or access points (APs).
[0102] Referring to FIG. 5, according to one embodiment, a wearable device (103) may include at least one of a processor (510), a display (520), a communication circuit (530), and a memory (540). The processor (510), the display (520), the communication circuit (530), and the memory (540) may be electrically and / or operably coupled with each other by a communication bus. Hereinafter, operably coupled hardware components may mean that a direct connection or an indirect connection is established between the hardware components, either wired or wireless, such that a second hardware component is controlled by a first hardware component among the hardware components. Although illustrated based on different blocks, the embodiment is not limited thereto, and some of the hardware components illustrated in FIG. 5 (e.g., at least a portion of the processor (510), memory (540), and communication circuit (530)) may be included in a single integrated circuit such as a system on a chip (SoC). The type and / or number of hardware components included in the wearable device (103) is not limited to those illustrated in FIG. 5. For example, the wearable device (103) may include only some of the hardware components illustrated in FIG. 5.
[0103] According to one embodiment, the processor (510) of the wearable device (103) may include a hardware component for processing data based on one or more instructions. The hardware component for processing data may include, for example, an arithmetic and logic unit (ALU), a floating point unit (FPU), and a field programmable gate array (FPGA). As an example, the hardware component for processing data may include a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processing (DSP), and / or a neural processing unit (NPU). The number of processors (510) may be one or more. For example, the processor (510) may have a multi-core processor structure, such as a dual core, a quad core, or a hexa core. The processor (510) of FIG. 5 may include the processor (120) of FIG. 1.
[0104] For example, the processor (510) of the wearable device (103) may include various processing circuits and / or multiple processors. For example, the term "processor" as used herein, including in the claims, may include various processing circuits including at least one processor, one or more of which may be configured to individually and / or collectively perform the various functions described below in a distributed manner. As used herein, when "processor," "at least one processor," and "one or more processors" are described as being configured to perform various functions, these terms encompass, for example, and without limitation, situations where one processor performs some of the recited functions and other processor(s) perform other parts of the recited functions, and also situations where one processor may perform all of the recited functions. Additionally, the at least one processor may include a combination of processors that perform the various functions enumerated / disclosed, for example, in a distributed manner. At least one processor is capable of executing program instructions to accomplish or perform various functions.
[0105] According to one embodiment, a display (520) of a wearable device (103) may output visualized information to a user. The number of displays (520) included in the wearable device (103) may be one or more. For example, the display (520) may be controlled by a processor (510) and / or a graphic processing unit (GPU) (not shown) to output visualized information to a user. The display (520) may include a flat panel display (FPD) and / or electronic paper. The FPD may include a liquid crystal display (LCD), a plasma display panel (PDP), a digital mirror device (DMD), one or more light emitting diodes (LEDs), and / or micro LEDs. The LEDs may include organic LEDs (OLEDs). The display (520) of FIG. 5 may include the display module (160) of FIG. 1.
[0106] According to one embodiment, the communication circuit (530) of the wearable device (103) may include hardware for supporting transmission and / or reception of electrical signals between the wearable device (103) and an external electronic device (490). The communication circuit (530) may include, for example, at least one of a modem, an antenna, and an optical / electronic (O / E) converter. The communication circuit (530) may support transmission and / or reception of electrical signals based on various types of communication means, such as Ethernet, Bluetooth, Bluetooth low energy (BLE), ZigBee, long term evolution (LTE), and 5G new radio (NR). The communication circuit (530) of FIG. 5 may include the communication module (190) and / or the antenna module (197) of FIG. 1.
[0107] According to one embodiment, the memory (540) of the wearable device (103) may include a hardware component for storing data and / or instructions input to and / or output from the processor (510). The memory (540) may include, for example, a volatile memory such as a random-access memory (RAM), and / or a non-volatile memory such as a read-only memory (ROM). The volatile memory may include, for example, at least one of a dynamic RAM (DRAM), a static RAM (SRAM), a cache RAM, and a pseudo SRAM (PSRAM). The non-volatile memory may include, for example, at least one of a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), a flash memory, a hard disk, a compact disc, and an embedded multimedia card (eMMC). The memory (540) of FIG. 5 may include the memory (130) of FIG. 1.
[0108] Although not shown in FIG. 5, the wearable device (103) may include a camera. The camera may include one or more optical sensors (e.g., a charged coupled device (CCD) sensor, a complementary metal oxide semiconductor (CMOS) sensor) that generate electrical signals representing the color and / or brightness of light. A plurality of optical sensors included in the camera may be arranged in the form of a two-dimensional array. The camera may acquire the electrical signals of each of the plurality of optical sensors substantially simultaneously, and generate an image corresponding to light reaching the optical sensors of the two-dimensional grid, and including a plurality of pixels arranged two-dimensionally. According to one embodiment, the wearable device (103) may render an actual environment within the image acquired through the camera and display the rendered visual information. In addition, for example, the wearable device (103) may recognize a distance between an external electronic device (490) and the wearable device (103) from the image. The number of cameras included in the wearable device (103) may be one or more, as described above with reference to FIGS. 2a and 2b, and / or FIGS. 3a and 3b.
[0109] Although not illustrated in FIG. 5, the wearable device (103) may include a sensor. For example, the sensor may include at least one sensor. For example, the sensor may include at least a portion of the sensor module (176) of FIG. 1. For example, the sensor may include an IMU (or IMU sensor). For example, the sensor may include a gyro sensor, a gravity sensor, and / or an acceleration sensor. According to one embodiment, the wearable device (103) may include an output means for outputting information in a form other than a visualized form. For example, the wearable device (103) may include a speaker for outputting an acoustic signal. For example, the wearable device (103) may include a motor for providing haptic feedback based on vibration.
[0110] Referring to FIG. 5, according to one embodiment, one or more instructions (or commands) representing operations and / or actions to be performed on data by a processor (510) of the wearable device (103) may be stored in the memory (540) of the wearable device (103). A set of one or more instructions may be referred to as a program, firmware, an operating system, a process, a routine, a sub-routine, and / or an application. Hereinafter, when an application is installed in an electronic device (e.g., a wearable device (103)), it may mean that one or more instructions provided in the form of an application are stored in the memory (540), and that the one or more applications are stored in a format executable by the processor of the electronic device (e.g., a file having an extension designated by the operating system of the wearable device (103)). According to one embodiment, the wearable device (103) may perform the operations of FIGS. 6 and 8 by executing one or more instructions stored in the memory (540).
[0111] Referring to FIG. 5, programs installed in the wearable device (103) may be classified into any one of different layers, including an application layer (550), a framework layer (560), and / or a hardware abstraction layer (HAL) (570), based on the target. For example, programs (e.g., drivers) designed to target the hardware of the wearable device (103) (e.g., the display (540), and / or the communication circuit (550)) may be classified within the hardware abstraction layer (570). For example, programs (e.g., distance recognition module (561), content verification module (563), screen adjustment module (565), and / or content provision module (567)) designed to target at least one of the hardware abstraction layer (570) and / or the application layer (550) may be classified within the framework layer (560). Programs classified as a framework layer (560) can provide an executable application programming interface (API) based on other programs.
[0112] Referring to FIG. 5, programs designed to target users controlling wearable devices (103) may be classified within the application layer (550). For example, a program classified within the application layer (550) may include at least one application that provides an XR environment. However, the embodiments of the present disclosure are not limited thereto. For example, a program classified within the application layer (550) may call an API to cause the execution of functions supported by programs classified within the framework layer (560).
[0113] Referring to FIG. 5, the wearable device (103) can recognize the distance between the wearable device (103) and the external electronic device (490) based on the execution of the distance recognition module (561) in the framework layer (560). According to one embodiment, the wearable device (103) can recognize the distance between the external electronic device (490) and the wearable device (103) using at least one of the communication circuit (530), the camera, and the sensor. For example, the wearable device (103) can recognize the distance based on a location positioning technique. For example, the location positioning technique can include Wi-Fi-based location positioning, BLE-based location positioning, IoT (internet of things) server-based location positioning, UWB (ultra-wideband)-based location positioning, ToF (time of flight) camera-based location positioning, and GPS-based location positioning. The above distance recognition may be performed periodically or aperiodically, or when a specified condition is satisfied. For example, the specified condition may include identifying the movement of the user of the wearable device (103).
[0114] Referring to FIG. 5, the wearable device (103) can verify content to be provided from an external electronic device (490) based on the execution of the content verification module (563) within the framework layer (560). For example, the wearable device (103) can verify the content based on authentication information included in a signal (e.g., the second signal) received from the external electronic device (490). For example, the authentication information may include information about the content provided by the wearable device (490) and an authentication key of the content. For example, the information about the content may include at least one of the type of the content, the content of the content, or the number of times the content can be viewed. For example, the type may include a document, a video, or an image. In addition, for example, the authentication information may further include an intent for a software application according to the content.
[0115] Referring to FIG. 5, the wearable device (103) may adjust a screen displayed on the display (520) based on the distance based on the execution of the screen adjustment module (565) within the framework layer (560). The adjustment of the screen may include the application of a filter (or visual information) to adjust the color and alpha value of the screen. For example, the wearable device (103) may display the screen without the filter applied when the distance is outside the first reference distance. For example, the wearable device (103) may apply the filter when the distance is within the first reference distance and outside the second reference distance. The second reference distance may be shorter than the first reference distance. In this case, the wearable device (103) may adjust the alpha value as the distance within the first reference distance approaches the second reference distance. However, the embodiments of the present disclosure are not limited thereto. For example, the wearable device (103) may display a visual object including text or lines based on the distance and the reference distances. Specific details related thereto are described below in FIGS. 7A and 7B.
[0116] Referring to FIG. 5, the wearable device (103) may provide content based on the execution of the content provision module (567) within the framework layer (560). For example, the content may include content requiring security. For example, the wearable device (103) may execute a software application for displaying or executing the content based on the distance within the second reference distance. For example, if the software application is stored within the wearable device (103), the wearable device (103) may execute the software application based on recognizing the distance within the second reference distance. Alternatively, if the software application is not stored within the wearable device (103), the wearable device (103) may store (or download) the software application based on the intent within the authentication information. For example, the wearable device (103) can provide the content using the software application.
[0117] The external electronic device (490) of FIG. 5 may include a processor (581), a display (583), and a communication circuit (585). For example, the external electronic device (490) may be directly connected to the wearable device (103) using the communication circuit (585). Alternatively, for example, the external electronic device (105) may be indirectly connected to the wearable device (103) via a server (not shown) using the communication circuit (585). The description of the communication circuit (585) may be substantially identical to the description of the communication circuit (530). The description of the processor (581) may be substantially identical to the description of the processor (510). The description of the display (583) may be substantially identical to the description of the display (520). Although not illustrated in FIG. 5, the external electronic device (490) may further include at least one of a sensor, a camera, and a memory.
[0118] FIG. 6 illustrates an example of an operational flow for a method of displaying visual information indicating a security level according to the distance between a wearable device and an external electronic device and displaying content requiring authentication.
[0119] At least some of the methods of FIG. 6 may be performed by the wearable device (103) of FIG. 5. For example, at least some of the methods may be controlled by the processor (510) of the wearable device (103). In the embodiments described below, the operations may be performed sequentially, but are not necessarily performed sequentially. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.
[0120] In operation (600), the wearable device (103) can obtain a distance to an external electronic device (490). For example, the wearable device (103) can recognize the distance between the wearable device (103) and the external electronic device (490). For example, the wearable device (103) can recognize the distance using at least one of a communication circuit (530), a sensor, or a camera of the wearable device (103). At this time, the wearable device (103) can identify the external electronic device (490) based on an input and obtain the distance to the identified external electronic device (490). For example, the input can include a direction of a user's gaze toward the wearable device (103), or an input (or gesture) of the user.
[0121] In FIG. 6, an example of the wearable device (103) recognizing the distance is illustrated in operation (600), but the embodiments of the present disclosure are not limited thereto. For example, the wearable device (103) may perform the distance recognition periodically or aperiodically. Alternatively, for example, the wearable device (103) may perform the distance recognition when a specified condition is satisfied. For example, the specified condition may include identifying the movement of the user of the wearable device (103).
[0122] In operation (605), the wearable device (103) may determine whether the distance is less than a first reference distance. For example, the wearable device (103) may determine whether the distance is less than the first reference distance, which is a threshold value for executing a content viewing mode of the wearable device (103). For example, the first reference distance may be set for each content. Or, for example, the first reference distance may be set by the user of the wearable device (103). Or, for example, the first reference distance may be set according to the space in which the wearable device (103) is positioned.
[0123] In operation (605), if the distance is less than the first reference distance, the wearable device (103) may perform operation (610). Conversely, in operation (605), if the distance is greater than or equal to the first reference distance, the wearable device (103) may perform operation (600). For example, the wearable device (103) may reacquire the distance.
[0124] In operation (610), the wearable device (103) may transmit a first signal. For example, the wearable device (103) may transmit the first signal to an external electronic device (490) to request authentication information of the content.
[0125] According to one embodiment, the wearable device (103) can recognize the gaze direction of the user of the wearable device (103). For example, the wearable device (103) can recognize the gaze direction using a camera of the wearable device (103). When the gaze direction is located within a range designated for the wearable device (490) (or the user of the wearable device (490)), the wearable device (103) can transmit the first signal to the wearable device (490).
[0126] In operation (615), the wearable device (103) may receive a second signal. For example, the wearable device (103) may receive, in response to the first signal, the second signal including the authentication information of the content from an external electronic device (490). For example, the authentication information may include information about the content provided by the wearable device (490) and an authentication key of the content. For example, the information about the content may include at least one of the type of the content, the content of the content, or the number of times the content can be viewed. For example, the type may include a document, a video, or an image. In addition, for example, the authentication information may further include an intent for a software application according to the content.
[0127] In operation (620), the wearable device (103) may execute a mode for displaying the content. For example, the mode may be referred to as a content viewing mode. For example, the wearable device (103) may execute the mode based on receiving the second signal.
[0128] In Fig. 6, operation (620) is performed after operation (610) and operation (615), but the embodiment of the present disclosure is not limited thereto. For example, the wearable device (103) may execute the mode in response to recognizing that the distance is less than the first reference distance through operation (605), and may transmit the first signal and receive the second signal within the mode.
[0129] In operation (625), the wearable device (103) may display a screen having a color associated with the content. For example, the wearable device (103) may display the screen having the color in response to the mode being executed while displaying the screen. For example, the color of the screen may be determined based on the type of content included in the second signal. For example, however, the embodiments of the present disclosure are not limited thereto. For example, the user of the wearable device (103) may set a color for each content. In this case, the user may set different colors even for content of the same type. In one example, if the content is a Word file, the color may be blue. In one example, if the content is an Excel file, the color may be green. In one example, if the content is a PowerPoint file, the color may be red.
[0130] For example, if the content is first content, the color may be the first color. Conversely, if the content is second content that is different from the first content, the color may be a second color that is different from the first color. For example, the first content may be a document, and the second content may be a video.
[0131] According to one embodiment, the screen having the color displayed in operation (625) may have a designated alpha value. For example, the designated alpha value may represent transparency that is adjusted according to the distance. In this case, the designated alpha value may be defined as a basic alpha value. The designated alpha value may have a changed value with respect to 0 or an arbitrary value (e.g., 30). For example, the 0 or the arbitrary value may represent transparency when the distance is substantially equal to the first reference distance.
[0132] In operation (630), the wearable device (103) may determine whether the distance has changed. For example, the wearable device (103) may determine whether the distance has changed using at least one of the communication circuit (530), the camera, or the sensor. For example, whether the distance has changed may be determined based on the user's movement of the wearable device (103).
[0133] In operation (630), if the distance changes, the wearable device (103) can perform operation (635). Alternatively, in operation (630), if the distance does not change (or is maintained), the wearable device (103) can perform operation (630). For example, the wearable device (103) can check whether the distance changes.
[0134] In operation (635), the wearable device (103) may adjust the alpha value of the color. For example, the wearable device (103) may adjust the alpha value according to the distance. For example, when the distance is a first distance within the first reference distance, the wearable device (103) may determine the alpha value as a first alpha value. Thereafter, when the distance is a second distance within the first distance from the first distance, the wearable device (103) may determine the alpha value as a second alpha value. For example, the second alpha value may be greater than the first alpha value. Conversely, when the distance is a third distance outside the first distance from the first distance and within the first reference distance, the wearable device (103) may determine the alpha value as a third alpha value. For example, the third alpha value may be less than the first alpha value.
[0135] In operation (640), the wearable device (103) can determine whether the distance is decreasing. For example, if the wearable device (103) periodically recognizes the distance, it can determine whether the distance of the current period is decreasing or increasing by comparing it to the distance of the previous period.
[0136] In FIG. 6, operation (640) is illustrated as being performed after operation (635), but the embodiments of the present disclosure are not limited thereto. For example, operation (635) may be performed as the distance decreases or increases after operation (640) is performed.
[0137] In operation (640), the wearable device (103) may perform operation (655) upon determining that the distance has decreased. Alternatively, in operation (640), the wearable device (103) may perform operation (645) upon determining that the distance has increased.
[0138] In operation (645), the wearable device (103) may determine whether the distance is less than the first reference distance. For example, the wearable device (103) may determine whether the distance is less than the first reference distance based on a change in the distance recognized in operation (630).
[0139] In operation (645), if the distance is less than the first reference distance, the wearable device (103) may perform operation (630). In other words, if the distance is less than the first reference distance despite the change in the distance, the wearable device (103) may re-check whether the distance has changed. Conversely, in operation (645), if the distance is greater than or equal to the first reference distance, the wearable device (103) may perform operation (650).
[0140] In operation (650), the wearable device (103) may stop displaying the color. For example, the wearable device (103) may change from the content viewing mode to another mode based on recognizing that the distance is greater than or equal to the first reference distance based on the change in the distance identified in operation (630). For example, the other mode may be referred to as the basic mode. For example, the wearable device (103) may stop displaying the color within the basic mode. The wearable device (103) may display the screen instead of displaying the screen having the color. In other words, the wearable device (103) may deactivate application of a filter (or visual information, visual object, or visual effect) for applying the color (and the alpha value) to the screen. In one embodiment, the wearable device (103) may perform operation (600) again after stopping displaying the color. For example, the wearable device (103) may obtain (or recognize) the distance between the external electronic device (490) and the wearable device (103).
[0141] In operation (655), the wearable device (103) may determine whether the distance is less than a second reference distance. For example, the second reference distance may represent a threshold value at which the wearable device (103) executes a software application for displaying contents.
[0142] In the above example, a wearable device (103) is illustrated that determines whether the distance is less than the second reference distance, but embodiments of the present disclosure are not limited thereto. For example, the wearable device (103) may also determine whether the alpha value of the screen exceeds a reference alpha value. The reference alpha value may represent a threshold value for executing a software application for displaying the content. For example, the reference alpha value may indicate a completely opaque value (e.g., 255). However, embodiments of the present disclosure are not limited thereto.
[0143] In operation (655), the wearable device (103) may perform operation (660) upon determining that the distance is less than the second reference distance. Alternatively, in operation (655), the wearable device (103) may perform operation (630) upon determining that the distance is greater than or equal to the second reference distance.
[0144] In operation (660), the wearable device (103) may execute the software application for displaying the content. For example, if the software application is stored in the wearable device (103), the wearable device (103) may execute the software application based on recognizing the distance within the second reference distance. Alternatively, if the software application is not stored in the wearable device (103), the wearable device (103) may store (or download) the software application based on the intent within the authentication information.
[0145] According to one embodiment, the wearable device (103) may perform authentication for viewing the content based on the authentication information. For example, the wearable device (103) may request the authentication from an external electronic device (e.g., a server) that manages the content. For example, the wearable device (103) may request the authentication using the authentication key within the authentication information. In response to the authentication being successful, the wearable device (103) may display the screen including a visual object inquiring about the execution of the software application. Based on the input to the visual object, the wearable device (103) may execute the software application for displaying the content. At this time, the authentication may be performed in operation (655) or may be performed before operation (655).
[0146] In operation (665), the wearable device (103) may display the content. For example, the wearable device (103) may display the content while the software application is running. In the above example, an example in which the software application for displaying the content is executed is described, but the embodiments of the present disclosure are not limited thereto. For example, the wearable device (103) may execute a program for executing the content and execute the content based on the program. In this case, the content may be executed in the background of the wearable device (103).
[0147] According to one embodiment, the wearable device (103) may determine the gaze direction of the user of the wearable device (103) while adjusting the color and the alpha value of the screen in operations (620) to (655). For example, even if the wearable device (103) determines that the distance is reduced in operation (640), the wearable device (103) may change from the content viewing mode to the other mode based on the gaze direction being located outside the specified range with respect to the external electronic device (490) (or the user of the external electronic device (490). For example, the wearable device (103) may stop displaying visual information (or the filter) having the color and the alpha value within the basic mode. In other words, the wearable device (103) may display a screen to which the filter is not applied. For example, when the mode of the wearable device (103) is changed from the above mode (or the content viewing mode) to the other mode (or the basic mode), the viewing authority of the wearable device (103) for the content may be terminated. In other words, the number of times the content can be viewed may be set to 1.
[0148] As described above, the device and method according to embodiments of the present disclosure can provide the user of the wearable device (103) with the security level by displaying the visual information (e.g., a filter for applying the color and the alpha value). In the above example, an example of executing the content viewing mode and displaying the content requiring security based on the distance and reference distances between the wearable device (103) and the wearable device (490) is shown, but the embodiments of the present disclosure are not limited thereto. For example, instead of the distance, the content viewing mode may be executed and the content may be displayed based on a range extending from the position of the wearable device (490) or based on the position of the wearable device (490).
[0149] In addition, the above example illustrates an example in which visual information is displayed with adjusted attributes (e.g., the color and the alpha value) of the screen displayed on the wearable device (103), but the embodiments of the present disclosure are not limited thereto. For example, the wearable device (103) may also display a visual object including text or a line based on the distance and the reference distances. Specific details related thereto are described below in FIGS. 7A and 7B.
[0150] Figures 7a and 7b illustrate examples of visual objects indicating security levels.
[0151] The display (520) of FIGS. 7A and 7B may represent the display (520) of FIG. 5. FIGS. 7A and 7B illustrate examples (700, 705, 750, 755) of visual objects for indicating the security level. For example, the wearable device (103) may display a screen including the visual object through the display (520).
[0152] Referring to FIG. 7A, an example (700) illustrates a visual object (720) that is displayed when the wearable device (103) recognizes that the distance between the external electronic device (490) and the wearable device (103) is within the first reference distance. Referring to the example (700), the wearable device (103) can display a screen (710) that includes an actual external environment. The example (700) illustrates a screen (710) that includes the external environment, as the wearable device (103) that provides an AR environment is described, but the embodiments of the present disclosure are not limited thereto. For example, the wearable device (103) may also display a screen (710) that includes a virtual environment rendered for the external environment or a virtual environment different from the external environment.
[0153] According to one embodiment, the wearable device (103) may, in response to determining that the distance is less than the first reference distance, display a screen (710) including a visual object (720). For example, the wearable device (103) may recognize that the distance is the first distance. For example, the first distance may be less than the first reference distance. For example, the visual object (720) may include text to guide that a content viewing mode is executed. For example, the visual object (720) may include "Content viewing mode (come a little closer)." The visual object (720) may be used to guide a user of the wearable device (103) to approach an external electronic device (490) (or a user of the external electronic device (490)) while wearing the wearable device (103).
[0154] In example (705), the wearable device (103) may recognize that the distance has changed from the first distance to a second distance. For example, the second distance may be shorter than the first distance. In other words, compared to example (700), the wearable device (103) and the external electronic device (490) of example (705) may be positioned closer. For example, the second distance may be less than the second reference distance. In response to determining that the second distance is less than the second reference distance, the wearable device (103) may display a screen (710) including a visual object (730). For example, the screen (710) may include a visual object (730) instead of a visual object (720). For example, the visual object (730) may include text to guide that content can be viewed (or displayed, executed). For example, a visual object (730) may include “content viewable.” The visual object (730) may be used to guide a user of a wearable device (103) to provide input for executing the content.
[0155] According to one embodiment, the wearable device (103) may execute a software application for displaying the content and display the content based on the user's input to the wearable device (103) while the screen (710) including the visual object (730) is displayed.
[0156] Referring to FIG. 7b, example (750) illustrates a visual object (770) that is displayed when the wearable device (103) recognizes that the distance is within the first reference distance. Referring to example (750), the wearable device (103) can display a screen (710) that includes an external environment.
[0157] According to one embodiment, the wearable device (103) may, in response to determining that the distance is less than the first reference distance, display a screen (710) including a visual object (770). For example, the wearable device (103) may recognize that the distance is the first distance. For example, the visual object (770) may include a line for guiding that a content viewing mode is executed. For example, the visual object (770) may include a first line formed as a dotted line. For example, the visual object (770) may be used to guide a user of the wearable device (103) to approach an external electronic device (490) (or a user of the external electronic device (490)) while wearing the wearable device (103).
[0158] In example (755), the wearable device (103) may recognize that the distance has changed from the first distance to a second distance. For example, the second distance may be shorter than the first distance. In other words, compared to example (750), the wearable device (103) and the external electronic device (490) of example (755) may be positioned closer. For example, the second distance may be less than the second reference distance. In response to determining that the second distance is less than the second reference distance, the wearable device (103) may display a screen (710) including a visual object (780). For example, the screen (710) may include a visual object (780) instead of a visual object (770). For example, the visual object (780) may include a second line formed by a dotted line. For example, the second line may be formed thicker than the first line. The visual object (780) may be used to guide the user of the wearable device (103) to provide input for executing the content.
[0159] According to one embodiment, the wearable device (103) may execute a software application for displaying the content and display the content based on the user's input to the wearable device (103) while the screen (710) including the visual object (780) is displayed.
[0160] Referring to the above, in FIGS. 7A and 7B, instead of the visual information (e.g., a color and a filter for adjusting the alpha value of the color) of FIGS. 4A and 4B, examples (700, 705, 750, 755) are shown in which visual objects (e.g., visual objects (720, 730, 770, 780)) are provided according to the distance between the wearable device (103) and the wearable device (490). However, the embodiments of the present disclosure are not limited thereto. According to one embodiment, the wearable device (103) may provide the visual object together with the visual information. Alternatively, for example, the wearable device (103) may provide visual objects different from the visual objects (720, 730, 770, 780).
[0161] Figure 8 illustrates an example of a flow of operations for displaying visual information indicating a security level and executing a software application for displaying content requiring authentication.
[0162] At least some of the methods of FIG. 8 may be performed by the wearable device (103) of FIG. 5. For example, at least some of the methods may be controlled by the processor (510) of the wearable device (103). In the embodiments described below, the operations may be performed sequentially, but are not necessarily performed sequentially. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.
[0163] In operation (810), the wearable device (103) may transmit a first signal requesting authentication information of the content to the external electronic device (490). In response to a distance between the wearable device (103) and the external electronic device (490) being less than the first reference distance, the first signal may be transmitted to the external electronic device (490).
[0164] According to one embodiment, the wearable device (103) can obtain the distance to the external electronic device (490). For example, the wearable device (103) can recognize the distance using at least one of the communication circuit (530), a sensor, or a camera of the wearable device (103). At this time, the wearable device (103) can identify the external electronic device (490) based on an input and obtain the distance to the identified external electronic device (490). For example, the input can include a direction of a user's gaze toward the wearable device (103) or an input (or gesture) of the user. For example, the wearable device (103) can perform the distance recognition periodically or aperiodically. Or, for example, the wearable device (103) can perform the distance recognition when a specified condition is satisfied. For example, the specified conditions may include identifying movements of a user of the wearable device (103).
[0165] In one embodiment, the wearable device (103) may determine whether the distance is less than a first reference distance. For example, the wearable device (103) may determine whether the distance is less than the first reference distance, which is a threshold value for executing a content viewing mode of the wearable device (103). For example, the first reference distance may be set for each content. Or, for example, the first reference distance may be set by the user of the wearable device (103). Or, for example, the first reference distance may be set according to the space in which the wearable device (103) is positioned.
[0166] In one embodiment, if the distance is less than the first reference distance, the wearable device (103) may transmit the first signal. Conversely, if the distance is greater than or equal to the first reference distance, the wearable device (103) may reacquire the distance.
[0167] According to one embodiment, the wearable device (103) can recognize the gaze direction of the user of the wearable device (103). For example, the wearable device (103) can recognize the gaze direction using a camera of the wearable device (103). When the gaze direction is located within a range designated for the wearable device (490) (or the user of the wearable device (490)), the wearable device (103) can transmit the first signal to the wearable device (490).
[0168] In operation (820), the wearable device (103) may receive a second signal including authentication information. For example, in response to the first signal, the wearable device (103) may receive the second signal including the authentication information of the content from an external electronic device (490).
[0169] In one embodiment, the authentication information may include information about content provided by the wearable device (490) and an authentication key for the content. For example, the information about the content may include at least one of the type of the content, the content of the content, or the number of times the content can be viewed. For example, the type may include a document, a video, or an image. In addition, for example, the authentication information may further include an intent for a software application according to the content.
[0170] In one embodiment, the wearable device (103) may execute a mode for displaying the content. For example, the mode may be referred to as a content viewing mode. For example, the wearable device (103) may execute the mode based on receiving the second signal.
[0171] In the above example, the mode is described as being executed after transmitting the first signal and receiving the second signal, but the embodiments of the present disclosure are not limited thereto. For example, the wearable device (103) may execute the mode in response to recognizing that the distance is less than the first reference distance, and may also transmit the first signal and receive the second signal within the mode.
[0172] In operation (830), the wearable device (103) may display a screen having a color associated with the content. For example, the wearable device (103) may display the screen having the color in response to the mode being executed while displaying the screen. For example, the color of the screen may be determined based on the type of content included in the second signal. For example, however, the embodiments of the present disclosure are not limited thereto. For example, the user of the wearable device (103) may set a color for each content. In this case, the user may set different colors even for content of the same type. In one example, if the content is a Word file, the color may be blue. In one example, if the content is an Excel file, the color may be green. In one example, if the content is a PowerPoint file, the color may be red.
[0173] For example, if the content is first content, the color may be the first color. Conversely, if the content is second content that is different from the first content, the color may be a second color that is different from the first color. For example, the first content may be a document, and the second content may be a video.
[0174] For example, if the content is first content, the wearable device (103) may display the screen further including a first visual object indicating the first content. If the content is second content, the wearable device (103) may display the screen further including a second visual object indicating the second content. For example, the first visual object may include text or an icon indicating the first content. For example, the second visual object may include text or an icon indicating the second content.
[0175] In one embodiment, the screen having the color may have a designated alpha value. For example, the designated alpha value may represent transparency that is adjusted according to the distance. In this case, the designated alpha value may be defined as a basic alpha value. The designated alpha value may have a changed value with respect to 0 or an arbitrary value (e.g., 30). For example, the 0 or the arbitrary value may represent transparency when the distance is substantially equal to the first reference distance.
[0176] In operation (840), the wearable device (103) may adjust the alpha value of the color. For example, the wearable device (103) may adjust the alpha value of the color based on a change in the distance while displaying the screen.
[0177] In one embodiment, the wearable device (103) can determine whether the distance has changed. For example, the wearable device (103) can determine whether the distance has changed using at least one of the communication circuit (530), the camera, or the sensor. For example, the change in the distance can be determined based on the user's movement of the wearable device (103).
[0178] For example, if the distance is a first distance within the first reference distance, the wearable device (103) may determine the alpha value as a first alpha value. Thereafter, if the distance is a second distance within the first distance from the first distance, the wearable device (103) may determine the alpha value as a second alpha value. For example, the second alpha value may be greater than the first alpha value. Conversely, if the distance is a third distance outside the first distance from the first distance and within the first reference distance, the wearable device (103) may determine the alpha value as a third alpha value. For example, the third alpha value may be less than the first alpha value.
[0179] In one embodiment, the wearable device (103) can recognize a change in the distance. For example, the distance may change due to a movement of the user of the wearable device (103). For example, based on the change in the distance, if the distance is greater than or equal to the first reference distance, the wearable device (103) can stop displaying the color. For example, based on recognizing that the distance is greater than or equal to the first reference distance, the wearable device (103) can change from the content viewing mode to another mode. For example, the other mode may be referred to as the basic mode. For example, the wearable device (103) can stop displaying the color within the basic mode. The wearable device (103) can display the screen instead of displaying the screen having the color. In other words, the wearable device (103) can disable application of a filter (or visual object, visual effect) to the screen for applying the color (and the alpha value).
[0180] In operation (850), the wearable device (103) may execute a software application for displaying the content. For example, the wearable device (103) may execute the software application for displaying the content based on the distance being less than the second reference distance, which is less than the first reference distance.
[0181] In one embodiment, the wearable device (103) may determine whether the distance is less than a second reference distance. For example, the second reference distance may represent a threshold value at which the wearable device (103) executes the software application.
[0182] In the above example, a wearable device (103) is illustrated that determines whether the distance is less than the second reference distance, but embodiments of the present disclosure are not limited thereto. For example, the wearable device (103) may also determine whether the alpha value of the screen exceeds a reference alpha value. The reference alpha value may represent a threshold value for executing a software application for displaying the content. For example, the reference alpha value may indicate a completely opaque value (e.g., 255). However, embodiments of the present disclosure are not limited thereto.
[0183] In one embodiment, the wearable device (103) may execute the software application for displaying the content upon determining that the distance is less than the second reference distance. For example, if the software application is stored in the wearable device (103), the wearable device (103) may execute the software application based on recognizing the distance within the second reference distance. Alternatively, if the software application is not stored in the wearable device (103), the wearable device (103) may store (or download) the software application based on the intent in the authentication information.
[0184] According to one embodiment, the wearable device (103) may perform authentication for viewing the content based on the authentication information. For example, the wearable device (103) may request the authentication from an external electronic device (e.g., a server) that manages the content. For example, the wearable device (103) may request the authentication using the authentication key in the authentication information. In response to the authentication being successful, the wearable device (103) may display the screen including a visual object inquiring about the execution of the software application. Based on the input to the visual object, the wearable device (103) may execute the software application for displaying the content. In this case, the authentication may be performed prior to operation (850).
[0185] According to one embodiment, the wearable device (103) can display the content. For example, the wearable device (103) can display the content while the software application is running. In the above example, an example in which the software application for displaying the content is executed is described, but the embodiments of the present disclosure are not limited thereto. For example, the wearable device (103) can execute a program for executing the content and execute the content based on the program. In this case, the content can also be executed within the background of the wearable device (103).
[0186] According to one embodiment, the wearable device (103) may check the gaze direction of the user of the wearable device (103) while adjusting the color and the alpha value of the screen. For example, the wearable device (103) may change from the content viewing mode to the other mode based on the gaze direction being located outside the specified range with respect to the external electronic device (490) (or the user of the external electronic device (490)), even if the distance is within the first reference distance. For example, the wearable device (103) may stop displaying visual information (or the filter) having the color and the alpha value within the basic mode. In other words, the wearable device (103) may display a screen to which the filter is not applied. For example, when the mode of the wearable device (103) is changed from the above mode (or the content viewing mode) to the other mode (or the basic mode), the viewing authority of the wearable device (103) for the content may be terminated. In other words, the number of times the content can be viewed may be set to 1.
[0187] As described above, the device and method according to embodiments of the present disclosure can provide the user of the wearable device (103) with the security level by displaying the visual information (e.g., a filter for applying the color and the alpha value). In the above example, an example of executing the content viewing mode and displaying the content requiring security based on the distance and reference distances between the wearable device (103) and the wearable device (490) is illustrated, but the embodiments of the present disclosure are not limited thereto. For example, instead of the distance, the content viewing mode may be executed and the content may be displayed based on a range extending from the location of the wearable device (490) or based on the location of the wearable device (490).
[0188] In addition, although the above example illustrates an example in which the attributes (e.g., the color and the alpha value) of the screen displayed on the wearable device (103) are adjusted, the embodiments of the present disclosure are not limited thereto. For example, the wearable device (103) may display a visual object including text or a line based on the distance and the reference distances. For specific details related thereto, reference may be made to FIGS. 7A and 7B above.
[0189] As described above, the device and method according to embodiments of the present disclosure can set a security level according to the space (or area) in which the wearable device (103) providing the XR environment is located, and provide visual information indicating the set security level. Based on the visual information, the user of the wearable device (103) can recognize the security level and effectively use content requiring security within a safe space.
[0190] As described above, the wearable device (103) may include a communication circuit (530). The wearable device (103) may include a memory (540) that stores instructions and includes one or more storage media. The wearable device (103) may include a display (520). The wearable device (103) may include at least one processor (510) that includes a processing circuit. The instructions, when individually or collectively executed by the at least one processor (510), may cause the wearable device (103) to transmit, through the communication circuit (530), a first signal requesting authentication information of content to the external electronic device (490) in response to a distance between the wearable device (103) and the external electronic device (490) being less than a first reference distance. The instructions, when individually or collectively executed by the at least one processor (510), may cause the wearable device (103) to receive, in response to the first signal, a second signal including the authentication information from the external electronic device (490). The above instructions, when individually or collectively executed by the at least one processor (510), may cause the wearable device (103) to display, through the display (520), a screen having a color related to the content within a mode for displaying the content executed based on the received second signal.The instructions, when individually or collectively executed by the at least one processor (510), may cause the wearable device (103) to adjust an alpha value of the color based on a change in the distance from a first distance less than the first reference distance to a second distance less than the first distance while displaying the screen having the color. The instructions, when individually or collectively executed by the at least one processor (510), may cause the wearable device (103) to execute a software application for displaying the content based on the distance being less than a second reference distance less than the first reference distance.
[0191] In one embodiment, the first signal may cause the display of a visual object confirming that the content is provided to a user of the wearable device (103) via a display (520) of the external electronic device (490).
[0192] In one embodiment, the instructions, when individually or collectively executed by the at least one processor (510), may cause the wearable device (103) to determine whether the distance is less than the first reference distance. The instructions, when individually or collectively executed by the at least one processor (510), may cause the wearable device (103) to transmit the first signal based on the distance being less than the first reference distance and a gaze direction of a user of the wearable device (103) being located within a specified range with respect to the external electronic device (490).
[0193] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (510), may cause the wearable device (103) to display the screen having a first color when the content is first content. The instructions, when individually or collectively executed by the at least one processor (510), may cause the wearable device (103) to display the screen having a second color different from the first color when the content is second content different from the first content.
[0194] In one embodiment, the instructions, when individually or collectively executed by the at least one processor (510), may cause the wearable device (103) to display the screen further including a first visual object indicating that the content is first content, if the content is first content. The instructions, when individually or collectively executed by the at least one processor (510), may cause the wearable device (103) to display the screen further including a second visual object indicating that the content is second content, if the content is second content different from the first content.
[0195] In one embodiment, the instructions, when individually or collectively executed by the at least one processor (510), may cause the wearable device (103) to, while displaying the screen, display the screen rendered based on the alpha value having a first value when the distance is the first distance. The instructions, when individually or collectively executed by the at least one processor (510), may cause the wearable device (103) to, while displaying the screen, display the screen rendered based on the alpha value having a second value exceeding the first value when the distance is the second distance changed from the first distance.
[0196] In one embodiment, the instructions, when individually or collectively executed by the at least one processor (510), may cause the wearable device (103) to change the mode to another mode based on a change in the distance from the second distance to a third distance greater than or equal to the first reference distance while displaying the screen. The instructions, when individually or collectively executed by the at least one processor (510), may cause the wearable device (103) to cease displaying the color within the other mode.
[0197] In one embodiment, the instructions, when individually or collectively executed by the at least one processor (510), may cause the wearable device (103) to track a gaze direction of a user of the wearable device (103). The instructions, when individually or collectively executed by the at least one processor (510), may cause the wearable device (103) to change the mode to another mode if, while displaying the screen within the mode, the gaze direction is located outside a range specified with respect to the external electronic device (490). The instructions, when individually or collectively executed by the at least one processor (510), may cause the wearable device (103) to cease displaying the color within the other mode.
[0198] In one embodiment, the instructions, when individually or collectively executed by the at least one processor (510), may cause the wearable device (103) to display the screen including a visual object inquiring about execution of the software application based on successful authentication for access to the content using the authentication information. The instructions, when individually or collectively executed by the at least one processor (510), may cause the wearable device (103) to display the screen including the content while the software application is running.
[0199] According to one embodiment, each of the wearable device (103) and the external electronic device (490) may include a device that provides an extended reality (XR) environment.
[0200] As described above, the method performed by the wearable device (103) may include an operation of transmitting, through the communication circuit (530), a first signal requesting authentication information of content to the external electronic device (490) in response to a distance between the wearable device (103) and the external electronic device (490) being less than a first reference distance. The method may include an operation of receiving, in response to the first signal, a second signal including the authentication information from the external electronic device (490). The method may include an operation of displaying a screen having a color related to the content within a mode for displaying the content that is executed based on the received second signal. The method may include an operation of adjusting an alpha value of the color based on a change in the distance from a first distance less than the first reference distance to a second distance less than the first distance while displaying the screen having the color. The method may include an operation of executing a software application for displaying the content based on the distance being less than a second reference distance less than the first reference distance.
[0201] In one embodiment, the first signal may cause the display of a visual object confirming that the content is provided to a user of the wearable device (103) via a display (520) of the external electronic device (490).
[0202] In one embodiment, the method may include an operation of determining whether the distance is less than the first reference distance. The method may include an operation of transmitting the first signal based on the distance being less than the first reference distance and the gaze direction of the user of the wearable device (103) being located within a specified range with respect to the external electronic device (490).
[0203] In one embodiment, the method may include an operation of displaying the screen having a first color when the content is first content. The method may include an operation of displaying the screen having a second color different from the first color when the content is second content different from the first content.
[0204] In one embodiment, the method may include, if the content is first content, displaying the screen further including a first visual object indicating that the content is first content. If the content is second content different from the first content, the method may include, if the content is second content, displaying the screen further including a second visual object indicating that the content is second content.
[0205] In one embodiment, the method may include an operation of displaying the screen rendered based on the alpha value having a first value when the distance is the first distance while displaying the screen. The method may include an operation of displaying the screen rendered based on the alpha value having a second value exceeding the first value when the distance is the second distance changed from the first distance while displaying the screen.
[0206] In one embodiment, the method may include an operation of changing the mode to another mode based on a change in the distance from the second distance to a third distance greater than or equal to the first reference distance while displaying the screen. The method may include an operation of ceasing the display of the color within the other mode.
[0207] According to one embodiment, the method may include an operation of tracking a gaze direction of a user of the wearable device (103). The method may include an operation of changing the mode to another mode when, while displaying the screen within the mode, the gaze direction is located outside a range specified with respect to the external electronic device (490). The method may include an operation of ceasing the display of the color within the other mode.
[0208] In one embodiment, the method may include displaying a screen including a visual object requesting execution of the software application based on successful authentication for access to the content using the authentication information. The method may include displaying the screen including the content while the software application is running.
[0209] The non-transitory computer-readable storage medium as described above may store one or more programs including instructions that, when individually or collectively executed by at least one processor (510) of a wearable device (103) including a communication circuit (530) and a display (520), cause the wearable device (103) to transmit, through the communication circuit (530), a first signal requesting authentication information of content to the external electronic device (490) in response to a distance between the wearable device (103) and the external electronic device (490) being less than a first reference distance. The non-transitory computer-readable storage medium may store one or more programs including instructions that, when individually or collectively executed by the at least one processor (510), cause the wearable device (103) to receive, in response to the first signal, a second signal including the authentication information from the external electronic device (490). The non-transitory computer-readable storage medium may store one or more programs including instructions that, when individually or collectively executed by the at least one processor (510), cause the wearable device (103) to display, through the display (520), a screen having a color related to the content in a mode for displaying the content executed based on the received second signal.The non-transitory computer-readable storage medium may store one or more programs including instructions that, when individually or collectively executed by the at least one processor (510), cause the wearable device (103) to adjust an alpha value of the color based on a change in the distance from a first distance less than the first reference distance to a second distance less than the first distance while displaying the screen having the color. The non-transitory computer-readable storage medium may store one or more programs including instructions that, when individually or collectively executed by the at least one processor (510), cause the wearable device (103) to execute a software application for displaying the content based on the distance being less than a second reference distance less than the first reference distance.
[0210] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.
[0211] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.
[0212] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0213] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.
[0214] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
[0215] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
Claims
1. In a wearable device (103), A memory (540) storing instructions and including one or more storage media; Communication circuit (530); display (520); and At least one processor (510) comprising a processing circuit; The above instructions, when individually or collectively executed by the at least one processor (510), cause the wearable device (103) to: In response to a distance between the wearable device (103) and the external electronic device (490) being less than a first reference distance, a first signal requesting authentication information of content is transmitted to the external electronic device (490) through the communication circuit (530); In response to the first signal, a second signal including the authentication information is received from the external electronic device (490); In a mode for displaying the content executed based on the received second signal, a screen having a color related to the content is displayed through the display (520); While displaying the screen having the color, adjusting the alpha value of the color based on the distance changing from a first distance less than the first reference distance to a second distance less than the first distance; and Causing a software application for displaying the content to be executed based on the distance being less than the second reference distance which is less than the first reference distance. Wearable device (103).
2. In claim 1, The first signal causes the display of a visual object confirming that the content is provided to the user of the wearable device (103) through the display (520) of the external electronic device (490). Wearable device (103).
3. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (510), cause the wearable device (103) to: determining whether the above distance is less than the first reference distance; and Causing the first signal to be transmitted based on the distance being less than the first reference distance and the gaze direction of the user of the wearable device (103) being located within a specified range with respect to the external electronic device (490). Wearable device (103).
4. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (510), cause the wearable device (103) to: If the above content is the first content, display the screen having the first color; and If the above content is a second content different from the first content, causing the screen to be displayed having a second color different from the first color. Wearable device (103).
5. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (510), cause the wearable device (103) to: If the content is the first content, displaying the screen further including a first visual object indicating that it is the first content; and If the content is a second content different from the first content, causing the screen to be displayed further including a second visual object indicating that it is the second content. Wearable device (103).
6. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (510), cause the wearable device (103) to: While displaying the above screen, if the distance is the first distance, display the screen rendered based on the alpha value having the first value; and While displaying the above screen, if the distance is the second distance changed from the first distance, causing the screen to be rendered based on the alpha value having the second value exceeding the first value, Wearable device (103).
7. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (510), cause the wearable device (103) to: While displaying the above screen, based on the distance changing from the second distance to a third distance greater than the first reference distance, changing the mode to another mode; and causing, within said other mode, the display of said color to be stopped; Wearable device (103).
8. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (510), cause the wearable device (103) to: Tracking the gaze direction of the user of the wearable device (103); While displaying the screen within the above mode, if the gaze direction is located outside the range specified for the external electronic device (490), the mode is changed to another mode; and causing, within said other mode, the display of said color to be stopped; Wearable device (103).
9. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (510), cause the wearable device (103) to: Displaying a screen including a visual object requesting execution of the software application based on successful authentication for access to the content using the above authentication information; and Causing the screen containing the content to be displayed while the software application is running; Wearable device (103).
10. In claim 1, Each of the wearable device (103) and the external electronic device (490) includes a device that provides an XR (extended reality) environment. Wearable device (103).
11. In a method performed by a wearable device (103), The above method: An operation of transmitting, through the communication circuit (530), a first signal requesting authentication information of content to the external electronic device (490) in response to a distance between the wearable device (103) and the external electronic device (490) being less than a first reference distance; In response to the first signal, an operation of receiving a second signal including the authentication information from the external electronic device (490); An action of displaying a screen having a color related to the content within a mode for displaying the content executed based on the received second signal; An operation of adjusting an alpha value of the color based on a change in the distance from a first distance less than the first reference distance to a second distance less than the first distance while displaying the screen having the color; and Including an action of executing a software application for displaying the content based on the distance being less than the second reference distance which is less than the first reference distance. method.
12. In claim 11, The first signal causes the display of a visual object confirming that the content is provided to the user of the wearable device (103) through the display (520) of the external electronic device (490). method.
13. In claim 11, The above method: An operation for determining whether the above distance is less than the first reference distance; and An operation of transmitting the first signal based on the distance being less than the first reference distance and the gaze direction of the user of the wearable device (103) being located within a specified range with respect to the external electronic device (490). method.
14. In claim 11, The above method: If the above content is the first content, an action of displaying the screen having the first color; and If the content is a second content different from the first content, the method comprises displaying the screen having a second color different from the first color. method.
15. A non-transitory computer-readable storage medium, when individually or collectively executed by at least one processor (510) of a wearable device (103) including a communication circuit (530) and a display (520), causes the wearable device (103) to: In response to a distance between the wearable device (103) and the external electronic device (490) being less than a first reference distance, a first signal requesting authentication information of content is transmitted to the external electronic device (490) through the communication circuit (530); In response to the first signal, a second signal including the authentication information is received from the external electronic device (490); In a mode for displaying the content executed based on the received second signal, a screen having a color related to the content is displayed through the display (520); While displaying the screen having the color, adjusting the alpha value of the color based on the distance changing from a first distance less than the first reference distance to a second distance less than the first distance; and storing one or more programs including instructions causing a software application for displaying the content to be executed based on the distance being less than the second reference distance which is less than the first reference distance; A non-transitory computer-readable storage medium.
Citation Information
Patent Citations
Contents synchronization apparatus and method for providing synchronized interaction
KR101763887B1
Controlling a media device using a mobile device
KR101837612B1
Method for proximity service data and an electronic device thereof
KR1020160063041A
Automated content scrolling
KR102305380B1
Method and device for encrypting or decrypting contents
KR102314646B1