Wearable electronic device and method for identifying controller by using wearable electronic device
By integrating wireless communication, sensors and recognition cameras in wearable electronic devices, using the LED's luminous cycle and turn-on time identification controller, the problem of error recognition between multiple devices is solved, and higher operational accuracy is achieved.
Patent Information
- Application Number
- CN202380062613.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-10-21
- Filing Date
- 2023-08-07
- Publication Date
- 2025-04-11
AI Technical Summary
The wearable electronic device may incorrectly identify other users' controllers between multiple devices and controllers, resulting in operational errors.
By equipping each wearable electronic device with a wireless communication module, a sensor module, an identification camera and a processor, identifying and distinguishing the controller associated with itself, the controller is identified using the light emitting period and the turn-on time of the LED.
Ensure that each wearable electronic device can only identify the controller associated with itself, prevent incorrect operational signal transmission, and improve the accuracy and reliability of the system.
Smart Images

Figure CN119816798A_ABST
Abstract
Description
Technical Field
[0001] Various embodiments of the present disclosure are directed to a wearable electronic device and a method for identifying at least one controller by using the wearable electronic device. Background Art
[0002] The use of electronic devices such as strip-type, foldable-type, rollable-type, slide-type, or wearable-type electronic devices has increased.
[0003] Wearable electronic devices have changed into various forms, such as augmented reality (AR) glasses in the form of glasses, virtual reality glasses, video see-through (VST) mixed reality (MR) glasses, or head mounted displays (HMD).
[0004] The wearable electronic device may visually provide information obtained by synthesizing an actually existing environment and / or a virtual object composed of graphics to the user through glasses (eg, a display). Summary of the invention
[0005] Technical issues The wearable electronic device may display virtual objects on glasses (eg, a display) to implement augmented reality and / or virtual reality.
[0006] The wearable electronic device enables a user to play games by using virtual objects displayed on the glasses. The wearable electronic device may be associated with a controller (or processor) including at least one light emitting diode (LED), and executes the virtual game displayed on the glasses according to the operation of the controller.
[0007] The wearable electronic device may perform an erroneous operation by recognizing the controller of another user when a controller associated with another user's wearable electronic device other than the controller associated with itself exists in a designated space.
[0008] For example, when a second controller associated with a second wearable electronic device approaches the first wearable electronic device while a game is being executed by the first wearable electronic device using the first controller, the first wearable electronic device may perform an erroneous operation by recognizing an operation signal of the second controller of the second wearable electronic device in addition to the first controller associated with itself.
[0009] Various embodiments of the present disclosure may provide a wearable electronic device that enables each wearable electronic device to identify a controller associated with itself among a plurality of wearable electronic devices and controllers.
[0010] The technical problems to be achieved in the present disclosure may not be limited to the above-mentioned technical problems, and other technical problems not mentioned may be clearly understood by those skilled in the art to which the present disclosure belongs through the following description.
[0011] Solution to the problem A wearable electronic device according to an embodiment of the present disclosure may include a wireless communication module, a sensor module, a first recognition camera and / or a second recognition camera, and a processor, wherein the processor is operably connected to the wireless communication module, the sensor module, the first recognition camera, and / or the second recognition camera. According to an embodiment, the processor may be configured to recognize that a first controller and a second controller are detected in a specified space through at least one of the first recognition camera and the second recognition camera, wherein each of the first controller and the second controller has an LED disposed therein. According to an embodiment, the processor may be configured to send a control signal to the first controller to cause the LED disposed in the first controller to operate at a first turn-on time. The processor may be configured to send a control signal to the second controller to cause the LED disposed in the second controller to operate at a second turn-on time.
[0012] According to an embodiment of the present disclosure, a method for identifying a first controller and a second controller by a wearable electronic device may include a processor identifying that the first controller and the second controller are detected in a specified space through at least one of a first recognition camera and a second recognition camera, wherein each of the first controller and the second controller has an LED disposed therein. According to an embodiment, the method may include the processor sending a control signal that causes the LED disposed in the first controller to operate at a first turn-on time to the first controller. According to an embodiment, the method may include the processor sending a control signal that causes the LED disposed in the second controller to operate at a second turn-on time to the second controller.
[0013] Advantageous Effects of the Invention According to various embodiments of the present disclosure, each wearable electronic device among multiple wearable electronic devices and controllers can identify a controller associated with itself, thereby preventing the corresponding wearable electronic device from erroneously identifying a controller of another user other than the controller associated with itself.
[0014] According to various embodiments of the present disclosure, a first controller of a first wearable electronic device and a second controller of a second wearable electronic device have the same LED light cycle and different turn-on time timings, so that the first wearable electronic device can identify the first controller based on the LED light cycle and the first turn-on time timing, and the second wearable electronic device can identify the second controller based on the LED light cycle and the second turn-on time timing.
[0015] Besides this, various effects directly or indirectly recognized through this document may be provided. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] Regarding the description of the drawings, the same or similar reference numerals may be used for the same or similar components.
[0017] Figure 1 is a block diagram of an electronic device in a network environment according to various embodiments of the present disclosure; Figure 2 is a perspective view schematically showing a configuration of a wearable electronic device according to an embodiment of the present disclosure; Figure 3 is a perspective view schematically illustrating a controller associated with a wearable electronic device according to an embodiment of the present disclosure; Figure 4 is a perspective view schematically illustrating a pair of controllers associated with a wearable electronic device according to an embodiment of the present disclosure; Figure 5 Schematically illustrates the turn-on time and light emission cycle of an LED of a controller associated with a wearable electronic device according to an embodiment of the present disclosure; Figure 6 Schematically illustrates an embodiment in which a wearable electronic device according to an embodiment of the present disclosure can recognize multiple controllers; Figure 7 Cases (a) to (d) illustrate an embodiment in which a wearable electronic device recognizes at least one controller according to an embodiment of the present disclosure; Figure 8 Cases (a) to (d) illustrate embodiments of operation time configurations when at least one of a first recognition camera or a second recognition camera of a wearable electronic device detects an LED provided in at least one controller according to an embodiment of the present disclosure; Fig. 9 An embodiment in which at least one of a first recognition camera or a second recognition camera of a wearable electronic device according to an embodiment of the present disclosure can detect a light emission pattern of an LED provided in at least one controller is shown; Fig.10Various embodiments are shown in which at least one of the first recognition camera or the second recognition camera of the wearable electronic device according to an embodiment of the present disclosure can detect a light emission pattern of an LED provided in at least one controller; Fig.11a An embodiment in which an accessory according to an embodiment of the present disclosure includes a first mode is shown; Fig.11b An embodiment in which the attachment according to an embodiment of the present disclosure includes a second mode is shown; Fig.11c illustrates various embodiments of patterns that may be arranged on an accessory according to embodiments of the present disclosure; and Fig.12 is a flowchart illustrating a method for recognizing at least one controller by a wearable electronic device by using at least one of a first recognition camera or a second recognition camera according to an embodiment of the present disclosure. DETAILED DESCRIPTION
[0018] Figure 1 is a block diagram illustrating an electronic device 101 in a network environment 100 according to various embodiments.
[0019] refer to Figure 1 , the electronic device 101 in the network environment 100 may communicate with the electronic device 102 via the first network 198 (e.g., a short-range wireless communication network), or communicate with at least one of the electronic device 104 or the server 108 via the second network 199 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 via the server 108. According to an embodiment, the electronic device 101 may include a processor 120, a memory 130, an input module 150, a sound output module 155, a display module 160, an audio module 170, a sensor module 176, an interface 177, a connection terminal 178, a haptic module 179, a camera module 180, a power management module 188, a battery 189, a communication module 190, a user identification module (SIM) 196, or an antenna module 197. In some embodiments, at least one of the above components (e.g., the connection terminal 178) may be omitted from the electronic device 101, or one or more other components may be added to the electronic device 101. In some embodiments, some of the above-described components (eg, sensor module 176, camera module 180, or antenna module 197) may be implemented as a single integrated component (eg, display module 160).
[0020] The processor 120 may run, for example, software (e.g., program 140) to control at least one other component (e.g., hardware component or software component) of the electronic device 101 connected to the processor 120, and may perform various data processing or calculations. According to one embodiment, as at least part of the data processing or calculation, the processor 120 may store a command or data received from another component (e.g., sensor module 176 or communication module 190) in the volatile memory 132, process the command or data stored in the volatile memory 132, and store the resultant data in the non-volatile memory 134. According to an embodiment, the processor 120 may include a main processor 121 (e.g., a central processing unit (CPU) or an application processor (AP)) or an auxiliary processor 123 (e.g., a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is independent of or combined with the main processor 121 in operation. For example, when the electronic device 101 includes a main processor 121 and an auxiliary processor 123, the auxiliary processor 123 may be adapted to consume less power than the main processor 121, or adapted to be dedicated to a specific function. The auxiliary processor 123 may be implemented separately from the main processor 121, or as part of the main processor 121.
[0021] When the main processor 121 is in an inactive (e.g., sleep) state, the auxiliary processor 123 (rather than the main processor 121) may control at least some of the functions or states related to at least one component among the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190), or when the main processor 121 is in an active state (e.g., running an application), the auxiliary processor 123 may control at least some of the functions or states related to at least one component among the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190) together with the main processor 121. According to an embodiment, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., a camera module 180 or a communication module 190) that is functionally related to the auxiliary processor 123. According to an embodiment, the auxiliary processor 123 (e.g., a neural processing unit) may include a hardware structure dedicated to artificial intelligence model processing. The artificial intelligence model may be generated through machine learning. For example, such learning may be performed by the electronic device 101 where the artificial intelligence is executed or via a separate server (e.g., server 108). The learning algorithm may include, but is not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, for example. The artificial intelligence model may include multiple artificial neural network layers. The artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), or a deep Q network or a combination of two or more thereof, but is not limited thereto. Additionally or optionally, the artificial intelligence model may include a software structure in addition to a hardware structure.
[0022] The memory 130 may store various data used by at least one component of the electronic device 101 (e.g., the processor 120 or the sensor module 176). The various data may include, for example, software (e.g., the program 140) and input data or output data for commands related thereto. The memory 130 may include a volatile memory 132 or a nonvolatile memory 134.
[0023] The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system (OS) 142 , middleware 144 , or applications 146 .
[0024] The input module 150 may receive commands or data to be used by other components (e.g., the processor 120) of the electronic device 101 from outside (e.g., a user) of the electronic device 101. The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus).
[0025] The sound output module 155 can output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or playing records. The receiver can be used to receive incoming calls. Depending on the embodiment, the receiver can be implemented as a separate part from the speaker, or as part of the speaker.
[0026] The display module 160 may visually provide information to the outside of the electronic device 101 (e.g., a user). The display device 160 may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling a corresponding one of the display, the holographic device, and the projector. According to an embodiment, the display module 160 may include a touch sensor adapted to detect a touch or a pressure sensor adapted to measure the strength of a force caused by a touch.
[0027] The audio module 170 may convert sound into an electrical signal, or vice versa. According to an embodiment, the audio module 170 may obtain sound via the input module 150, or output sound via the sound output module 155 or an earphone of an external electronic device (e.g., electronic device 102) directly (e.g., wired) or wirelessly connected to the electronic device 101.
[0028] The sensor module 176 may detect an operating state (e.g., power or temperature) of the electronic device 101 or an environmental state (e.g., a state of a user) outside the electronic device 101, and then generate an electrical signal or a data value corresponding to the detected state. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illumination sensor.
[0029] The interface 177 may support one or more specific protocols to be used to connect the electronic device 101 directly (e.g., wired) or wirelessly with an external electronic device (e.g., the electronic device 102). According to an embodiment, the interface 177 may include, for example, a high-definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.
[0030] The connection end 178 may include a connector, wherein the electronic device 101 can be physically connected to an external electronic device (e.g., the electronic device 102) via the connector. According to an embodiment, the connection end 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0031] The haptic module 179 may convert the electric signal into mechanical stimulation (eg, vibration or motion) or electric stimulation that can be recognized by the user via his sense of touch or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electric stimulator.
[0032] The camera module 180 may capture still images or moving images. According to an embodiment, the camera module 180 may include one or more lenses, an image sensor, an image signal processor, or a flash.
[0033] The power management module 188 may manage power supply to the electronic device 101. According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).
[0034] The battery 189 may power at least one component of the electronic device 101. According to an embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0035] The communication module 190 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108), and perform communication via the established communication channel. The communication module 190 may include one or more communication processors capable of operating independently from the processor 120 (e.g., an application processor (AP)) and supporting direct (e.g., wired) communication or wireless communication. According to an embodiment, the communication module 190 may include a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules can communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wireless Fidelity (Wi-Fi) Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a traditional cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules may be implemented as a single component (e.g., a single chip), or may be implemented as multiple components (e.g., multiple chips) separated from each other. The wireless communication module 192 may identify and authenticate the electronic device 101 in a communication network (such as the first network 198 or the second network 199) using user information (e.g., an International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196.
[0036] The wireless communication module 192 may support 5G networks after 4G networks and next generation communication technologies (e.g., new radio (NR) access technologies). NR access technologies may support enhanced mobile broadband (eMBB), massive machine type communications (mMTC), or ultra-reliable low latency communications (URLLC). The wireless communication module 192 may support high frequency bands (e.g., millimeter wave bands) to achieve, for example, high data transmission rates. The wireless communication module 192 may support various technologies for ensuring performance on high frequency bands, such as, for example, beamforming, massive multiple input multiple output (massive MIMO), full dimensional MIMO (FD-MIMO), array antennas, analog beamforming, or massive antennas. The wireless communication module 192 may support various requirements specified in the electronic device 101, an external electronic device (e.g., electronic device 104), or a network system (e.g., a second network 199). According to an embodiment, the wireless communication module 192 may support a peak data rate for implementing eMBB (e.g., 20 Gbps or greater), loss coverage for implementing mMTC (e.g., 164 dB or less), or U-plane delay for implementing URLLC (e.g., 0.5 ms or less for each of the downlink (DL) and uplink (UL), or 1 ms or less for a round trip).
[0037] The antenna module 197 may transmit or receive a signal or power to or from the outside of the electronic device 101 (e.g., an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a radiation element formed of a conductive material or a conductive pattern formed in or on a substrate (e.g., a printed circuit board (PCB)). According to an embodiment, the antenna module 197 may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication scheme used in a communication network (such as the first network 198 or the second network 199) may be selected from the plurality of antennas by, for example, the communication module 190 (e.g., the wireless communication module 192). A signal or power may then be transmitted or received between the communication module 190 and the external electronic device via the selected at least one antenna. According to an embodiment, another component (e.g., a radio frequency integrated circuit (RFIC)) other than the radiation element may be additionally formed as a part of the antenna module 197.
[0038] According to various embodiments, the antenna module 197 may form a millimeter wave antenna module. According to an embodiment, the millimeter wave antenna module may include a printed circuit board, a radio frequency integrated circuit (RFIC), and a plurality of antennas (e.g., array antennas), wherein the RFIC is disposed on a first surface (e.g., bottom surface) of the printed circuit board, or adjacent to the first surface and capable of supporting a designated high frequency band (e.g., millimeter wave band), and the plurality of antennas are disposed on a second surface (e.g., top surface or side surface) of the printed circuit board, or adjacent to the second surface and capable of transmitting or receiving signals of the designated high frequency band.
[0039] At least some of the above components may be connected to each other via an inter-peripheral communication scheme (e.g., a bus, a general purpose input output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)) and communicatively transfer signals (e.g., commands or data) therebetween.
[0040] According to an embodiment, a command or data may be sent or received between the electronic device 101 and the external electronic device 104 via the server 108 connected to the second network 199. Each of the electronic device 102 or the electronic device 104 may be a device of the same type as the electronic device 101, or a device of a different type from the electronic device 101. According to an embodiment, all or some operations to be executed in the electronic device 101 may be executed in one or more of the external electronic device 102, the external electronic device 104, or the server 108. For example, if the electronic device 101 should automatically execute a function or service or should execute a function or service in response to a request from a user or another device, the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service instead of executing the function or service, or the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service in addition to executing the function or service. The one or more external electronic devices receiving the request may execute at least part of the requested function or service, or execute another function or another service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may provide the result as at least a partial reply to the request with or without further processing the result. To this end, cloud computing technology, distributed computing technology, mobile edge computing (MEC) technology, or client-server computing technology, for example, may be used. The electronic device 101 may use, for example, distributed computing or mobile edge computing to provide ultra-low latency services. In another embodiment, the external electronic device 104 may include an Internet of Things (IoT) device. The server 108 may be an intelligent server using machine learning and / or neural networks. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199. The electronic device 101 may be applied to intelligent services (e.g., smart homes, smart cities, smart cars, or healthcare) based on 5G communication technology or IoT-related technologies.
[0041] The electronic device according to various embodiments may be one of various types of electronic devices. The electronic device may include, for example, a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a household appliance. According to an embodiment of the present disclosure, the electronic device is not limited to those electronic devices described above.
[0042] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, but include various changes, equivalent forms or alternative forms for the corresponding embodiments. For the description of the accompanying drawings, similar reference numerals may be used to refer to similar or related elements. It will be understood that the nouns in the singular form corresponding to the term may include one or more things unless the relevant context clearly indicates otherwise. As used herein, each of the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "at least one of A, B or C" may include any one or all possible combinations of the items listed together with the corresponding one of the multiple phrases. As used herein, terms such as "1st" and "2nd" or "first" and "second" may be used to simply distinguish the corresponding component from another component, and do not limit the component in other aspects (e.g., importance or order). It will be understood that if an element (e.g., a first element) is referred to as being “coupled with another element (e.g., the second element)”, “coupled to another element (e.g., the second element)”, “connected with another element (e.g., the second element)”, or “connected to another element (e.g., the second element)” with or without the terms “operably” or “communicatively” being used, it means that the element may be directly (e.g., wired) connected to the other element, wirelessly connected to the other element, or connected to the other element via a third element.
[0043] As used in connection with various embodiments of the present disclosure, the term "module" may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "portion," or "circuit"). A module may be a single integrated component adapted to perform one or more functions or a minimum unit or portion of the single integrated component. For example, according to an embodiment, a module may be implemented in the form of an application specific integrated circuit (ASIC).
[0044] The various embodiments described herein may be implemented as software (e.g., program 140) including one or more instructions stored in a storage medium (e.g., internal memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). For example, under the control of a processor, a processor (e.g., processor 120) of the machine (e.g., electronic device 101) may call at least one of the one or more instructions stored in the storage medium and execute the at least one instruction with or without the use of one or more other components. This enables the machine to operate to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Among them, the term "non-transitory" only means that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but the term does not distinguish between data being semi-permanently stored in the storage medium and data being temporarily stored in the storage medium.
[0045] According to an embodiment, the method according to various embodiments of the present disclosure may be included and provided in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be published in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)), or may be published online (e.g., downloaded or uploaded) via an application store (e.g., Play StoreTM), or may be distributed (e.g., downloaded or uploaded) directly between two user devices (e.g., smart phones). If published online, at least part of the computer program product may be temporarily generated, or at least part of the computer program product may be at least temporarily stored in a machine-readable storage medium (such as a manufacturer's server, an application store's server, or a memory of a forwarding server).
[0046] According to various embodiments, each of the above-mentioned components (e.g., a module or a program) may include a single entity or multiple entities, and some of the multiple entities may be separately arranged in different components. According to various embodiments, one or more of the above-mentioned components may be omitted, or one or more other components may be added. Alternatively or additionally, multiple components (e.g., a module or a program) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform the one or more functions of each of the multiple components in the same or similar manner as a corresponding one of the multiple components performing one or more functions before integration. According to various embodiments, the operations performed by a module, a program or another component may be performed sequentially, in parallel, repeatedly or in a heuristic manner, or one or more of the operations may be run or omitted in a different order, or one or more other operations may be added.
[0047] Figure 2 is a perspective view schematically illustrating a configuration of a wearable electronic device according to various embodiments of the present disclosure.
[0048] Figure 2 The wearable electronic device 200 may include a Figure 1 The wearable electronic device 200 may include one of augmented reality (AR) glasses (eg, an AR device), virtual reality glasses (eg, a VR device), video see-through (VST) mixed reality (MR) glasses, and a head mounted display (HMD).
[0049] refer to Figure 2 According to various embodiments of the present disclosure, the wearable electronic device 200 may include a nose bridge 201, a first lens ring 210, a second lens ring 220, a first stud 230, a second stud 240, a first temple 250 and / or a second temple 260.
[0050] According to an embodiment, the nose bridge 201 may connect the first frame 210 and the second frame 220. The nose bridge 201 may be formed of a non-conductive material (e.g., a polymer) and / or a conductive material (e.g., a metal). The first frame 210 and the second frame 220 may be formed of a non-conductive material (e.g., a polymer) and / or a conductive material (e.g., a metal). When a user wears the wearable electronic device 200, the nose bridge 201 may be located above the user's nose. The nose bridge 201 may separate the first frame 210 and the second frame 220 with reference to the user's nose.
[0051] According to various embodiments, the nose bridge 201 may include a camera module 203 , a first gaze tracking camera 205 , a second gaze tracking camera 207 , and / or an audio module 209 .
[0052] According to various embodiments, the camera module 203 (eg, Figure 1 The camera module 180 of the wearable electronic device 200 may capture the front (e.g., -y axis direction) of the user (e.g., the user of the wearable electronic device 200) and obtain image data. The camera module 203 may capture an image corresponding to the field of view (FoV) of the user or measure the distance to the subject (e.g., the object). The camera module 203 may include an RGB camera, a high resolution (HR) camera, and / or a photo video (PV) camera. The camera module 203 may include a color camera with an auto focus (AF) function and an optical image stabilization (OIS) function in order to obtain high-quality images.
[0053] According to various embodiments, the first gaze tracking camera 205 and the second gaze tracking camera 207 may recognize the gaze of the user. The first gaze tracking camera 205 and the second gaze tracking camera 207 may capture the user's pupil in a direction opposite to the capturing direction of the camera module 203. For example, the first gaze tracking camera 205 may partially capture the user's left eye, and the second gaze tracking camera 207 may partially capture the user's right eye. The first gaze tracking camera 205 and the second gaze tracking camera 207 may detect the user's pupil (e.g., left eye and right eye) and track the gaze direction. The tracked gaze direction may be used to move the center of a virtual image including a virtual object to correspond to the gaze direction. The first gaze tracking camera 205 and / or the second gaze tracking camera 207 may track the user's gaze by using, for example, at least one of an electrooculogram or an electrooculogram (EOG) sensor, a coil system, a dual Purkinje system, a bright pupil system, or a dark pupil system.
[0054] According to various embodiments, the audio module 209 (eg, Figure 1 The audio module 209 may be disposed between the first gaze tracking camera 205 and the second gaze tracking camera 207. The audio module 209 may convert the user's voice into an electrical signal or convert the electrical signal into sound. The audio module 209 may include a microphone.
[0055] According to an embodiment, the first lens ring 210 and the second lens ring 220 may configure a frame (e.g., a glasses frame) of the wearable electronic device 200 (e.g., AR glasses). The first lens ring 210 may be disposed in a first direction (e.g., x-axis direction) of the nose bridge 201. The first lens ring 210 may be disposed at a position corresponding to the left eye of the user. The second lens ring 220 may be disposed in a second direction (e.g., -x-axis direction) of the nose bridge 201 opposite to the first direction (e.g., x-axis direction). The second lens ring 220 may be disposed at a position corresponding to the right eye of the user.
[0056] According to various embodiments, the first lens bezel 210 may surround and support at least a portion of a first lens 215 (e.g., a first display) disposed on its inner circumferential surface. The first lens 215 may be located in front of the user's left eye. The second lens bezel 220 may surround and support at least a portion of a second lens 225 (e.g., a second display) disposed on its inner circumferential surface. The second lens 225 may be located in front of the user's right eye. The user of the wearable electronic device 200 may view a foreground (e.g., a real image) for an external object (e.g., a subject) through the first lens 215 and the second lens 225. The wearable electronic device 200 may implement augmented reality by overlaying and displaying a virtual image on the foreground (e.g., a real image) for an external object.
[0057] According to various embodiments, the first lens 215 and the second lens 225 may include a projection-type transparent display. Each of the first lens 215 and the second lens 225 may form a reflective surface as a transparent plate (or a transparent screen), and the image generated by the wearable electronic device 200 may be reflected (e.g., total internal reflection) by the reflective surface and incident to the left and right eyes of the user. In an embodiment, the first lens 215 may include an optical waveguide, wherein the optical waveguide transmits the light generated from the light source of the wearable electronic device 200 to the left eye of the user. For example, the optical waveguide may be formed of glass, plastic, or a polymer material, and may include a nano pattern (e.g., a polygonal or curved grating structure or a mesh structure) formed on the inner side or surface of the first lens 215. The optical waveguide may include at least one of at least one diffractive element (e.g., a diffractive optical element (DOE) or a holographic optical element (HOE)) or a reflective element (e.g., a reflector). The optical waveguide may guide the display light emitted from the light source to the user's eyes by using at least one diffractive element or a reflective element included in the optical waveguide. In various embodiments, the diffractive element may include an input / output optical member, and the reflective element may include total internal reflection (TIR). For example, the optical path of light emitted from the light source may be guided to the light waveguide through the input optical member, and the light moving inside the light waveguide may be guided in a direction toward the user's eyes through the output optical member. The second lens 225 may be implemented in substantially the same manner as the first lens 215.
[0058] According to various embodiments, each of the first lens 215 and the second lens 225 may include Figure 1. The first lens 215 and the second lens 225 may include, for example, a liquid crystal display (LCD), a digital mirror device (DMD), a liquid crystal on silicon (LCoS), an organic light emitting diode (OLED), or a micro light emitting diode (microLED). Although not shown, when the first lens 215 and the second lens 225 are configured by one of a liquid crystal display, a digital mirror display, or a liquid crystal on silicon, the wearable electronic device 200 may include a light source, wherein the light source emits light to the screen output area of the first lens 215 and the second lens 225. In another embodiment, when the first lens 215 and the second lens 225 can generate light by themselves, for example, when the first lens and the second lens are made of an organic light emitting diode or a microLED, the wearable electronic device 200 can provide a virtual image with good quality to the user even without a separate light source. In various embodiments, the first lens 215 and the second lens 225 may be formed of a glass plate, a plastic plate, or a polymer. The first lens 215 and the second lens 225 may be configured to be transparent or opaque.
[0059] According to various embodiments, the first lens bezel 210 may include a first microphone 211, a first recognition camera 213, a first light emitting device 217, and / or a first display module 219. The second lens bezel 220 may include a second microphone 221, a second recognition camera 223, a second light emitting device 227, and / or a second display module 229.
[0060] In various embodiments, the first light emitting device 217 and the first display module 219 may be included in the first head 230 , and the second light emitting device 227 and the second display module 229 may be included in the second head 240 .
[0061] According to various embodiments, the first microphone 211 and / or the second microphone 221 may receive a voice of a user of the wearable electronic device 200 and convert the voice into an electrical signal.
[0062] According to various embodiments, the first recognition camera 213 and / or the second recognition camera 223 may recognize the peripheral space of the wearable electronic device 200. The first recognition camera 213 and / or the second recognition camera 223 may detect a gesture of a user (e.g., a controller) within a predetermined distance (e.g., a predetermined space) of the wearable electronic device 200. The first recognition camera 213 and / or the second recognition camera 223 may include a global shutter (GS) camera, wherein a rolling shutter (RS) phenomenon may be reduced by the GS camera, so as to detect and track a quick gesture of a user (e.g., a controller) and / or a minute movement of a finger of the user. The wearable electronic device 200 may detect an eye corresponding to a dominant eye and / or a non-dominant eye in the left eye and / or the right eye of the user by using the first gaze tracking camera 205, the second gaze tracking camera 207, the first recognition camera 213, and / or the second recognition camera 223. For example, the wearable electronic device 200 may detect an eye corresponding to a dominant eye and / or a non-dominant eye based on a gaze direction of the user for an external object or a virtual object.
[0063] According to various embodiments, the first light emitting device 217 and / or the second light emitting device 227 may emit light to improve the accuracy of the camera module 203, the first gaze tracking camera 205, the second gaze tracking camera 207, the first recognition camera 213, and / or the second recognition camera 223. The first light emitting device 217 and / or the second light emitting device 227 may be used as an auxiliary device for improving the accuracy when photographing the pupil of the user by using the first gaze tracking camera 205 and / or the second gaze tracking camera 207. When photographing the gesture of the user using the first recognition camera 213 and / or the second recognition camera 223, the first light emitting device 217 and / or the second light emitting device 227 may be used as an auxiliary device when it is not easy to detect the object to be photographed (e.g., the subject) due to the mixture of reflected light and various light sources or a dark environment. The first light emitting device 217 and / or the second light emitting device 227 may include, for example, an LED, an IR LED, or a xenon lamp.
[0064] According to various embodiments, the first display module 219 and / or the second display module 229 may emit light and transmit the light to the left eye and / or the right eye of the user by using the first lens 215 and / or the second lens 225. The first lens 215 and / or the second lens 225 may display various image information by using the light emitted by the first display module 219 and / or the second display module 229. The first display module 219 and / or the second display module 229 may include Figure 1 The wearable electronic device 200 may overlap and display an image emitted by the first display module 219 and / or the second display module 229 and a foreground for an external object through the first lens 215 and / or the second lens 225.
[0065] According to an embodiment, the first stud 230 may be coupled to a portion of the first lens ring 210 (e.g., in the x-axis direction). The second stud 240 may be coupled to a portion of the second lens ring 220 (e.g., in the −x-axis direction). In various embodiments, the first light emitting device 217 and the first display module 219 may be included in the first stud 230. The second light emitting device 227 and the second display module 229 may be included in the second stud 240.
[0066] According to various embodiments, the first stud 230 may connect the first rim 210 and the first temple 250 , and the second stud 240 may connect the second rim 220 and the second temple 260 .
[0067] According to an embodiment, the first temple 250 may be operably connected to the first stud 230 by using the first hinge part 255. The first hinge part 255 may be rotatably configured so that the first temple 250 is folded or unfolded relative to the first lens ring 210. For example, the first temple 250 may extend along the left side of the user's head. When the user wears the wearable electronic device 200, the distal end portion (e.g., y-axis direction) of the first temple 250 may be configured, for example, in a curved shape to be supported by the user's left ear. The second temple 260 may be operably connected to the second stud 240 by using the second hinge part 265. The second hinge part 265 may be rotatably configured so that the second temple 260 is folded or unfolded relative to the second lens ring 220. For example, the second temple 260 may extend along the right side of the user's head. When the user wears the wearable electronic device 200, the distal end portion (e.g., y-axis direction) of the second temple 260 may be configured, for example, in a curved shape to be supported by the user's right ear.
[0068] According to various embodiments, the first temple 250 may include a first printed circuit board 251, a first sound output module 253 (eg, Figure 1 The sound output module 155) and / or the first battery 257 (eg, Figure 1 The second temple 260 may include a second printed circuit board 261, a second sound output module 263 (eg, Figure 1 The sound output module 155) and / or the second battery 267 (eg, Figure 1 Battery 189).
[0069] According to various embodiments, such as Figure 1 The various electronic components (e.g., included in the processor 120, memory 130, sensor module 176, interface 177 and / or wireless communication module 192) shown in Figure 1At least some of the components in the electronic device 101 of the present invention) may be arranged on the first printed circuit board 251 and / or the second printed circuit board 261. The processor may include, for example, one or more of a central processing unit, an application processor, a graphics processing unit, an image signal processor, a sensor hub processor, or a communication processor. The first printed circuit board 251 and / or the second printed circuit board 261 may include, for example, a printed circuit board (PCB), a flexible PCB (FPCB), or a rigid-flexible PCB (RFPCB). In some embodiments, the first printed circuit board 251 and / or the second printed circuit board 261 may include a main PCB, a slave PCB arranged to partially overlap with the main PCB, and / or an interposer substrate between the main PCB and the slave PCB. The first printed circuit board 251 and / or the second printed circuit board 261 may be electrically connected to other components (e.g., the camera module 203, the first gaze tracking camera 205, the second gaze tracking camera 207, the audio module 209, the first microphone 211, the first recognition camera 213, the first light-emitting device 217, the first display module 219, the second microphone 221, the second recognition camera 223, the second light-emitting device 227, the second display module 229, the first sound output module 253, and / or the second sound output module 263) by using an electrical path such as an FPCB and / or a cable. For example, the FPCB and / or the cable may be provided in at least a portion of the first bezel 210, the nose bridge 201, and / or the second bezel 220. In some embodiments, the wearable electronic device 200 may include only one of the first printed circuit board 251 or the second printed circuit board 261.
[0070] According to various embodiments, the first sound output module 253 and / or the second sound output module 263 may send an audio signal to the left ear and / or the right ear of the user. The first sound output module 253 and / or the second sound output module 263 may include, for example, a piezoelectric speaker (e.g., a bone conduction speaker) that sends an audio signal without a speaker hole. In some embodiments, the wearable electronic device 200 may include only one of the first sound output module 253 or the second sound output module 263.
[0071] According to various embodiments, the first battery 257 and / or the second battery 267 may be powered by using a power management module (e.g., Figure 1 The power management module 188 of the wearable electronic device 200 supplies power to the first printed circuit board 251 and / or the second printed circuit board 261. The first battery 257 and / or the second battery 267 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell. In some embodiments, the wearable electronic device 200 may include only one of the first battery 257 or the second battery 267.
[0072] According to various embodiments, the wearable electronic device 200 may include a sensor module (eg, Figure 1 The sensor module 176 of the wearable electronic device 200). The sensor module may generate an electrical signal or data value corresponding to the internal operating state or the external environmental state of the wearable electronic device 200. The sensor module may include, for example, at least one of a gesture sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a color sensor, an infrared (IR) sensor, a biometric sensor (e.g., an HRM sensor), a temperature sensor, a humidity sensor, an inertial measurement (IMU) sensor, or an illumination sensor. In some embodiments, the sensor module may identify the user's biometric information by using various biosensors (or biometric sensors) such as an olfactory sensor (electronic nose sensor), an electromyography sensor (EMG sensor), an electroencephalography sensor (EEG sensor), an electrocardiography sensor (ECG sensor), or an iris sensor.
[0073] According to various embodiments, the wearable electronic device 200 may display a virtual object through the first lens 215 and the second lens 225 to implement augmented reality and / or virtual reality.
[0074] Figure 3 is a perspective view schematically illustrating a controller associated with a wearable electronic device according to an embodiment of the present disclosure. Figure 4 is a perspective view schematically illustrating a pair of controllers associated with a wearable electronic device according to an embodiment of the present disclosure.
[0075] According to an embodiment, the controller 300 may include Figure 1 , the processor 120, the memory 130, the program 140, the input module 150, the sound output module 155, the sensor module 176, the battery 189 and / or the wireless communication module 192 of the electronic device 101 shown in .
[0076] According to an embodiment, the controller 300 may operate in association with the wearable electronic device 200. The controller 300 may send a signal to the wearable electronic device 200 or receive a signal from the wearable electronic device 200 via wireless communication. The wireless communication may include one of WiFi, Bluetooth, or millimeter waves. The controller 300 may send a key input signal and motion data to the wearable electronic device 200. The controller 300 may receive a control signal from the wearable electronic device 200.
[0077] According to an embodiment, the controller 300 may play (or control) a game through a game screen displayed through the first lens 215 (e.g., first display) and the second lens 225 (e.g., second display) of the wearable electronic device 200. The wearable electronic device 200 may differently configure the game screen displayed through the first lens 215 and the second lens 225 based on a control operation of the controller 300. The controller 300 may be a handle capable of controlling the game screen of the wearable electronic device 200. The controller 300 may use a visual manner.
[0078] refer to Figure 3 , the controller 300 according to an embodiment of the present disclosure may include a first housing 301 and a second housing 302. The first housing 301 and the second housing 302 may be integrally connected.
[0079] According to an embodiment, the first shell 301 may include an LED 310. At least one LED 310 may be disposed in the first shell 301. A plurality of LEDs 310 may be disposed in the first shell 301. The LED 310 may be disposed in the first shell 301 to be detected by the first recognition camera 213 and / or the second recognition camera 223 of the wearable electronic device 200. For example, a portion of the LED 310 may be disposed on the outer surface of the first shell 301, and the other portion of the LED 310 may be disposed on the inner surface of the first shell 301. The LED 310 may be turned on or off in a specified mode. The LED 310 may be repeatedly turned on and off in a predetermined cycle to reduce current consumption. The on time and off time of the LED 310 may be changed.
[0080] According to an embodiment, the second housing 302 may include an on / off button 320, a menu button 330, a joystick 340, and / or a touch pad 350. The on / off button 320 may turn the controller 300 on or off. The menu button 330 may be used when calling up a menu displayed through the first lens 215 (e.g., the first display) and the second lens 225 (e.g., the second display) of the wearable electronic device 200. The joystick 340 may be used when performing operations (e.g., movement and rotation) of a game displayed through the first lens 215 and the second lens 225 of the wearable electronic device 200. The touch pad 350 may be used when inputting an operation signal necessary for playing a game displayed through the first lens 215 and the second lens 225 of the wearable electronic device 200. In various embodiments, the configuration included in the second housing 302 is not limited to the above-mentioned example, and may include various other configurations.
[0081] According to various embodiments, the controller 300 may have a printed circuit board (not shown) disposed inside the second housing 302. Figure 1Electronic components with functions substantially the same as those of the processor 120, memory 130, input module 150, sound output module 155, sensor module 176, battery 189 or wireless communication module 192 of the electronic device 101 shown in the figure may be arranged on a printed circuit board of the controller 300.
[0082] refer to Figure 4 , the controller 300 associated with the wearable electronic device 200 may include a controller 361 that can be manipulated by the user by using the right hand, and a controller 362 that can be manipulated by the user by using the left hand.
[0083] According to an embodiment, each of the controller 361 capable of being manipulated by the user by using the right hand and the controller 362 capable of being manipulated by the user by using the left hand may include Figure 3 The wearable electronic device 200 may perform operations associated with at least one of the controller 361 and the controller 362.
[0084] Figure 5 The diagram schematically illustrates the turn-on time and light emission period of an LED of a controller associated with a wearable electronic device according to an embodiment of the present disclosure.
[0085] refer to Figure 5 , the LED 310 provided in the controller 300 may be repeatedly turned on and off at a predetermined cycle to reduce current consumption. The LED 310 may be operated at substantially the same light emission cycle (e.g., a1). For example, the LED 310 may be operated at a light emission cycle of approximately 33 ms. The LED 310 may be repeatedly turned on and off at substantially the same time interval (e.g., t1). For example, the LED 310 may be repeatedly turned on and off at a time interval of approximately 20 μs.
[0086] Figure 6 An embodiment in which a wearable electronic device according to an embodiment of the present disclosure can recognize multiple controllers is schematically shown.
[0087] refer to Figure 6 , user 1 may use a first wearable electronic device 200a associated with a first controller 300a. User 2 may use a second wearable electronic device 200b associated with a second controller 300b. User 3 may use a third wearable electronic device 200c associated with a third controller 300c. User 4 may use a fourth wearable electronic device 200d associated with a fourth controller 300d.
[0088] In various embodiments, when user 5 is present, user 5 may use, for example, a fifth wearable electronic device (not shown) associated with a fifth controller (not shown). User 1 to User 5 are examples, and there may be more or fewer users.
[0089] According to an embodiment, the first wearable electronic device 200a, the second wearable electronic device 200b, the third wearable electronic device 200c, or the fourth wearable electronic device 200d may include Figure 1 The first wearable electronic device 200a, the second wearable electronic device 200b, the third wearable electronic device 200c, or the fourth wearable electronic device 200d may include a configuration substantially the same as at least some of the embodiments described in the electronic device 101 shown in FIG. Figure 2 The wearable electronic device 200 shown in FIG. 1 may have substantially the same configuration as at least some of the embodiments described in the embodiments. In an embodiment, the first wearable electronic device 200a may be Figure 1 In the embodiment, the second wearable electronic device 200b, the third wearable electronic device 200c or the fourth wearable electronic device 200d may be Figure 1 The external electronic device 102 or 104 shown in FIG. Figure 6 In the description of Figure 1 An embodiment of the electronic device 101 or Figure 2 Components of the embodiment of the wearable electronic device 200 that are substantially the same are given similar reference numerals, and redundant descriptions will be omitted. According to various embodiments, the first wearable electronic device 200a, the second wearable electronic device 200b, the third wearable electronic device 200c, and / or the fourth wearable electronic device 200d described below may perform substantially the same functions, with only different reference numerals.
[0090] According to an embodiment, the first wearable electronic device 200a used by the user 1 may be used as a server. For example, the first wearable electronic device 200a may be used as a host of the second wearable electronic device 200b, the third wearable electronic device 200c, and / or the fourth wearable electronic device 200d. The first wearable electronic device 200a may send a control signal to the first controller 300a, the second wearable electronic device 200b, the second controller 300b, the third wearable electronic device 200c, the third controller 300c, the fourth wearable electronic device 200d, and / or the fourth controller 300d. For example, the control signal sent from the first wearable electronic device 200a may include a signal for controlling the turn-on time and the light-emitting period of the LED 310 set in each of the first controller 300a, the second controller 300b, the third controller 300c, and the fourth controller 300d. The first wearable electronic device 200a may control the turn-on time and operation cycle of the first recognition camera 213 and the second recognition camera 223 based on the turn-on time and the light emission cycle of the LED 310 set in each of the first controller 300a, the second controller 300b, the third controller 300c, and the fourth controller 300d. In an embodiment, the timing at which the third recognition camera 213a and the fourth recognition camera 223b of the second wearable electronic device 200b are operated, the timing at which the fifth recognition camera 213c and the sixth recognition camera 223d of the third wearable electronic device 200c are operated, and / or the timing at which the seventh recognition camera 213e and the eighth recognition camera 223f of the fourth wearable electronic device 200d are operated may be controlled by using a control signal transmitted from the first wearable electronic device 200a. In an embodiment, the first wearable electronic device 200a may receive information transmitted from the second wearable electronic device 200b, the third wearable electronic device 200c, and / or the fourth wearable electronic device 200d.
[0091] According to various embodiments, the LED 310 provided in each of the first controller 300a, the second controller 300b, the third controller 300c, and the fourth controller 300d may perform an operation based on a control signal transmitted from the first wearable electronic device 200a. The third recognition camera 213a and the fourth recognition camera 223b of the second wearable electronic device 200b, the fifth recognition camera 213c and the sixth recognition camera 223d of the third wearable electronic device 200c, and the seventh recognition camera 213e and / or the eighth recognition camera 223f of the fourth wearable electronic device 200d may perform an operation based on a control signal transmitted from the first wearable electronic device 200a.
[0092] According to an embodiment, the first wearable electronic device 200a (eg, Figure 2The wearable electronic device 200 may detect movement and position of the first controller 300a, the second controller 300b, the third controller 300c, and / or the fourth controller 300d through at least one of the first recognition camera 213 and the second recognition camera 223.
[0093] According to an embodiment, the first wearable electronic device 200a may detect the turning on and / or off of the LED 310 set in each of the first controller 300a, the second controller 300b, the third controller 300c, and / or the fourth controller 300d through the first recognition camera 213 and / or the second recognition camera 223, and recognize the position of the first controller 300a, the second controller 300b, the third controller 300c, and / or the fourth controller 300d. In various embodiments, each of the first controller 300a, the second controller 300b, the third controller 300c, and / or the fourth controller 300d may include an inertial measurement sensor, and the angular velocity and acceleration of the first controller 300a, the second controller 300b, the third controller 300c, and / or the fourth controller 300d are sent to the first wearable electronic device 200a. In various embodiments, the first controller 300a, the second controller 300b, the third controller 300c, and / or the fourth controller 300d may include Figure 1 The sensor module 176 shown in FIG.
[0094] According to an embodiment, the first wearable electronic device 200a may recognize the movement and position of the first controller 300a through the first recognition camera 213 and / or the second recognition camera 223. The first wearable electronic device 200a may receive information related to the movement and position of the second controller 300b through the second wearable electronic device 200b. The first wearable electronic device 200a may receive information related to the movement and position of the third controller 300c through the third wearable electronic device 200c. The first wearable electronic device 200a may receive information related to the movement and position of the fourth controller 300d through the fourth wearable electronic device 200d. According to an embodiment, the first wearable electronic device 200a may receive information related to the movement and position of the fourth controller 300d through the sensor module (e.g., Figure 1 The sensor module 176 of the first wearable electronic device 200a can detect the movement and position of the first controller 300a, the second controller 300b, the third controller 300c, and / or the fourth controller 300d. For example, the sensor module 176 of the first wearable electronic device 200a can include an inertial measurement sensor, wherein the inertial measurement sensor is configured to measure the angular velocity and acceleration of the first controller 300a, the second controller 300b, the third controller 300c, and / or the fourth controller 300d.
[0095] According to various embodiments, each of the first controller 300a, the second controller 300b, the third controller 300c, and the fourth controller 300d may include an inertial measurement sensor, and measured information may be transmitted to at least one of the first to fourth wearable electronic devices 200a to 200d.
[0096] According to an embodiment, the sensor module 176 of the first wearable electronic device 200a may include a global positioning system (GPS) sensor configured to detect the location of the first controller 300a, the second controller 300b, the third controller 300c and / or the fourth controller 300d.
[0097] According to various embodiments, each of the first controller 300a, the second controller 300b, the third controller 300c, and the fourth controller 300d may include a GPS sensor, and measured information may be transmitted to at least one of the first to fourth wearable electronic devices 200a to 200d.
[0098] According to an embodiment, the first wearable electronic device 200a can detect at least one of the light cycle, turn-on time (e.g., light timing) and light pattern of the LED 310 set in each of the first controller 300a, the second controller 300b, the third controller 300c and / or the fourth controller 300d through the first recognition camera 213 and / or the second recognition camera 223. The first wearable electronic device 200a can detect the light cycle, turn-on time and / or light pattern of the LED 310 set in each of the first controller 300a, the second controller 300b, the third controller 300c and / or the fourth controller 300d through the first recognition camera 213 and / or the second recognition camera 223, and identify the first controller 300a, the second controller 300b, the third controller 300c and / or the fourth controller 300d.
[0099] According to an embodiment, the first wearable electronic device 200a may receive designated information (eg, movement and location signals) from the second wearable electronic device 200b, the third wearable electronic device 200c, and / or the fourth wearable electronic device 200d.
[0100] The first wearable electronic device 200a may present information received from the second wearable electronic device 200b, the third wearable electronic device 200c and / or the fourth wearable electronic device 200d, and then send visual data, audio data and / or control signals to the second wearable electronic device 200b, the third wearable electronic device 200c and / or the fourth wearable electronic device 200d.
[0101] According to an embodiment, the first recognition camera 213 and / or the second recognition camera 223 may recognize the peripheral space of the first wearable electronic device 200a. The first recognition camera 213 and / or the second recognition camera 223 may detect the movement and position of the first controller 300a, the second controller 300b, the third controller 300c, and / or the fourth controller 300d within a predetermined distance (e.g., a predetermined space) of the first wearable electronic device 200a. The first recognition camera 213 and / or the second recognition camera 223 may include a global shutter (GS) camera, wherein a rolling shutter (RS) phenomenon may be reduced by the GS camera, so as to detect the light emission cycle, the timing of the light emission time, and the light emission pattern of the LED 310 set in each of the first controller 300a, the second controller 300b, the third controller 300c, and / or the fourth controller 300d.
[0102] According to an embodiment, the LED 310 provided in each of the first controller 300a, the second controller 300b, the third controller 300c, and the fourth controller 300d may be turned on or off to have different modes. At least one of the first recognition camera 213 and the second recognition camera 223 of the first wearable electronic device 200a may identify the first controller 300a, the second controller 300b, the third controller 300c, and / or the fourth controller 300d based on at least one of the light emission cycle, the turn-on time (e.g., light emission timing), and the light emission pattern of the LED 310 provided in each of the first controller 300a, the second controller 300b, the third controller 300c, and / or the fourth controller 300d.
[0103] According to an embodiment, in a case where the first wearable electronic device 200a is executing a game by using the first controller 300a, when the second controller 300b associated with the second wearable electronic device 200b, the third controller 300c associated with the third wearable electronic device 200c, and / or the fourth controller 300d associated with the fourth wearable electronic device 200d are located adjacent to the first wearable electronic device 200a, the first wearable electronic device 200a can recognize the second controller 300b, the third controller 300c, and / or the fourth controller 300d through at least one of the first recognition camera 213 or the second recognition camera 223, and send a control signal to the second controller 300b, the third controller 300c, and / or the fourth controller 300d, and send a control signal to the second controller 300b, the third controller 300c, and / or the fourth controller 300d, wherein the control signal causes the LED provided in each of the second controller 300b, the third controller, and / or the fourth controller to be operated to have a different turn-on time and a different light emission pattern than the LED 310 provided in the first controller 300a.
[0104] According to an embodiment, although in the above embodiment, an embodiment in which the first wearable electronic device 200a operates as a host has been described, the second wearable electronic device 200b, the third wearable electronic device 200c or the fourth wearable electronic device 200d may also operate as a host and perform functions substantially the same as those of the first wearable electronic device 200a described above.
[0105] According to various embodiments, Figure 1 The electronic device 101 (e.g., a mobile terminal) shown in the figure can send a control signal (e.g., operation information) to the first controller 300a, the second controller 300b, the third controller 300c, and the fourth controller 300d through the first wearable electronic device 200a, the second wearable electronic device 200b, the third wearable electronic device 200c, and the fourth wearable electronic device 200d.
[0106] Figure 7 Cases (a) to (d) illustrate an embodiment in which a wearable electronic device recognizes at least one controller according to an embodiment of the present disclosure.
[0107] According to an embodiment, Figure 7 Case (a) may illustrate a turn-on time and a light emission period of the LED 310 of the first controller 300 a associated with the first wearable electronic device 200 a . Figure 7 Case (b) may show the turn-on time and the light emission period of the LED 310 of the first controller 300a associated with the first wearable electronic device 200a and the turn-on time and the light emission period of the LED 310 of the second controller 300b associated with the second wearable electronic device 200b. Figure 7 Case (c) may show the turn-on time and light-emitting period of the LED 310 of the first controller 300a associated with the first wearable electronic device 200a, the turn-on time and light-emitting period of the LED 310 of the second controller 300b associated with the second wearable electronic device 200b, and the turn-on time and light-emitting period of the LED 310 of the third controller 300c associated with the third wearable electronic device 200c. Figure 7 Case (d) may show the turn-on time and the light-emitting period of the LED 310 of the first controller 300a associated with the first wearable electronic device 200a, the turn-on time and the light-emitting period of the LED 310 of the second controller 300b associated with the second wearable electronic device 200b, the turn-on time and the light-emitting period of the LED 310 of the third controller 300c associated with the third wearable electronic device 200c, and the turn-on time and the light-emitting period of the LED 310 of the fourth controller 300d associated with the fourth wearable electronic device 200d.
[0108] refer to Figure 7 In case (a), the first wearable electronic device 200a may configure the first turn-on time ① and the light emission period a1 of the LED 310 set in the first controller 300a and send it to the first controller 300a. The first wearable electronic device 200a may identify the first controller 300a whose LED 310 is operated within the first turn-on time ① by using at least one of the first recognition camera 213 or the second recognition camera 223.
[0109] refer to Figure 7 In case (b), the first wearable electronic device 200a may configure the first turn-on time ① and the light cycle a1 of the LED 310 set in the first controller 300a, and send it to the first controller 300a. The first wearable electronic device 200a may configure the second turn-on time ② and the light cycle of the LED 310 set in the second controller 300b, and send it to the second controller 300b through the second wearable electronic device 200b. The first wearable electronic device 200a may identify the first controller 300a whose LED 310 is operated within the first turn-on time ① and / or the second controller 300b whose LED 310 is operated within the second turn-on time ② by using at least one of the first recognition camera 213 or the second recognition camera 223. In an embodiment, the light cycle of the LED 310 set in the first controller 300a and the light cycle of the LED 310 set in the second controller 300b may be substantially the same, and the first turn-on time ① of the LED 310 set in the first controller 300a and the second turn-on time ② of the LED 310 set in the second controller 300b may be different from each other. For example, the timings of the first turn-on time ① and the second turn-on time ② may be different from each other.
[0110] refer to Figure 7In case (c), the first wearable electronic device 200a may configure the first turn-on time ① and the light-emitting period a1 of the LED 310 set in the first controller 300a, and send it to the first controller 300a. The first wearable electronic device 200a may configure the second turn-on time ② and the light-emitting period of the LED 310 set in the second controller 300b, and send it to the second controller 300b through the second wearable electronic device 200b. The first wearable electronic device 200a may configure the third turn-on time ③ and the light-emitting period of the LED 310 set in the third controller 300c, and send it to the third controller 300c through the third wearable electronic device 200c. The first wearable electronic device 200a may identify the first controller 300a whose LED 310 is operated in the first turn-on time ①, the second controller 300b whose LED 310 is operated in the second turn-on time ②, and / or the third controller 300c whose LED 310 is operated in the third turn-on time ③ by using at least one of the first recognition camera 213 or the second recognition camera 223. In an embodiment, the light emission cycle of the LED 310 set in the first controller 300a, the light emission cycle of the LED 310 set in the second controller 300b, and the light emission cycle of the LED 310 set in the third controller 300c may be substantially the same, and the first turn-on time ① of the LED 310 set in the first controller 300a, the second turn-on time ② of the LED 310 set in the second controller 300b, and the third turn-on time ③ of the LED 310 set in the third controller 300c may be different from each other. For example, the timing of the first turn-on time ①, the second turn-on time ②, and the third turn-on time ③ may be different from each other.
[0111] refer to Figure 7In case (d), the first wearable electronic device 200a may configure the first turn-on time ① and the light-emitting period a1 of the LED 310 set in the first controller 300a, and send it to the first controller 300a. The first wearable electronic device 200a may configure the second turn-on time ② and the light-emitting period of the LED 310 set in the second controller 300b, and send it to the second controller 300b through the second wearable electronic device 200b. The first wearable electronic device 200a may configure the third turn-on time ③ and the light-emitting period of the LED 310 set in the third controller 300c, and send it to the third controller 300c through the third wearable electronic device 200c. The first wearable electronic device 200a may configure the fourth turn-on time ④ and the light-emitting period of the LED 310 set in the fourth controller 300d, and send it to the fourth controller 300d through the fourth wearable electronic device 200d. The first wearable electronic device 200a can identify the first controller 300a of LED310 being operated within the first turn-on time ①, the second controller 300b of LED310 being operated within the second turn-on time ②, the third controller 300c of LED310 being operated within the third turn-on time ③, and / or the fourth controller 300d of LED310 being operated within the fourth turn-on time ④ by using at least one of the first identification camera 213 or the second identification camera 223. In an embodiment, the light-emitting period of the LED 310 set in the first controller 300a, the light-emitting period of the LED 310 set in the second controller 300b, the light-emitting period of the LED 310 set in the third controller 300c, and the light-emitting period of the LED 310 set in the fourth controller 300d may be substantially the same, and the first turn-on time ① of the LED 310 set in the first controller 300a, the second turn-on time ② of the LED 310 set in the second controller 300b, the third turn-on time ③ of the LED 310 set in the third controller 300c, and the fourth turn-on time ④ of the LED 310 set in the fourth controller 300d may be different from each other. For example, the timing of the first turn-on time ①, the second turn-on time ②, the third turn-on time ③, and the fourth turn-on time ④ may be different from each other. For example, the LED 310 set in each of the first controller 300a, the second controller 300b, the third controller 300c, and the fourth controller 300d may be turned on according to the time difference.
[0112] refer to Figure 7In cases (a) to (d), according to the control of the processor 120, the first wearable electronic device 200a may send a control signal to turn on the LED 310 set in the first controller 300a at a specified time. According to the control of the processor 120, the first wearable electronic device 200a may send a control signal to turn on the LED 310 set in the second controller 300b at a specified time to the second controller 300b through the second wearable electronic device 200b. According to the control of the processor 120, the first wearable electronic device 200a may send a control signal to turn on the LED 310 set in the third controller 300c at a specified time to the third controller 300c through the third wearable electronic device 200c. According to the control of the processor 120, the first wearable electronic device 200a may send a control signal to turn on the LED 310 set in the fourth controller 300d at a specified time to the fourth controller 300d through the fourth wearable electronic device 200d. The LED 310 provided in each of the first controller 300a, the second controller 300b, the third controller 300c, and the fourth controller 300d is operated with substantially the same light emission cycle a1 (for example, about 33ms), and the timings of the first turn-on time ① to the fourth turn-on time ④ may be different from each other. In an embodiment, according to the control of the processor 120, the first wearable electronic device 200a may send a control signal to the first controller 300a, the second controller 300b, the third controller 300c, and the fourth controller 300d through the wireless communication module 192, wherein the control signal causes the LED 310 provided in each of the first controller 300a, the second controller 300b, the third controller 300c, and the fourth controller 300d to operate with substantially the same light emission cycle and different turn-on times (for example, the first turn-on time ① to the fourth turn-on time ④). The first wearable electronic device 200a may identify the first controller 300a, the second controller 300b, the third controller 300c, and the fourth controller 300d having respective LEDs 310 with different turn-on timings by using at least one of the first recognition camera 213 or the second recognition camera 223.
[0113] According to an embodiment, the first wearable electronic device 200a can identify the luminous intensity and / or color information of the LED 310 set in each of the first controller 300a, the second controller 300b, the third controller 300c and the fourth controller 300d through at least one of the first identification camera 213 or the second identification camera 223, and identify each of the first controller 300a, the second controller 300b, the third controller 300c and the fourth controller 300d.
[0114] Figure 8Cases (a) to (d) show embodiments of operation time configurations when at least one of the first recognition camera or the second recognition camera of the wearable electronic device detects an LED provided in at least one controller according to an embodiment of the present disclosure.
[0115] According to an embodiment, Figure 8 Case (a) may show an operation time of at least one of the first recognition camera 213 or the second recognition camera 223 when recognizing a first turn-on time ① of the LED 310 of the first controller 300a associated with the first wearable electronic device 200a. Figure 8 Case (b) may show the operation time of at least one of the first recognition camera 213 or the second recognition camera 223 of the first wearable electronic device 200a and the operation time of at least one of the third recognition camera 213a or the fourth recognition camera 223b of the second wearable electronic device 200b when identifying the first turn-on time ① of the LED 310 of the first controller 300a associated with the first wearable electronic device 200a and the second turn-on time ② of the LED 310 of the second controller 300b associated with the second wearable electronic device 200b. Figure 8 Case (c) may show the operation time of at least one of the first recognition camera 213 or the second recognition camera 223 of the first wearable electronic device 200a, the operation time of at least one of the third recognition camera 213a or the fourth recognition camera 223b of the second wearable electronic device 200b, and the operation time of at least one of the fifth recognition camera 213c or the sixth recognition camera 223d of the third wearable electronic device 200c when identifying the first turn-on time ① of the LED 310 of the first controller 300a associated with the first wearable electronic device 200a, the second turn-on time ② of the LED 310 of the second controller 300b associated with the second wearable electronic device 200b, and the third turn-on time ③ of the LED 310 of the third controller 300c associated with the third wearable electronic device 200c. Figure 8Case (d) may show an operation time of at least one of the first recognition camera 213 or the second recognition camera 223 of the first wearable electronic device 200a, an operation time of at least one of the third recognition camera 213a or the fourth recognition camera 223b of the second wearable electronic device 200b, an operation time of at least one of the fifth recognition camera 213c or the sixth recognition camera 223d of the third wearable electronic device 200c, and an operation time of at least one of the seventh recognition camera 213e or the eighth recognition camera 223f of the fourth wearable electronic device 200d when identifying a first turn-on time ① of the LED 310 of the first controller 300a associated with the first wearable electronic device 200a, a second turn-on time ② of the LED 310 of the second controller 300b associated with the second wearable electronic device 200b, a third turn-on time ③ of the LED 310 of the third controller 300c associated with the third wearable electronic device 200c, and a fourth turn-on time ④ of the LED 310 of the fourth controller 300d associated with the fourth wearable electronic device 200d.
[0116] According to various embodiments, the first wearable electronic device 200a may obtain the light cycle, timing of the on time, and / or light pattern of the LED 310 set in the first controller 300a through at least one of the first recognition camera 213 or the second recognition camera 223. The second wearable electronic device 200b may obtain the light cycle, timing of the on time, and / or light pattern of the LED 310 set in the second controller 300b through at least one of the third recognition camera 213a or the fourth recognition camera 223b. The third wearable electronic device 200c may obtain the light cycle, timing of the on time, and / or light pattern of the LED 310 set in the third controller 300c through at least one of the fifth recognition camera 213c or the sixth recognition camera 223d. The fourth wearable electronic device 200d may obtain the light cycle, timing of the on time, and / or light pattern of the LED 310 set in the fourth controller 300d through the seventh recognition camera 213e or the eighth recognition camera 223f.
[0117] According to various embodiments, the first wearable electronic device 200a to the fourth wearable electronic device 200d may share the light cycle of the LED 310, the timing of the turn-on time, and / or the light pattern obtained from each of the first controller 300a to the fourth controller 300d. For example, information related to the light cycle of the LED 310, the timing of the turn-on time, and / or the light pattern obtained from each of the second controller 300b to the fourth controller 300d may be sent to the first wearable electronic device 200a by each of the second wearable electronic device 200b to the fourth wearable electronic device 200d. Figure 8In case (a), when the first turn-on time ① of the LED 310 set in the first controller 300a is recognized by at least one of the first recognition camera 213 or the second recognition camera 223, the first wearable electronic device 200a may configure at least one of the first recognition camera 213 or the second recognition camera 223 to operate within a fifth turn-on time ⑤. The fifth turn-on time ⑤ of at least one of the first recognition camera 213 or the second recognition camera 223 may be configured to be longer than the first turn-on time ① of the LED 310 set in the first controller 300a.
[0118] refer to Figure 8 In case (b), when the second turn-on time ② of the LED 310 set in the second controller 300b is recognized by at least one of the first recognition camera 213 or the second recognition camera 223, the first wearable electronic device 200a may configure at least one of the first recognition camera 213 or the second recognition camera 223 to operate within the sixth turn-on time ⑥. The sixth turn-on time ⑥ of at least one of the first recognition camera 213 or the second recognition camera 223 may be configured to be longer than the second turn-on time ② of the LED 310 set in the second controller 300b.
[0119] refer to Figure 8 In case (c), when the third turn-on time ③ of the LED 310 set in the third controller 300c is recognized by at least one of the first recognition camera 213 or the second recognition camera 223, the first wearable electronic device 200a may configure at least one of the first recognition camera 213 or the second recognition camera 223 to operate within the seventh turn-on time ⑦. The seventh turn-on time ⑦ of at least one of the first recognition camera 213 or the second recognition camera 223 may be configured to be longer than the third turn-on time ③ of the LED 310 set in the third controller 300c.
[0120] refer to Figure 8 In case (d), when the fourth turn-on time ④ of the LED 310 set in the fourth controller 300d is recognized by at least one of the first recognition camera 213 or the second recognition camera 223, the first wearable electronic device 200a may configure at least one of the first recognition camera 213 or the second recognition camera 223 to operate within an eighth turn-on time ⑧. The eighth turn-on time ⑧ of at least one of the first recognition camera 213 or the second recognition camera 223 may be configured to be longer than the fourth turn-on time ④ of the LED 310 set in the fourth controller 300d.
[0121] According to an embodiment, the first wearable electronic device 200a can detect the light-emitting cycle, the timing of the turn-on time and the light-emitting pattern of the LED 310 set in each of the first controller 300a, the second controller 300b, the third controller 300c and the fourth controller 300d through at least one of the first recognition camera 213 or the second recognition camera 223.
[0122] Fig. 9 An embodiment is shown in which at least one of the first recognition camera or the second recognition camera of the wearable electronic device according to an embodiment of the present disclosure can detect a light emission pattern of an LED provided in at least one controller. Fig.10 Various embodiments are shown in which at least one of the first recognition camera or the second recognition camera of the wearable electronic device according to an embodiment of the present disclosure can detect a light emission pattern of an LED provided in at least one controller.
[0123] According to an embodiment, Fig. 9 and Fig.10 Various embodiments may be shown in which the wearable electronic device 200 detects a first mode (mode 1) of the LED 310 set in the first controller to a fifth mode (mode 5) of the LED 310 set in the fifth controller by using at least one of the first recognition camera 213 or the second recognition camera 223. Fig. 9 and Fig.10 Each of the first to fifth controllers described may have Figure 3 The configuration of the controller 300 shown in FIG. 1 is basically the same configuration.
[0124] refer to Fig. 9 , the first column 910 may indicate the situations where the LED 310 provided in the first controller to the LED 310 provided in the fifth controller are in the on state and the off state. For example, the first column 910 may show all situations where the LED 310 provided in the first controller to the LED 310 provided in the fifth controller are in the light emitting state or not in the light emitting state. Fig. 9 The second column 920 may indicate that the LEDs 310 to 310 provided in the first controller to the fifth controller are in the on state. For example, the second column 920 may only show that the LEDs 310 to 310 provided in the first controller to the fifth controller are in the light emitting state.
[0125] According to an embodiment, each of the LEDs 310 provided in the first controller to the LEDs 310 provided in the fifth controller may include an array of first LEDs A and second LEDs B, for example.
[0126] According to an embodiment, in the first mode (mode 1) of the LED 310 provided in the first controller, the first LED A may be turned on, the second LED B may be turned off, the first LED A may be turned on, and the second LED B may be turned off.
[0127] According to an embodiment, in the second mode (mode 2) of the LED 310 provided in the second controller, the first LED A may be turned off, the second LED B may be turned on, the first LED A may be turned off, and the second LED B may be turned on.
[0128] According to an embodiment, in the third mode (mode 3) of the LED 310 provided in the third controller, the first LED A may be turned on, the second LED B may be turned on, the first LED A may be turned off, and the second LED B may be turned on.
[0129] According to an embodiment, in a fourth mode (mode 4) of the LED 310 provided in the fourth controller, the first LED A may be turned off, the second LED B may be turned on, the first LED A may be turned on, and the second LED B may be turned off.
[0130] According to an embodiment, in the fifth mode (mode 5) of the LED 310 provided in the fifth controller, the first LED A may be turned on, the second LED B may be turned off, the first LED A may be turned on, and the second LED B may be turned on.
[0131] According to various embodiments, the wearable electronic device 200 (eg, Figure 6 The first wearable electronic device 200a) can identify the first mode (mode 1) of the first controller, the second mode (mode 2) of the second controller, the third mode (mode 3) of the third controller, the fourth mode (mode 4) of the fourth controller and / or the fifth mode (mode 5) of the fifth controller by using at least one of the first recognition camera 213 or the second recognition camera 223 to identify the first controller to the fifth controller.
[0132] refer to Fig.10 , the wearable electronic device 200 (eg, Figure 6 The first wearable electronic device 200a) may recognize a first mode (mode 1) of a first controller to a fifth mode (mode 5) of a fifth controller by using at least one of the first recognition camera 213 or the second recognition camera 223.
[0133] According to an embodiment, the first controller may include a first mode (mode 1) having an array in which only the first LED A is turned on. The first mode (mode 1) may include an array in which the second LED B is turned off.
[0134] According to an embodiment, the second controller may include a second mode (mode 2) of the array having only the second LED B turned on. The second mode (mode 2) may include an array in which the first LED A is turned off. For example, the second controller may control the second wearable electronic device (e.g., Figure 6 The second wearable electronic device 200b) sends information related to the second mode (mode 2) to the wearable electronic device 200 (eg, Figure 6 A first wearable electronic device 200a).
[0135] According to an embodiment, the third mode (mode 3) of the third controller, the fourth mode (mode 4) of the fourth controller, and the fifth mode (mode 5) of the fifth controller may include modes in which some of the first LEDs A and some of the second LEDs B are turned on and / or off. For example, the third controller, the fourth controller, and the fifth controller may transmit information about the third mode (mode 3), the fourth mode (mode 4), and the fifth mode (mode 5) to the wearable electronic device 200 (e.g., Figure 6 A first wearable electronic device 200a).
[0136] According to various embodiments, the array of the first mode (mode 1) of the first controller to the fifth mode (mode 5) of the fifth controller is not limited to the above example and may be changed to various other arrays.
[0137] Fig.11a An embodiment in which the accessory according to an embodiment of the present disclosure includes a first mode is shown. Fig.11b An embodiment in which the accessory according to the embodiment of the present disclosure includes a second mode is shown. Fig.11c Various embodiments of patterns that may be arranged on an accessory according to embodiments of the present disclosure are shown.
[0138] refer to Fig.11a , the wearable electronic device 200 may recognize the first pattern 1110 of the LED 310 disposed on the accessory 1100 (eg, a removable accessory device) by using at least one of the first recognition camera 213 or the second recognition camera 223 .
[0139] refer to Fig.11b , the wearable electronic device 200 may recognize the second pattern 1120 of the LED 310 disposed on the accessory 1100 (eg, a removable accessory device) by using at least one of the first recognition camera 213 or the second recognition camera 223 .
[0140] refer to Fig.11c , the accessory 1100 (eg, a mobile device) can form various modes by turning on and / or off the plurality of first LEDs A and the plurality of second LEDs B.
[0141] Fig.12 is a flowchart illustrating a method for recognizing at least one controller by a wearable electronic device by using at least one of a first recognition camera or a second recognition camera according to an embodiment of the present disclosure.
[0142] In operation 1210, the processor 120 of the wearable electronic device 200 may recognize that the first controller 300a and the second controller 300b are detected in the designated space through at least one of the first recognition camera 213 or the second recognition camera 223, wherein each of the first controller 300a and the second controller 300b has an LED 310 disposed therein. In various embodiments, the processor 120 of the wearable electronic device 200 may recognize that the first controller 300a and the second controller 300b are detected in the designated space through a sensor module (e.g., a proximity sensor) or wireless communication, wherein each of the first controller 300a and the second controller 300b has an LED 310 disposed therein.
[0143] At operation 1220, the processor 120 may transmit a control signal to the first controller 300a so that the LED 310 provided in the first controller 300a operates at the first turn-on time ①.
[0144] At operation 1230, the processor 120 may transmit a control signal to the second controller 300b to operate the LED 310 provided in the second controller 300b at the second turn-on time ②.
[0145] The wearable electronic device 200 or 200a according to an embodiment of the present disclosure may include a wireless communication module 192, a sensor module 176, a first recognition camera 213 and / or a second recognition camera 223, and a processor 120, wherein the processor 120 is operably connected to the wireless communication module 192, the sensor module 176, the first recognition camera 213 and / or the second recognition camera 223. According to an embodiment, the processor 120 may recognize that a first controller 300a and a second controller 300b are detected in a designated space through at least one of the first recognition camera 213 and the second recognition camera 223, wherein each of the first controller 300a and the second controller 300b has an LED 310 disposed therein. According to an embodiment, the processor 120 may send a control signal to operate the LED 310 disposed in the first controller 300a at a first turn-on time ① to the first controller 300a. According to an embodiment, the processor 120 may send a control signal to operate the LED 310 disposed in the second controller 300b at a second turn-on time ② to the second controller 300b.
[0146] According to an embodiment, the processor 120 may be configured to identify the first controller 300a and the second controller 300b based on a timing of identifying the first turn-on time ① and the second turn-on time ② through at least one of the first recognition camera 213 and the second recognition camera 223.
[0147] According to an embodiment, the processor 120 may be configured to, when the first turn-on time ① is detected by at least one of the first recognition camera 213 and the second recognition camera 223, cause at least one of the first recognition camera 213 and the second recognition camera 223 to operate within a fifth turn-on time ⑤ that is longer than the first turn-on time ①, and when the second turn-on time ② is detected by at least one of the first recognition camera 213 and the second recognition camera 223, cause at least one of the first recognition camera 213 and the second recognition camera 223 to operate within a sixth turn-on time ⑥ that is longer than the second turn-on time ②.
[0148] According to an embodiment, the processor 120 may be configured to cause the LED 310 provided in the first controller 300 a and the LED 310 provided in the second controller 300 b to operate in substantially the same light emission cycle.
[0149] According to an embodiment, the processor 120 may be configured to detect movement of the first controller 300 a and the second controller 300 b through at least one of the first recognition camera 213 , the second recognition camera 223 , and the sensor module 176 .
[0150] According to an embodiment, the processor 120 may be configured to detect the positions of the first controller 300 a and the second controller 300 b through at least one of the first recognition camera 213 , the second recognition camera 223 , and the sensor module 176 .
[0151] According to an embodiment, the sensor module 176 may include an inertial measurement sensor configured to measure angular velocity and acceleration of the first controller 300a and the second controller 300b, or a global positioning system (GPS) sensor configured to detect the positions of the first controller 300a and the second controller 300b.
[0152] According to an embodiment, the wearable electronic device 200 or 200a may be configured so that the LED 310 set in the first controller 300a is turned on and / or off to be operated in a first mode, and the LED 310 set in the second controller 300b is turned on and / or off to be operated in a second mode different from the first mode.
[0153] According to an embodiment, the processor 120 may be configured to identify the first controller 300a and the second controller 300b based on identifying the first mode of the LED 310 set in the first controller 300a and the second mode of the LED 310 set in the second controller 300b through at least one of the first recognition camera 213 and the second recognition camera 223.
[0154] According to an embodiment, at least one of the first controller 300a and the second controller 300b may include a movable accessory device.
[0155] According to an embodiment of the present disclosure, a method for identifying a first controller 300a and a second controller 300b by a wearable electronic device 200 or 200a may include: the processor 120 identifies the first controller 300a and the second controller 300b detected in a designated space through at least one of the first recognition camera 213 and the second recognition camera 223, wherein each of the first controller 300a and the second controller 300b has an LED 310 disposed therein. According to an embodiment, the method may include the processor 120 sending a control signal to the first controller 300a to operate the LED 310 disposed in the first controller 300a at a first turn-on time ①. According to an embodiment, the method may include the processor 120 sending a control signal to the second controller 300b to operate the LED 310 disposed in the second controller 300b at a second turn-on time ②.
[0156] According to an embodiment, the method may include: the processor 120 identifies the first controller 300a and the second controller 300b based on a timing of identifying the first turn-on time ① and the second turn-on time ② through at least one of the first recognition camera 213 and the second recognition camera 223.
[0157] According to an embodiment, the method may include: when the first turn-on time ① is detected by at least one of the first recognition camera 213 and the second recognition camera 223, the processor 120 controls at least one of the first recognition camera 213 and the second recognition camera 223 to operate within a fifth turn-on time ⑤ that is longer than the first turn-on time ①, and when the second turn-on time ② is detected by at least one of the first recognition camera 213 and the second recognition camera 223, the processor 120 controls at least one of the first recognition camera 213 and the second recognition camera 223 to operate within a sixth turn-on time ⑥ that is longer than the second turn-on time ②.
[0158] According to an embodiment, the method may include controlling, by the processor 120 , the LED 310 provided in the first controller 300 a and the LED 310 provided in the second controller 300 b to operate at substantially the same light emission cycle.
[0159] According to an embodiment, the method may include detecting, by the processor 120 , movement of the first controller 300 a and the second controller 300 b through at least one of the first recognition camera 213 , the second recognition camera 223 , and the sensor module 176 .
[0160] According to an embodiment, the method may include detecting, by the processor 120 , positions of the first controller 300 a and the second controller 300 b through at least one of the first recognition camera 213 , the second recognition camera 223 , and the sensor module 176 .
[0161] According to an embodiment, the sensor module 176 may include an inertial measurement sensor configured to measure angular velocity and acceleration of the first controller 300a and the second controller 300b, or a global positioning system (GPS) sensor configured to detect the positions of the first controller 300a and the second controller 300b.
[0162] According to an embodiment, the method may include: controlling, by the processor 120, the LED 310 set in the first controller 300a to be turned on and / or turned off to be operated in a first mode, and controlling the LED 310 set in the second controller 300b to be turned on and / or turned off to be operated in a second mode different from the first mode.
[0163] According to an embodiment, the method may include: the processor 120 identifies the first controller 300a and the second controller 300b based on identifying the first mode of the LED 310 set in the first controller 300a and the second mode of the LED 310 set in the second controller 300b through at least one of the first recognition camera 213 and the second recognition camera 223.
[0164] Although the present disclosure has been described above with reference to various embodiments thereof, it will be apparent to those skilled in the art that modifications and variations may be made thereto without departing from the scope of the present disclosure as defined by the appended claims.
Claims
1. A wearable electronic device (200; 200a), comprising: Wireless communication module (192); Sensor Module (176); a first recognition camera (213) and / or a second recognition camera (223); and A processor (120) is operably connected to the wireless communication module (192), the sensor module (176), and the first recognition camera (213) and / or the second recognition camera (223), Wherein, the processor (120) is configured to: recognizing that a first controller (300a) and a second controller (300b) are detected in a designated space by at least one of the first recognition camera (213) and the second recognition camera (223), wherein each of the first controller (300a) and the second controller (300b) has a light emitting diode (310) (LED) disposed therein; sending a control signal to the first controller (300a) to operate the LED (310) provided in the first controller (300a) at a first turn-on time (①); and A control signal for causing the LED (310) provided in the second controller (300b) to operate at a second turn-on time (②) is sent to the second controller (300b).
2. The electronic device (200; 200a) according to claim 1, wherein: The processor (120) is configured to identify the first controller (300a) and the second controller (300b) based on a timing of identifying the first turn-on time (①) and the second turn-on time (②) by at least one of the first recognition camera (213) and the second recognition camera (223).
3. The electronic device (200; 200a) according to claim 1 or 2, wherein: The processor (120) is configured to: When the first turn-on time (①) is detected by at least one of the first recognition camera (213) and the second recognition camera (223), at least one of the first recognition camera (213) and the second recognition camera (223) is operated within a fifth turn-on time (⑤) that is longer than the first turn-on time (①); as well as When the second turn-on time (②) is detected by at least one of the first recognition camera (213) and the second recognition camera (223), at least one of the first recognition camera (213) and the second recognition camera (223) is operated within a sixth turn-on time (⑥) that is longer than the second turn-on time (②).
4. The electronic device (200; 200a) according to any one of the preceding claims, wherein: The processor (120) is configured to cause the LED (310) provided in the first controller (300a) and the LED (310) provided in the second controller (300b) to operate in substantially the same lighting cycle.
5. The electronic device (200; 200a) according to any one of the preceding claims, wherein The processor (120) is configured to detect movement of the first controller (300a) and the second controller (300b) through at least one of the first recognition camera (213), the second recognition camera (223), and the sensor module (176), The sensor module (176) preferably comprises an inertial measurement sensor, wherein the inertial measurement sensor is configured to measure the angular velocity and acceleration of the first controller (300a) and the second controller (300b).
6. The electronic device (200; 200a) according to any one of the preceding claims, wherein The processor (120) is configured to detect positions of the first controller (300a) and the second controller (300b) through at least one of the first recognition camera (213), the second recognition camera (223), and the sensor module (176), Wherein, the sensor module (176) preferably comprises a global positioning system (GPS) sensor, wherein the GPS sensor is configured to detect the positions of the first controller (300a) and the second controller (300b).
7. The electronic device (200; 200a) according to any one of the preceding claims, wherein The LED (310) provided in the first controller (300a) is turned on and / or off to be operated in a first mode, and wherein the LED (310) provided in the second controller (300b) is turned on and / or off to be operated in a second mode different from the first mode, Wherein, preferably, the processor (120) is configured to identify the first controller (300a) and the second controller (300b) based on identifying the first pattern of the LED (310) set in the first controller (300a) and the second pattern of the LED (310) set in the second controller (300b) through at least one of the first recognition camera (213) and the second recognition camera (223).
8. The electronic device (200; 200a) according to any one of the preceding claims, wherein At least one of the first controller (300a) and the second controller (300b) is a removable accessory device.
9. A method for identifying a first controller (300a) and a second controller (300b) by a wearable electronic device (200; 200a), the method comprising: The processor (120) of the electronic device (200; 200a) recognizes that the first controller (300a) and the second controller (300b) are detected in a designated space through at least one of a first recognition camera (213) and a second recognition camera (223) of the electronic device (200; 200a), wherein each of the first controller (300a) and the second controller (300b) has an LED (310) disposed therein; The processor (120) sends a control signal to the first controller (300a) for causing the LED (310) provided in the first controller (300a) to operate at a first turn-on time (①); and A control signal for causing the LED (310) provided in the second controller (300b) to operate at a second turn-on time (②) is sent to the second controller (300b) by the processor (120).
10. The method according to claim 9, further comprising: The processor (120) identifies the first controller (300a) and the second controller (300b) based on the timing of identifying the first turn-on time (①) and the second turn-on time (②) by at least one of the first recognition camera (213) and the second recognition camera (223), The method preferably further comprises: When the first turn-on time (①) is detected by at least one of the first recognition camera (213) and the second recognition camera (223), the processor (120) controls at least one of the first recognition camera (213) and the second recognition camera (223) to operate within a fifth turn-on time (⑤) that is longer than the first turn-on time (①); and When the second turn-on time (②) is detected by at least one of the first recognition camera (213) and the second recognition camera (223), the processor (120) controls at least one of the first recognition camera (213) and the second recognition camera (223) to operate within a sixth turn-on time (⑥) that is longer than the second turn-on time (②).
11. The method according to claim 9 or 10, comprising: The processor (120) controls the LED (310) provided in the first controller (300a) and the LED (310) provided in the second controller (300b) to operate in substantially the same lighting cycle.
12. The method according to any one of claims 9 to 11, comprising: The processor (120) detects movement of the first controller (300a) and the second controller (300b) through at least one of the first recognition camera (213), the second recognition camera (223), and the sensor module (176), The sensor module (176) preferably comprises an inertial measurement sensor, wherein the inertial measurement sensor is configured to measure the angular velocity and acceleration of the first controller (300a) and the second controller (300b).
13. The method according to any one of claims 9 to 12, comprising: The processor (120) detects the positions of the first controller (300a) and the second controller (300b) through at least one of the first recognition camera (213), the second recognition camera (223) and the sensor module (176), Wherein, the sensor module (176) preferably comprises a global positioning system (GPS) sensor, wherein the GPS sensor is configured to detect the positions of the first controller (300a) and the second controller (300b).
14. The method according to any one of claims 9 to 13, comprising: The processor (120) controls the LED (310) provided in the first controller (300a) to be turned on and / or off so as to be operated in a first mode, and controls the LED (310) provided in the second controller (300b) to be turned on and / or off so as to be operated in a second mode different from the first mode, The method preferably further includes: the processor (120) identifying the first controller (300a) and the second controller (300b) based on identifying the first pattern of the LED (310) set in the first controller (300a) and the second pattern of the LED (310) set in the second controller (300b) through at least one of the first recognition camera (213) and the second recognition camera (223).
15. The method according to any one of claims 9 to 14, wherein: At least one of the first controller (300a) and the second controller (300b) is a removable accessory device.