Wearable device, electronic device, and method for brain wave analysis
By employing EEG and BCI analysis models to manage signal magnitude thresholds, the system optimizes power consumption and data transmission in wearable devices, addressing inefficiencies in brain wave signal analysis.
Patent Information
- Application Number
- PCT/KR2024/018859
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-01-08
- Filing Date
- 2024-11-26
- Publication Date
- 2025-07-10
AI Technical Summary
Existing wearable devices and electronic devices face challenges in efficiently analyzing and managing brain wave signals, particularly in optimizing power consumption and data transmission based on signal magnitude thresholds, which can lead to unnecessary resource usage and potential inaccuracies.
Implementing a system where wearable devices and electronic devices utilize EEG and BCI analysis models to determine signal magnitude thresholds, adjusting measurement and data transmission based on these thresholds to optimize power usage and accuracy.
This approach enhances the efficiency of brain wave signal analysis by optimizing power consumption and data transmission, ensuring accurate analysis while reducing unnecessary operations and resource usage.
Smart Images

Figure KR2024018859_10072025_PF_FP_ABST
Abstract
Description
Wearable devices, electronic devices, and methods for brain wave analysis
[0001] The present disclosure relates to a wearable device, an electronic device and a method for brain wave analysis, according to one embodiment.
[0002] The healthcare and wearables market is rapidly growing worldwide. Wearable electronic devices (e.g., wireless earphones) can be used to monitor a user's vital signs.
[0003] Biosignals include electroencephalography (EEG), brain-computer interface (BCI) signals, electromyogram (EMG), electrocardiogram (ECG), ballistocardiogram (BCG), and photoplethysmogram (PPG). Electronic devices (e.g., wearable devices or mobile phones) can obtain various information about the state of a living organism by analyzing these biosignals.
[0004] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.
[0005] According to one embodiment, an electronic device may include a communication circuit, at least one processor, and a memory storing instructions. The instructions, when executed by the at least one processor, may be configured to cause the electronic device to receive, through the communication circuit, first data regarding a first signal obtained based on a potential difference between a first electrode and a second electrode of the wearable device, from a wearable device. The instructions, when executed by the at least one processor, may be configured to cause the electronic device to determine a magnitude of the first signal based on the first data. The instructions, when executed by the at least one processor, may be configured to cause the electronic device to perform an analysis on the first signal by using an electroencephalography (EEG) analysis model and a brain-computer interface (BCI) analysis model based on the magnitude of the first signal being less than a first reference value. The instructions may be configured to cause the electronic device, when executed by the at least one processor, to perform an analysis on the first signal by using the BCI analysis model based on the magnitude of the first signal being greater than or equal to the first threshold value and less than a second threshold value that is greater than the first threshold value. The instructions may be configured to cause the electronic device, when executed by the at least one processor, to transmit a first request to the wearable device via the communication circuitry, the first request causing a stop of measurement of the first signal, or to cause the electronic device to stop receiving the first data via the communication circuitry, based on the magnitude of the first signal being greater than or equal to the second threshold value.
[0006] According to one embodiment, a method of operating an electronic device may include receiving, from a wearable device, first data regarding a first signal obtained based on a potential difference between a first electrode and a second electrode of the wearable device. The method may include determining a magnitude of the first signal based on the first data. The method may include performing an analysis on the first signal by using an EEG analysis model and a Brain-Computer Interface (BCI) analysis model based on the magnitude of the first signal being less than a first reference value. The method may include performing an analysis on the first signal by using the BCI analysis model based on the magnitude of the first signal being greater than or equal to the first reference value and less than a second reference value that is greater than the first reference value. The method may include an action of transmitting a first request to the wearable device to cause a stop of measurement of the first signal, or an action of stopping reception of the first data, based on the magnitude of the first signal being greater than or equal to the second reference value.
[0007] According to one embodiment, a storage medium storing computer-readable instructions may be configured to cause at least one processor of an electronic device to perform at least one operation when the instructions are executed. The at least one operation may include receiving, from a wearable device, first data regarding a first signal obtained based on a potential difference between a first electrode and a second electrode of the wearable device. The at least one operation may include determining a magnitude of the first signal based on the first data. The at least one operation may include performing an analysis on the first signal by using an electroencephalography (EEG) analysis model and a brain-computer interface (BCI) analysis model based on the magnitude of the first signal being less than a first reference value. The at least one operation may include performing an analysis on the first signal by using the BCI analysis model based on the magnitude of the first signal being greater than or equal to the first reference value and less than a second reference value that is greater than the first reference value. The at least one operation may include transmitting a first request to the wearable device to cause a stop of measurement of the first signal, or an operation of stopping reception of the first data, based on the magnitude of the first signal being greater than or equal to the second reference value.
[0008] According to one embodiment, a wearable device may include a first electrode, a second electrode, a communication circuit, at least one processor, and a memory storing instructions. The instructions, when executed by the at least one processor, may be configured to cause the wearable device to acquire a first signal based on a potential difference between the first electrode and the second electrode while the wearable device is worn on one ear of a user. The instructions, when executed by the at least one processor, may be configured to cause the wearable device to determine a magnitude of the first signal. The instructions, when executed by the at least one processor, may be configured to cause the wearable device to perform an analysis on the first signal by using an electroencephalogram (EEG) analysis model and a brain-computer interface (BCI) analysis model based on the magnitude of the first signal being less than a first reference value. The instructions may be configured to cause the wearable device, when executed by the at least one processor, to perform an analysis on the first signal by using the BCI analysis model based on the magnitude of the first signal being greater than or equal to the first threshold value and less than a second threshold value that is greater than the first threshold value. The instructions may be configured to cause the wearable device, when executed by the at least one processor, to stop measuring the first signal through the first electrode and the second electrode, or to stop transmitting data including an analysis result of the first signal to an electronic device through the communication circuit, based on the magnitude of the first signal being greater than or equal to the second threshold value.
[0009] According to one embodiment, a method of operating a wearable device may include an operation of acquiring a first signal based on a potential difference between a first electrode and a second electrode of the wearable device while the wearable device is worn on one ear of a user. The method may include an operation of checking a magnitude of the first signal. The method may include an operation of performing an analysis on the first signal by using an EEG analysis model and a Brain-Computer Interface (BCI) analysis model based on the magnitude of the first signal being less than a first reference value. The method may include an operation of performing an analysis on the first signal by using the BCI analysis model based on the magnitude of the first signal being greater than or equal to the first reference value and less than a second reference value that is greater than the first reference value. The method may include an operation of stopping measurement of the first signal through the first electrode and the second electrode, or an operation of stopping transmission of data including an analysis result of the first signal to an electronic device, based on the magnitude of the first signal being greater than or equal to the second reference value.
[0010] According to one embodiment, a storage medium storing computer-readable instructions may be configured to cause the wearable device to perform at least one operation when executed by at least one processor of the wearable device. The at least one operation may include: acquiring a first signal based on a potential difference between a first electrode and a second electrode of the wearable device while the wearable device is worn on one ear of a user. The at least one operation may include determining a magnitude of the first signal. The at least one operation may include: performing an analysis on the first signal by using an electroencephalography (EEG) analysis model and a brain-computer interface (BCI) analysis model based on the magnitude of the first signal being less than a first reference value. The at least one operation may include performing an analysis on the first signal by using the BCI analysis model based on the magnitude of the first signal being greater than or equal to the first reference value and less than a second reference value that is greater than the first reference value. The at least one operation may include stopping the measurement of the first signal through the first electrode and the second electrode, or stopping the operation of transmitting data including the analysis result of the first signal to an electronic device, based on the magnitude of the first signal being greater than or equal to the second reference value.
[0011] FIG. 1 is a block diagram of an electronic device within a network environment, according to one embodiment.
[0012] FIG. 2 is a diagram illustrating a system for brain wave analysis according to one embodiment.
[0013] FIG. 3 is a block diagram of a wearable device and an electronic device according to one embodiment.
[0014] Figure 4 is a drawing explaining a data transmission path.
[0015] Figure 5 is a drawing explaining a data transmission path.
[0016] FIG. 6A is a diagram illustrating a first wearable device and a second wearable device according to one embodiment.
[0017] FIG. 6b is a diagram illustrating a first wearable device according to one embodiment.
[0018] FIG. 7 is a drawing showing one ear of a user wearing a wearable device according to one embodiment.
[0019] FIG. 8 is a diagram illustrating a signal (e.g., a biosignal) according to one embodiment.
[0020] FIG. 9 is a flowchart of a method of operating a wearable device and an electronic device according to one embodiment.
[0021] FIG. 10 is a flowchart of a method of operating an electronic device according to one embodiment.
[0022] FIG. 11 is a flowchart of a method of operating an electronic device according to one embodiment.
[0023] FIG. 12 is a drawing illustrating the operation of an electronic device according to one embodiment.
[0024] FIG. 13 is a drawing illustrating the operation of an electronic device according to one embodiment.
[0025] FIG. 14 is a drawing illustrating the operation of an electronic device according to one embodiment.
[0026] FIG. 15 is a drawing illustrating the operation of an electronic device according to one embodiment.
[0027] FIG. 16 is a flowchart of a method of operating a wearable device and an electronic device according to one embodiment.
[0028] FIG. 17 is a diagram illustrating the operation of a wearable device and an electronic device according to one embodiment.
[0029] Fig. 18 is a flowchart of a method of operating a wearable device according to one embodiment.
[0030] FIG. 19 is a flowchart of a method of operating a wearable device according to one embodiment.
[0031] FIG. 20 is a block diagram of a wearable device according to one embodiment.
[0032] FIG. 21 is a flowchart of a method of operating an electronic device according to one embodiment.
[0033] FIG. 1 is a block diagram of an electronic device within a network environment, according to one embodiment.
[0034] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).
[0035] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.
[0036] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.
[0037] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).
[0038] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0039] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0040] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.
[0041] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.
[0042] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).
[0043] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0044] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0045] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0046] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
[0047] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0048] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).
[0049] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0050] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).
[0051] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for realizing 1eMBB, a loss coverage (e.g., 164 dB or less) for realizing mMTC, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for realizing URLLC.
[0052] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).
[0053] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.
[0054] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).
[0055] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0056] FIG. 2 is a diagram illustrating a system for brain wave analysis according to one embodiment.
[0057] According to one embodiment, referring to FIG. 2, the first wearable device (310) may be worn on one ear of the user. The second wearable device (320) may be worn on the other ear of the user. The third wearable device (330) may be worn on the wrist of the user. For example, the first wearable device (310) and the second wearable device (320) may be implemented as a pair of wireless earphones. For example, the third wearable device (330) may be a smart watch. However, the wearable devices (e.g., 310, 320, 330) may not be earphones or smart watches. For example, they may be wearable devices (e.g., 310, 320, 330), smart glasses, a smart ring, or a head mounted display (HMD) device. For example, the electronic device (200) may be implemented as a smart phone or a tablet PC. There is no limitation on the type of the electronic device (200). The electronic device (200) may be the electronic device (101) of FIG. 1. The electronic device (200) may include at least one of the configurations of the electronic device (101) of FIG. 1. The first wearable device (310) may include a configuration corresponding to at least one of the configurations of the electronic device (101) of FIG. 1. The second wearable device (320) may include a configuration corresponding to at least one of the configurations of the electronic device (101) of FIG. 1. The third wearable device (330) may include a configuration corresponding to at least one of the configurations of the electronic device (101) of FIG. 1. For example, the description of at least one of the components of the electronic device (101) of FIG. 1 (e.g., communication module (190), processor (120), memory (130), sensor module (176)) may be applied to at least one component of the first wearable device (310) (e.g., communication circuit, processor, memory, sensor) or at least one component of the second wearable device (320) (e.g., communication circuit, processor, memory, sensor).For example, the description of at least one of the components of the electronic device (101) of FIG. 1 (e.g., communication module (190), processor (120), memory (130), sensor module (176)) may be applied to at least one component of the third wearable device (330) (e.g., communication circuit, processor, memory, sensor). However, for convenience of explanation, redundant descriptions may be omitted.
[0058] According to one embodiment, the first wearable device (310) may obtain a signal (e.g., a biosignal) based on a potential difference between electrodes of the first wearable device (310) when worn on one ear of the user. For example, the signal (e.g., a biosignal) may include an electroencephalography (EEG) component, a brain-computer interface (BCI) component, and an electromyogram (EMG) component. According to one embodiment, the first wearable device (310) may perform an analysis on the signal (e.g., a biosignal). The first wearable device (310) may transmit the analysis result on the signal (e.g., a biosignal) to the electronic device (200). The electronic device (200) may perform a specified operation based on the analysis result. According to one embodiment, the first wearable device (310) may transmit data regarding a signal (e.g., a biosignal) to the electronic device (200). The electronic device (200) may perform an analysis of the signal (e.g., a biosignal) based on the data received from the first wearable device (310). The electronic device (200) may perform a designated action based on the analysis result.
[0059] According to one embodiment, the second wearable device (320) may obtain a signal (e.g., a biosignal) based on a potential difference between electrodes of the second wearable device (320) while being worn on one ear of the user. According to one embodiment, the second wearable device (320) may perform analysis on the signal (e.g., a biosignal). According to one embodiment, the second wearable device (320) may transmit data on the signal (e.g., a biosignal) to the electronic device (200). The technical features of the first wearable device (310) of the present invention may be equally applied to the second wearable device (320).
[0060] However, for convenience of explanation, the present disclosure will focus on the operation method by the first wearable device (310). Accordingly, the first wearable device (310) may be referred to as a wearable device (310).
[0061] FIG. 3 is a block diagram of a wearable device and an electronic device according to one embodiment.
[0062] According to one embodiment, referring to FIG. 3, the electronic device (200) may include a processor (202) and a memory (203). The processor (202) of the electronic device (200) may be the processor (120) of FIG. 1. The memory (203) of the electronic device (200) may be the memory (130) of FIG. 1.
[0063] According to one embodiment, the processor (202) of the electronic device (200) may be referred to as a controller (202). The operation of the electronic device (200) according to one embodiment may be controlled by the processor (202) of the electronic device (200). When the electronic device (200) performs a specific operation, the electronic device (200) or a component included in the electronic device (200) may be controlled by the processor (202) of the electronic device (200). The processor (202) may be a circuit that performs processing. The electronic device (200) may include one or more processors (202). The operation(s) of the electronic device (200) may be processed by one processor (202). Some of the operations of the electronic device (200) may be processed by some of the processors (202) among the plurality of processors (202), and other of the operations of the electronic device (200) may be processed by other processors (202) among the plurality of processors (202). Hereinafter, even when a plurality of processors (202) are implemented, for convenience of explanation, the terms “operation of the electronic device (200)” or “operation of the processor (202)” will be used. According to one embodiment, the memory (203) may include instructions configured to cause at least one operation. When executed by the processor (202) of the electronic device (200), the instructions may cause the electronic device (200) to perform at least one operation. The electronic device (200) may include one or more memories (203). Hereinafter, “memory (203)” may be one memory (203) or a plurality of memories (203). Instructions may be stored in one memory (203). Some of the instructions may be stored in some of the plurality of memories (203), and other of the instructions may be stored in other of the plurality of memories (203).Hereinafter, even when a plurality of memories (203) are implemented, they will be referred to as “memories (203)” for convenience of explanation. According to one embodiment, in relation to the electronic device (200), a computer-readable storage medium storing instructions configured to cause at least one operation may be proposed.
[0064] According to one embodiment, referring to FIG. 3, the electronic device (200) may include a communication circuit (201) (e.g., a circuit included in the communication module (190) of FIG. 1). The electronic device (200) may include a display (204) (e.g., a display included in the display module (160) of FIG. 1). The electronic device (200) may include a speaker (205) (e.g., a speaker included in the audio output module (155) of FIG. 1). The electronic device (200) may include a sensor (e.g., an acceleration sensor (206), a gyro sensor (207)) (e.g., a sensor included in the sensor module (176) of FIG. 1). The electronic device (200) may include a Global Positioning System (GPS) device (208). The electronic device (200) may include an Ultra-wideband (UWB) device (209).
[0065] According to one embodiment, the third wearable device (330) (e.g., a smart watch) may include a communication circuit (e.g., corresponding to 201). The third wearable device (330) (e.g., a smart watch) may include a processor (e.g., corresponding to 202). The third wearable device (330) (e.g., a smart watch) may include a memory (e.g., corresponding to 203). The third wearable device (330) (e.g., a smart watch) may include a display (e.g., corresponding to 204). The third wearable device (330) (e.g., a smart watch) may include a speaker (e.g., corresponding to 205). The third wearable device (330) (e.g., a smart watch) may include an acceleration sensor (e.g., corresponding to 206). The third wearable device (330) (e.g., a smart watch) may include a gyro sensor (e.g., corresponding to 207). The third wearable device (330) (e.g., a smart watch) may include a GPS device (e.g., corresponding to 208). The third wearable device (330) (e.g., a smart watch) may include a UWB device (e.g., corresponding to 209).
[0066] According to one embodiment, referring to FIG. 3, a wearable device (310) may include a processor (312) and a memory (313). The processor (312) of the wearable device (310) may have a configuration corresponding to the processor (120) of FIG. 1. The memory (313) of the wearable device (310) may have a configuration corresponding to the memory (130) of FIG. 1.
[0067] According to one embodiment, the processor (312) of the wearable device (310) may be referred to as a controller (312). The operation of the wearable device (310) according to one embodiment may be controlled by the processor (312) of the wearable device (310). The wearable device (310) performing a specific operation may be controlled by the processor (312) of the wearable device (310) or a component included in the wearable device (310). The processor (312) may be circuitry that performs processing. The wearable device (310) may include one or more processors (312). The operation(s) of the wearable device (310) may be processed by one processor (312). Some of the operations of the wearable device (310) may be processed by some of the processors (312) among the plurality of processors (312), and other of the operations of the wearable device (310) may be processed by other processors (312) among the plurality of processors (312). Hereinafter, even when a plurality of processors (312) are implemented, for the convenience of explanation, the terms “operations of the wearable device (310)” or “operations of the processor (312)” will be used. According to one embodiment, the memory (313) may include instructions configured to cause at least one operation. When executed by the processor (312) of the wearable device (310), the instructions may cause the wearable device (310) to perform at least one operation. The wearable device (310) may include one or more memories (313). Hereinafter, “memory (313)” may be one memory (313) or multiple memories (313). Instructions may be stored in one memory (313). Some of the instructions may be stored in some of the multiple memories (313), and other of the instructions may be stored in other parts of the multiple memories (313).Hereinafter, even when a plurality of memories (313) are implemented, they will be referred to as "memories (313)" for convenience of explanation. According to one embodiment, in relation to a wearable device (310), a computer-readable storage medium storing instructions configured to cause at least one operation may be proposed.
[0068] According to one embodiment, referring to FIG. 3, the wearable device (310) may include a communication circuit (311) (e.g., a circuit corresponding to the communication module (190) of FIG. 1). The wearable device (310) may include a sensor (317) (e.g., a sensor corresponding to the sensor module (176) of FIG. 1).
[0069] According to one embodiment, referring to FIG. 3, a wearable device (310) may include a first electrode (314) and a second electrode (315). The first electrode (314) and the second electrode (315) may be exposed to the exterior of the wearable device (310) so as to be in contact with a user's body. A processor (312) of the wearable device (310) may be connected to the first electrode (314) and the second electrode (315). For example, the first electrode (314) may be referred to as an active electrode or a measuring electrode. For example, the second electrode (315) may be referred to as a reference electrode or a reference electrode. The wearable device (310) can obtain a signal based on the potential difference between the first electrode (314) (e.g., active electrode) and the second electrode (315) (e.g., reference electrode). For example, the wearable device (310) can obtain a signal based on the potential difference between the first electrode (314) (e.g., active electrode) and the second electrode (315) (e.g., reference electrode) using a differential amplifier. The signal obtained based on the potential difference between the first electrode (314) (e.g., active electrode) and the second electrode (315) (e.g., reference electrode) can include, for example, an electroencephalography (EEG) component, a brain-computer interface (BCI) component, and an electromyogram (EMG) component. According to one embodiment, the wearable device (310) may include a ground electrode (316). For example, the ground electrode (316) may be referred to as a ground electrode. The ground electrode (316) may be exposed to the exterior of the wearable device (310) so as to be in contact with a user's body. The processor (312) of the wearable device (310) may be connected to the ground electrode (316). The processor (312) of the wearable device (310) may also include the ground electrode (316) (e.g., an internal electrode of the processor (312)).The wearable device (310) may not include a ground electrode (316). The wearable device (310) may adjust the potential difference between the first electrode (314) and the second electrode (315) using a signal from the ground electrode (316).
[0070] Figure 4 is a drawing illustrating a data transmission path. Figure 5 is a drawing illustrating a data transmission path.
[0071] With reference to FIGS. 3, 4, and 5, the data transmission path can be understood. The embodiments of FIGS. 3, 4, and 5 differ only in the data transmission path, and the remaining operations excluding data transmission may be identical or similar.
[0072] FIG. 3 is a diagram illustrating the transmission of data of a wearable device (310) and an electronic device (200). FIG. 4 is a diagram illustrating the transmission of data of a wearable device (310), a server (400), and an electronic device (200). FIG. 5 is a diagram illustrating the transmission of data of a first wearable device (310), a second wearable device (320), a third wearable device (330), and an electronic device (200).
[0073] Referring to FIG. 3, according to one embodiment, a wearable device (310) can transmit a communication signal to an electronic device (200). The wearable device (310) can transmit the communication signal to the electronic device (200) using a communication circuit (311). The electronic device (200) can receive the communication signal from the wearable device (310) using a communication circuit (201). According to one embodiment, the electronic device (200) can transmit the communication signal to the wearable device (310). The electronic device (200) can transmit the communication signal to the wearable device (310) using a communication circuit (201). The wearable device (310) can receive the communication signal from the electronic device (200) using a communication circuit (311).
[0074] Referring to FIG. 4, according to one embodiment, a wearable device (310) can transmit a communication signal to an electronic device (200). The wearable device (310) can transmit the communication signal to the electronic device (200) using a communication circuit (e.g., 311). The electronic device (200) can receive the communication signal from the wearable device (310) using a communication circuit (e.g., 201). The electronic device (200) can transmit the communication signal to the server (400). The electronic device (200) can transmit the communication signal to the server (400) based on the communication signal provided from the wearable device (310). The server (400) can receive the communication signal from the electronic device (200). The server (400) can receive a communication signal transmitted from the electronic device (200) based on a communication signal provided from the wearable device (310). The server (400) can analyze the communication signal received from the electronic device (200). The server (400) can transmit a communication signal including the analysis result to the electronic device (200).
[0075] According to one embodiment, the wearable device (310) can transmit a communication signal to the server (400). The wearable device (310) can transmit the communication signal to the server (400) using a communication circuit (e.g., 311). The server (400) can receive the communication signal from the wearable device (310). The server (400) can transmit the communication signal to the electronic device (200). The server (400) can transmit the communication signal to the electronic device (200) based on the communication signal provided from the wearable device (310). The electronic device (200) can receive the communication signal from the server (400) using a communication circuit (e.g., 201). The electronic device (200) can receive a communication signal transmitted from a server (400) based on a communication signal provided from a wearable device (310) using a communication circuit (e.g., 201).
[0076] Referring to FIG. 5, according to one embodiment, a first wearable device (310) can transmit a communication signal to an electronic device (200). The first wearable device (310) can transmit the communication signal to the electronic device (200) using a communication circuit (e.g., 311). The electronic device (200) can receive the communication signal from the first wearable device (310) using a communication circuit (e.g., 201). According to one embodiment, a second wearable device (320) can transmit a communication signal to the electronic device (200) through the first wearable device (310). For example, the second wearable device (320) can transmit the communication signal to the first wearable device (310). The second wearable device (320) can transmit a communication signal to the first wearable device (310) using a communication circuit (e.g., corresponding to 311). The first wearable device (310) can receive a communication signal from the second wearable device (320). The first wearable device (310) can transmit a communication signal to the electronic device (200) based on the communication signal provided from the second wearable device (320). The electronic device (200) can receive the communication signal transmitted from the first wearable device (310) using a communication circuit (e.g., 201) based on the communication signal provided from the second wearable device (320). According to one embodiment, the second wearable device (320) may also transmit a communication signal directly to the electronic device (200), such as the first wearable device (310) of FIG. 3.
[0077] Referring to FIG. 5, according to one embodiment, the third wearable device (330) can transmit a communication signal to the electronic device (200). The third wearable device (330) can transmit the communication signal to the electronic device (200) using a communication circuit (e.g., corresponding to 201). The electronic device (200) can receive the communication signal from the third wearable device (330) using the communication circuit (201). According to one embodiment, the electronic device (200) can transmit the communication signal to the third wearable device (330). The electronic device (200) can transmit the communication signal to the third wearable device (330) using the communication circuit (201). The third wearable device (330) can receive a communication signal from the electronic device (200) using a communication circuit (e.g., corresponding to 201).
[0078] FIG. 6A is a diagram illustrating a first wearable electronic device and a second wearable electronic device according to one embodiment.
[0079] FIG. 6A is a drawing illustrating an example of the arrangement of electrodes of a first wearable electronic device (310) and a second wearable electronic device (320). The arrangement of electrodes of the first wearable electronic device (310) and the second wearable electronic device (320) is not limited to the embodiment of FIG. 6A.
[0080] Referring to (a) of FIG. 6A, according to one embodiment, the first wearable device (310) may include an ear tip (618) and a main body (or body part) (617) coupled with the ear tip (618). The shape of the ear tip (618) is not limited to the embodiment of FIG. 6A. The shape of the main body (or body part) (617) is not limited to the embodiment of FIG. 6A. For example, the main body (or body part) of the first wearable device (310) may be implemented in a form that wraps around a user's body (e.g., an ear) (e.g., FIG. 6B).
[0081] According to one embodiment, the first wearable device (310) may include a first electrode (314), a ground electrode (316), and a second electrode (315). The positions of the first electrode (314), the ground electrode (316), and the second electrode (315) are not limited to the embodiment of FIG. 6A. For example, the first electrode (314), the ground electrode (316), and the second electrode (315) may be positioned at the positions described in FIG. 7.
[0082] According to one embodiment, the processor (312) of the first wearable device (310) may be disposed in the main body (617). However, this is an example, and the processor (312) may also be disposed in the ear tip (618).
[0083] According to one embodiment, the first electrode (314) may be disposed on the main body (or body portion) (617). According to one embodiment, the first electrode (314) may include at least one electrode (e.g., a conductor electrode) exposed to the outside so as to be in contact with the user's body. Depending on the implementation, the first electrode (314) may be implemented with a plurality of electrodes. However, the number or shape of the electrodes included in the first electrode (314) may be modified to various numbers and / or shapes that can be understood by those skilled in the art. According to one embodiment, the first electrode (314) may be implemented with silver (Ag). However, this is an example, and the material of the first electrode (314) may not be limited thereto. According to one embodiment, the ground electrode (316) may be disposed on the ear tip (618). According to one embodiment, the ground electrode (316) may be a ground for generating a potential difference. For example, the ground electrode (316) may be exposed on the outside of the ear tip (618) so as to be in contact with the user's body. According to one embodiment, the second electrode (315) may be placed on the main body (617). For example, the second electrode (315) may be exposed on the outside of the main body (617) so as to be in contact with the user's body.
[0084] Referring to (b) of FIG. 6A, according to one embodiment, the second wearable device (320) may include an ear tip (628) and a main body (or body part) (627) coupled with the ear tip (628). The shape of the ear tip (628) is not limited to the embodiment of FIG. 6A. The shape of the main body (or body part) (627) is not limited to the embodiment of FIG. 6A. For example, the main body (or body part) of the second wearable device (320) may be implemented in a form that wraps around a user's body (e.g., an ear).
[0085] According to one embodiment, the second wearable device (320) may include a first electrode (324), a ground electrode (326), and a second electrode (325). The positions of the first electrode (324), the ground electrode (326), and the second electrode (325) are not limited to the embodiment of FIG. 6A. For example, the first electrode (324), the ground electrode (326), and the second electrode (325) may be positioned at the positions described in FIG. 7.
[0086] According to one embodiment, the processor (e.g., 312) of the second wearable device (320) may be disposed in the main body (627). However, this is an example, and the processor (e.g., 312) of the second wearable device (320) may also be disposed in the ear tip (628).
[0087] According to one embodiment, the first electrode (324) may be disposed on the main body (or body portion) (627). According to one embodiment, the first electrode (324) may include at least one electrode (e.g., a conductor electrode) exposed to the outside so as to be in contact with the user's body. Depending on the implementation, the first electrode (324) may be implemented with a plurality of electrodes. However, the number or shape of the electrodes included in the first electrode (324) may be modified into various numbers and / or shapes that can be understood by those skilled in the art. According to one embodiment, the first electrode (324) may be implemented with silver (Ag). However, this is an example, and the material of the first electrode (324) may not be limited thereto. According to one embodiment, the ground electrode (326) may be disposed on the ear tip (628). According to one embodiment, the ground electrode (326) may be a ground for generating a potential difference. For example, the ground electrode (326) may be exposed on the outside of the ear tip (628) so as to be in contact with the user's body. According to one embodiment, the second electrode (325) may be disposed on the main body (627). For example, the second electrode (325) may be exposed on the outside of the main body (627) so as to be in contact with the user's body.
[0088] FIG. 6B is a diagram illustrating a first wearable electronic device according to one embodiment.
[0089] FIG. 6B is a drawing illustrating an example of the arrangement of electrodes of the first wearable electronic device (310). The arrangement of electrodes of the first wearable electronic device (310) is not limited to the embodiment of FIG. 6B.
[0090] Referring to FIG. 6B, according to one embodiment, the first wearable device (310) may include an ear tip (618) and a main body (or body portion) (617) coupled with the ear tip (618). For example, the main body (or body portion) (617) may be connected to a housing (e.g., 631, 632, 633). For example, the first housing (631) may be connected to the main body (or body portion) (617). For example, the second housing (632) can be connected to the first housing (6310). For example, the second housing (632) can be implemented in a form that wraps around the user's body (e.g., ear). For example, a second electrode (315) can be placed in the second housing (632). For example, a third housing (633) can be connected to the first housing (6310). For example, a first electrode (314) can be placed in the third housing (633).
[0091] According to one embodiment, the first wearable device (310) may include a first electrode (314), a ground electrode (316), and a second electrode (315). The positions of the first electrode (314), the ground electrode (316), and the second electrode (315) are not limited to the embodiment of FIG. 6B. For example, the first electrode (314), the ground electrode (316), and the second electrode (315) may be positioned at the positions described in FIG. 7.
[0092] According to one embodiment, the processor (312) of the first wearable device (310) may be disposed in the main body (617). The processor (312) may also be disposed in the ear tip (618). The processor (312) of the first wearable device (310) may also be disposed in the first housing (631).
[0093] In the description of the electrodes (e.g., 314, 315, 316) of Fig. 6b, any description that overlaps with the description of the electrodes (e.g., 314, 315, 316) of Fig. 6a will be omitted.
[0094] FIG. 7 is a drawing showing one ear of a user wearing a wearable device according to one embodiment.
[0095] Let us explain Fig. 7 using the first wearable device (310) as an example.
[0096] According to one embodiment, referring to FIG. 7, the first electrode (314) of the wearable device (310) may be positioned at a location corresponding to one of a plurality of parts (e.g., “1”, “2”, “3”, “4”, “5”, “6”, “7”, “8”, “9”, “10”, “11”, “12”, “13”) of the user’s body (e.g., ear) of FIG. 7. The second electrode (315) of the wearable device (310) may be positioned at a location corresponding to one of a plurality of parts (e.g., “1”, “2”, “3”, “4”, “5”, “6”, “7”, “8”, “9”, “10”, “11”, “12”, “13”) of the user’s body (e.g., ear) of FIG. 7. The first electrode (314) and the second electrode (315) may be respectively positioned at positions corresponding to the same portion among multiple portions (e.g., “1”, “2”, “3”, “4”, “5”, “6”, “7”, “8”, “9”, “10”, “11”, “12”, “13”) of the user’s body (e.g., ear) of FIG. 7, or may be respectively positioned at positions corresponding to different portions. The first electrode (314) and the second electrode (315) may be respectively positioned at positions corresponding to the same portion, meaning that the first electrode (314) and the second electrode (315) may be positioned nearby. The ground electrode (316), like the first electrode (314) and the second electrode (315), may be positioned at a position corresponding to one of a plurality of parts (e.g., “1”, “2”, “3”, “4”, “5”, “6”, “7”, “8”, “9”, “10”, “11”, “12”, “13”) of the user’s body (e.g., ear) of FIG. 7. The ground electrode (316), like the first electrode (314) (or the second electrode (315), may be positioned at a position corresponding to the same part or may be positioned at a position corresponding to a different part among a plurality of parts (e.g., “1”, “2”, “3”, “4”, “5”, “6”, “7”, “8”, “9”, “10”, “11”, “12”, “13”) of the user’s body (e.g., ear) of FIG. 7.
[0097] For example, referring to FIG. 7, the wearable device (310) may be worn on either ear of the user. According to one embodiment, a ground electrode (316) included in the wearable device (310) may be brought into contact with a hole (e.g., “8” in FIG. 7) of either ear of the user. According to one embodiment, a first electrode (314) included in the wearable device (310) may be brought into contact with a first portion (e.g., “9” in FIG. 7) of a plurality of portions (e.g., “1”, “2”, “3”, “4”, “5”, “6”, “7”, “8”, “9”, “10”, “11”, “12”, “13”). According to one embodiment, the second electrode (315) included in the wearable device (310) may be brought into contact with a second portion (e.g., “13” in FIG. 7) among a plurality of portions (e.g., “1”, “2”, “3”, “4”, “5”, “6”, “7”, “8”, “9”, “10”, “11”, “12”, “13”).
[0098] According to one embodiment, the wearable device (310) can obtain a signal including an electroencephalography (EEG) component, a brain-computer interface (BCI) component, and an electromyogram (EMG) component based on the potential difference between a first electrode (314) and a second electrode (315) while being worn on one ear of a user.
[0099] FIG. 8 is a diagram illustrating a signal generated by a user's movement according to one embodiment.
[0100] FIG. 8 is a diagram illustrating a signal (e.g., a biosignal) according to one embodiment.
[0101] As described above, the signal (e.g., biosignal) of FIG. 8 may include an electroencephalography (EEG) component, a brain-computer interface (BCI) component, and an electromyogram (EMG) component. The horizontal axis of FIG. 8 may be time (e.g., [ns] (nano second)). The vertical axis of FIG. 9 may be a potential difference (e.g., [μV] (micro V)). For example, the frequency of the brain wave component may be included in a first frequency range (e.g., 0.1 to 20 [Hz]). The first frequency range (e.g., 0.1 to 20 [Hz]) is only an example. For example, the magnitude of the brain wave component may be included in a first voltage range (e.g., ±100 [μV]). The first voltage range (e.g., ±100 [μV]) is only an example. For example, the frequency of the BCI component may be included in a second frequency range (e.g., 0.1 to 5 [Hz]). The second frequency range (e.g., 0.1 to 5 [Hz]) is merely an example. For example, the magnitude of the BCI component may be included in a second voltage range (e.g., ±500 [μV]). The second voltage range (e.g., ±500 [μV]) is merely an example. For example, the frequency of the EMG component may be included in a third frequency range (e.g., 20 to 100 [Hz]). The third frequency range (e.g., 20 to 100 [Hz]) is merely an example. For example, the magnitude of the EMG component may be included in a first voltage range (e.g., ±100 [μV]). The first voltage range (e.g., ±100 [μV]) is merely an example.
[0102] In one embodiment, the analysis model (e.g., an EEG analysis model, a BCI analysis model, or an EMG analysis model) may be configured to perform analysis on the magnitude and frequency of a signal acquired based on the potential difference between electrodes. For example, an EEG signal may be identified by performing analysis on a signal acquired using the EEG analysis model (e.g., a biosignal). For example, a BCI signal may be identified by performing analysis on a signal acquired using the BCI analysis model (e.g., a biosignal). For example, an EMG signal may be identified by performing analysis on a signal acquired using the EMG analysis model (e.g., a biosignal). In one embodiment, the analysis model (e.g., an EEG analysis model, a BCI analysis model, or an EMG analysis model) may be included in the wearable device (310). For example, the wearable device (310) may perform an analysis on the magnitude and frequency of a signal acquired based on the potential difference between electrodes using an analysis model (e.g., an EEG analysis model, a BCI analysis model, or an EMG analysis model). According to one embodiment, the analysis model (e.g., an EEG analysis model, a BCI analysis model, or an EMG analysis model) may be included in the electronic device (200). For example, the electronic device (200) may perform an analysis on the magnitude and frequency of a signal acquired based on the potential difference between electrodes using an analysis model (e.g., an EEG analysis model, a BCI analysis model, or an EMG analysis model). According to one embodiment, the analysis model (e.g., an EEG analysis model, a BCI analysis model, or an EMG analysis model) may be included in the server (400). For example, the server (400) can perform analysis on the magnitude and frequency of a signal acquired based on the potential difference between electrodes using an analysis model (e.g., an EEG analysis model, a BCI analysis model, or an EMG analysis model).
[0103] The descriptions of FIGS. 1 through 8 can be applied to the embodiments described below. When describing the embodiments described below, portions that overlap with the descriptions of FIGS. 1 through 8 may be omitted. Any portions omitted from the descriptions of each drawing or each embodiment can be understood by referring to the descriptions of other drawings or embodiments.
[0104] FIG. 9 is a flowchart illustrating an operating method of a wearable device and an electronic device according to one embodiment. FIG. 9 may be described with reference to previously described embodiments and embodiments described below. Referring to FIG. 9, an embodiment in which an electronic device (200) performs analysis on a signal (e.g., a biosignal) using an analysis model (e.g., an EEG analysis model, a BCI analysis model, or an EMG analysis model) may be described.
[0105] At least some of the operations of FIG. 9 may be omitted. The order of the operations of FIG. 9 may be changed. Operations other than those of FIG. 9 may be performed before, during, or after the operations of FIG. 9.
[0106] Referring to FIG. 9, in operation 901, according to one embodiment, the wearable device (310) (e.g., the processor (312)) may obtain a first signal based on a potential difference between a first electrode (314) and a second electrode (315). The wearable device (310) may obtain the first signal based on the potential difference between the first electrode (314) and the second electrode (315) while the wearable device (310) is worn on a user's body (e.g., on either ear). According to one embodiment, as described above, the wearable device (310) may also adjust the potential difference between the first electrode (314) and the second electrode (315) using a signal from the ground electrode (316).
[0107] In operation 903, according to one embodiment, the wearable device (310) (e.g., processor (312)) may transmit first data to the electronic device (200) through the communication circuit (311) based on the first signal of operation 901. The first data may be data regarding the first signal. The first data may include information regarding the first signal. The electronic device (200) (e.g., processor (202)) may receive the first data regarding the first signal from the wearable device (310) through the communication circuit (201). The electronic device (200) (e.g., processor (202)) may verify the first signal based on the first data.
[0108] In operation 905, according to one embodiment, the electronic device (200) (e.g., processor (202)) can determine the magnitude of the first signal of operation 901 based on the first data of operation 903. The “magnitude of the first signal” may be the amplitude (e.g., potential difference [V]) of the first signal, as shown in FIG. 8. For example, the magnitude of the first signal may be the maximum value (or minimum value) of the first signal.
[0109] In operation 907, according to one embodiment, the electronic device (200) (e.g., processor (202)) may compare the magnitude of the first signal of operation 905 with a first reference value. The first reference value (e.g., ±100 μV) may be a reference value corresponding to an EEG analysis model. Here, the first reference value may also be a reference value corresponding to an EEG analysis model. For example, the first reference value may be greater than or equal to the maximum value of a general EEG signal (or EEG signal). Accordingly, a signal having a magnitude less than the first reference value may be used for EEG analysis (or EEG analysis). Meanwhile, a second reference value, which will be described later, may be greater than or equal to the maximum value of a general BCI signal. Accordingly, a signal having a magnitude less than the second reference value may be used for BCI analysis. At this time, the second reference value may be greater than the first reference value. Accordingly, signals having a magnitude less than the first threshold value can be used not only for EEG analysis (or EMG analysis) but also for BCI analysis. In one embodiment, operation 909 can be performed based on the magnitude of the first signal being less than the first threshold value.
[0110] In operation 909, according to one embodiment, the electronic device (200) (e.g., the processor (202)) may perform analysis on the first signal by using an EEG analysis model and a BCI analysis model based on the fact that the magnitude of the first signal of operation 905 is less than a first reference value. As described above, a signal having a magnitude less than the first reference value may be used not only for EEG analysis (or EMG analysis) but also for BCI analysis. The electronic device (200) may perform EEG analysis on the first signal by using the EEG analysis model based on the fact that the magnitude of the first signal is less than the first reference value. The electronic device (200) may perform BCI analysis on the first signal by using the BCI analysis model based on the fact that the magnitude of the first signal is less than the first reference value. The electronic device (200) may identify an EEG component included in the first signal and perform a first function corresponding to the identified EEG component. The electronic device (200) can identify a BCI component included in a first signal and perform a second function corresponding to the identified BCI component. There are no limitations on the first and second functions.
[0111] In operation 911, according to one embodiment, the electronic device (200) (e.g., processor (202)) may compare the magnitude of the first signal of operation 905 with a second reference value. The second reference value (e.g., ±500 μV) may be a reference value corresponding to a BCI analysis model. However, as described below, the second reference value may be set differently for each user, and this will be described with reference to FIGS. 11 to 17. The second reference value of operation 911 may be greater than the first reference value of operation 907. According to one embodiment, a signal having a magnitude less than the second reference value may be used for BCI analysis. According to one embodiment, a signal having a magnitude greater than or equal to the first reference value and less than the second reference value may not be used for EEG analysis (or EMG analysis), but may only be used for BCI analysis. In one embodiment, operation 913 may be performed based on the magnitude of the first signal being greater than or equal to the first threshold value and less than or equal to the second threshold value. In one embodiment, operation 915 may be performed based on the magnitude of the first signal being greater than or equal to the second threshold value.
[0112] In operation 913, according to one embodiment, the electronic device (200) (e.g., the processor (202)) may perform analysis on the first signal by using a BCI analysis model based on the fact that the magnitude of the first signal in operation 905 is greater than or equal to a first reference value and less than a second reference value. The electronic device (200) may perform BCI analysis on the first signal by using the BCI analysis model based on the fact that the magnitude of the first signal is greater than or equal to the first reference value and less than the second reference value. The electronic device (200) may identify a BCI component included in the first signal and perform a second function corresponding to the identified BCI component. Here, there is no limitation on the second function.
[0113] In operation 915, according to one embodiment, the performance of the operation may be stopped based on the magnitude of the first signal being greater than or equal to the second reference value. For example, "stopping the performance of the operation" may include stopping the measurement of the first signal of operation 901. For example, "stopping the performance of the operation" may include stopping the transmission (or reception) of the first data of operation 903. For example, "stopping the performance of the operation" may include stopping the measurement of the first signal of operation 901 and stopping the transmission (or reception) of the first data of operation 903. For example, "stopping the performance of the operation" may include maintaining the measurement of the first signal of operation 901 and stopping the transmission (or reception) of the first data of operation 903. According to one embodiment, the electronic device (200) (e.g., the processor (202)) may transmit a first request to the wearable device (310) via the communication circuit (201) to cause a stop in measurement of the first signal based on the magnitude of the first signal being greater than or equal to a second reference value. The wearable device (310) (e.g., the processor (312)) may receive the first request to cause a stop in measurement of the first signal from the electronic device (200) via the communication circuit (311). The wearable device (310) (e.g., the processor (312)) may stop the measurement of the first signal based on the first request. For example, the wearable device (310) (e.g., the processor (312)) may reduce power consumption by controlling an electrode channel to be off to stop the measurement of the first signal. For example, as described below, the wearable device (310) (e.g., processor (312)) may control the switch(es) (e.g., the switch(es) of FIG. 20) connected to the electrode(s) (e.g., the first electrode (314) and / or the second electrode (315)) to turn off in order to stop the measurement of the first signal.According to one embodiment, the electronic device (200) (e.g., processor (202)) may stop receiving the first data of operation 903 based on the magnitude of the first signal being greater than or equal to the second reference value. For example, the electronic device (200) (e.g., processor (202)) may transmit a communication signal requesting to stop transmission of the first data of operation 903 to the wearable device (310) through the communication circuit (201) based on the magnitude of the first signal being greater than or equal to the second reference value. For example, the wearable device (310) (e.g., processor (312)) may not transmit the first data to the electronic device (200) based on the communication signal requesting to stop transmission of the first data. For example, the wearable device (310) (e.g., processor (312)) may measure the first signal of operation 901, but may not transmit the first data for the first signal to the electronic device (200) based on a communication signal requesting to stop transmission of the first data. In one embodiment, the electronic device (200) (e.g., processor (202)) may not receive the first data for the first signal transmitted from the wearable device (310) based on the magnitude of the first signal being greater than or equal to the second reference value. In one embodiment, the electronic device (200) (e.g., processor (202)) may ignore the first data for the first signal transmitted from the wearable device (310) based on the magnitude of the first signal being greater than or equal to the second reference value.
[0114] In operation 917, according to one embodiment, the electronic device (200) (e.g., the processor (202)) may perform monitoring for movement after transmitting a first request that causes the measurement of the first signal of operation 901 to be stopped or after the reception of the first data of operation 903 is stopped. For example, “monitoring for movement” may include monitoring for movement of the electronic device (200). For example, “monitoring for movement” may include monitoring for movement of another device (e.g., a third wearable device (330) or a smart tag carried by the user). By monitoring for movement in operation 917, the user’s movement can be indirectly confirmed. For example, the electronic device (200) (e.g., the processor (202)) may determine that the user is moving based on the confirmation of movement by the monitoring for movement in operation 917. For example, the electronic device (200) (e.g., the processor (202)) may determine that the user is not moving based on the fact that no movement is detected by monitoring for movement in operation 917. In one embodiment, operation 917 may be performed using the acceleration sensor (206) of the electronic device (200). For example, the electronic device (200) may monitor for movement of the electronic device (200) using the acceleration sensor (206) after transmitting a first request that causes the measurement of the first signal in operation 901 to be stopped or after the reception of the first data in operation 903 is stopped. The electronic device (200) may determine the movement of the electronic device (200) based on the sensing value of the acceleration sensor (206) being greater than or equal to a reference value. The electronic device (200) can determine that the electronic device (200) is not moving based on the sensing value of the acceleration sensor (206) being less than a reference value. According to one embodiment, operation 917 can be performed using the gyro sensor (207) of the electronic device (200).For example, the electronic device (200) may monitor the movement of the electronic device (200) using the gyro sensor (207) of the electronic device (200) after transmitting the first request causing the measurement of the first signal of operation 901 to be stopped or after the reception of the first data of operation 903 is stopped. The electronic device (200) may determine the movement of the electronic device (200) based on the sensing value of the gyro sensor (207) being greater than or equal to a reference value. For example, the electronic device (200) may determine the movement of the electronic device (200) based on the sensing value of the gyro sensor (207) being greater than or equal to at least one of the reference values of the three directions. The electronic device (200) may determine that the electronic device (200) is not moving based on the sensing value of the gyro sensor (207) being less than the reference value. In one embodiment, operation 917 may be performed using the GPS device (208) of the electronic device (200). For example, after transmitting a first request causing a stop in the measurement of the first signal of operation 901 or stopping the reception of the first data of operation 903, the electronic device (200) may monitor the movement of the electronic device (200) using the GPS device (208) of the electronic device (200). The electronic device (200) may verify a GPS signal using the GPS device (208), convert the GPS signal from radians to meters of change, and calculate a speed. The electronic device (200) may verify the movement of the electronic device (200) based on the speed calculated using the GPS device (208) being greater than or equal to 0 and less than a reference speed (e.g., 4 km / h). The electronic device (200) can determine that the electronic device (200) is not moving based on the speed calculated using the GPS device (208) being 0 or greater than a reference speed (e.g., 4 km / h).For example, when a user of an electronic device (200) is moving in a car or an airplane, even if the speed calculated using the GPS device (208) is higher than a reference speed (e.g., 4 km / h), the electronic device (200) (e.g., the user) may be stationary. In one embodiment, operation 917 may be performed using the UWB device (209) of the electronic device (200). For example, the electronic device (200) may monitor the movement of the electronic device (200) using the UWB device (209) of the electronic device (200) after transmitting the first request causing the measurement of the first signal of operation 901 to be stopped or after stopping the reception of the first data of operation 903. The electronic device (200) can monitor the movement of the electronic device (200) using the UWB device (209) by the time of flight (ToF), time difference of arrival (TDoA), phase difference of arrival (PDoA), and / or angle of arrival (AoA) method. For example, the electronic device (200) can determine the movement of the electronic device (200) based on whether the electronic device (200) moves more than a reference distance using the UWB device (209). The electronic device (200) can determine whether the electronic device (200) is not moving based on whether the electronic device (200) moves less than a reference distance or stops using the UWB device (209). The electronic device (200) can monitor the movement of the electronic device (200) using the UWB device (209) at every reference cycle. According to one embodiment, operation 917 may be performed using a communication circuit (e.g., 190; 201) of the electronic device (200).For example, the electronic device (200) may monitor the movement of the electronic device (200) by using the communication circuit (e.g., 190; 201) of the electronic device (200) after transmitting the first request causing the measurement of the first signal of the operation 901 to be stopped or after the reception of the first data of the operation 903 has been stopped. The electronic device (200) may monitor the movement of the electronic device (200) by using the RSSI (received signal strength indicator) method by using the communication circuit (e.g., 190; 201). For example, the electronic device (200) may determine the movement of the electronic device (200) based on a change in the RSSI of a signal received through the communication circuit (e.g., 190; 201). For example, the electronic device (200) can determine the movement of the electronic device (200) based on the determination of movement greater than a reference distance during a reference time by a change in the RSSI of a signal received through a communication circuit (e.g., 190; 201).
[0115] As described above, operation 917 may include monitoring the movement of another device (e.g., the third wearable device (330) or a smart tag carried by the user). In one embodiment, the electronic device (200) (e.g., the processor (202)) may perform the monitoring of the movement of another device (e.g., the third wearable device (330) or a smart tag carried by the user). For example, the electronic device (200) (e.g., the processor (202)) may detect the movement (e.g., the movement of the third wearable device (330)) based on receiving a signal from the third wearable device (330) indicating the occurrence of movement of the third wearable device (330). For example, the third wearable device (330) may include an acceleration sensor, a gyro sensor, a GPS device, an UWB device, and / or communication circuitry. For example, the third wearable device (330) may transmit a signal indicating the occurrence of movement of the third wearable device (330) to the electronic device (200) based on confirming the movement of the third wearable device (330) using an acceleration sensor of the third wearable device (330). For example, the third wearable device (330) may transmit a signal indicating the occurrence of movement of the third wearable device (330) to the electronic device (200) based on confirming the movement of the third wearable device (330) using a gyro sensor of the third wearable device (330). For example, the third wearable device (330) may transmit a signal indicating the occurrence of movement of the third wearable device (330) to the electronic device (200) based on confirming the movement of the third wearable device (330) using the GPS device of the third wearable device (330).For example, the third wearable device (330) may transmit a signal indicating the occurrence of movement of the third wearable device (330) to the electronic device (200) based on confirming the movement of the third wearable device (330) using the UWB device of the third wearable device (330). For example, the third wearable device (330) may transmit a signal indicating the occurrence of movement of the third wearable device (330) to the electronic device (200) based on confirming the movement of the third wearable device (330) using the RSSI method using the communication circuit of the third wearable device (330). According to one embodiment, the electronic device (200) (e.g., the processor (202)) may also confirm the movement of the user using the UWB method by using a smart tag carried by the user. The method of monitoring the movement of the 917 action (e.g., the movement of the electronic device (200), the movement of the third wearable device (330), or the movement of the smart tag) is only an example, and there is no limitation on the method of “monitoring the movement.”
[0116] In operation 919, according to one embodiment, the electronic device (200) (e.g., processor (202)) may continue to perform operation 917 based on detecting movement (e.g., movement of the electronic device (200), movement of the third wearable device (330), or movement of the smart tag) through operation 917. In one embodiment, the electronic device (200) (e.g., processor (202)) may perform operation 921 based on not detecting movement (e.g., movement of the electronic device (200), movement of the third wearable device (330), or movement of the smart tag) through operation 917.
[0117] In operation 921, according to one embodiment, the electronic device (200) (e.g., the processor (202)) may request a resumption of the operation. For example, the electronic device (200) may request a resumption of the operation from the wearable device (310). The resumption of the operation may be a resumption of the operation that was stopped in operation 915. For example, the "resumption of the operation" may include a resumption of the measurement of the first signal in operation 901. For example, the "resumption of the operation" may include a resumption of the transmission (or reception) of the first data in operation 903. In one embodiment, the electronic device (200) (e.g., processor (202)) may transmit a second request to the wearable device (310) via the communication circuit (190; 201) to cause resumption of measurement of the first signal based on the fact that no movement (e.g., movement of the electronic device (200), movement of the third wearable device (330), or movement of the smart tag) is detected by operation 917. In one embodiment, the electronic device (200) (e.g., processor (202)) may request resumption of transmission of the first data of operation 903 to the wearable device (310) based on the fact that no movement (e.g., movement of the electronic device (200), movement of the third wearable device (330), or movement of the smart tag) is detected by operation 917. In one embodiment, the electronic device (200) (e.g., processor (202)) may resume receiving the first data of operation 903 through the communication circuit (190; 201) based on the fact that no movement (e.g., movement of the electronic device (200), movement of the third wearable device (330), or movement of the smart tag) is detected by operation 917. In one embodiment, the electronic device (200) (e.g., processor (202)) may stop monitoring for the movement of operation 917 based on transmitting the second request or resuming the reception of the first data.
[0118] In operation 923, according to one embodiment, the wearable device (310) (e.g., the processor 312) may resume the operation based on receiving a request to resume the operation. According to one embodiment, the wearable device (310) (e.g., the processor 312) may resume the measurement of the first signal of operation 901. For example, the wearable device (310) (e.g., the processor 312) may control the electrode channel to turn on in order to resume the measurement of the first signal. For example, as described below, the wearable device (310) (e.g., the processor 312) may control the switch(es) (e.g., the switch(es) of FIG. 20) connected to the electrode(s) (e.g., the first electrode (314) and / or the second electrode (315)) to turn on in order to resume the measurement of the first signal. In one embodiment, the wearable device (310) (e.g., processor (312)) may resume transmission of the first data of operation 903.
[0119] FIG. 10 is a flowchart of a method of operating an electronic device according to one embodiment. FIG. 10 can be explained with reference to the previously described embodiments and the embodiments described below.
[0120] At least some of the operations of FIG. 10 may be omitted. The order of the operations of FIG. 10 may be changed. Operations other than those of FIG. 10 may be performed before, during, or after the operations of FIG. 10.
[0121] Referring to FIG. 10, in operation 1001, according to one embodiment, the electronic device (200) (e.g., the processor (202)) may stop performing the operation. Operation 1001 may be understood with reference to operation 915 of FIG. 9. For example, the electronic device (200) (e.g., the processor (202)) may transmit a first request to the wearable device (310) via the communication circuit (201) to cause the stop of measurement of the first signal based on the magnitude of the first signal being greater than or equal to the second reference value. For example, the electronic device (200) (e.g., the processor (202)) may stop receiving the first data of operation 903 based on the magnitude of the first signal being greater than or equal to the second reference value. For example, the electronic device (200) (e.g., processor (202)) may transmit a communication signal requesting to stop transmission of the first data of operation 903 to the wearable device (310) through the communication circuit (201) based on the fact that the magnitude of the first signal is greater than or equal to the second reference value. For example, the electronic device (200) (e.g., processor (202)) may not receive the first data for the first signal transmitted from the wearable device (310) based on the fact that the magnitude of the first signal is greater than or equal to the second reference value. For example, the electronic device (200) (e.g., processor (202)) may ignore the first data for the first signal transmitted from the wearable device (310) based on the fact that the magnitude of the first signal is greater than or equal to the second reference value. Duplicate descriptions will be omitted.
[0122] In operation 1003, according to one embodiment, the electronic device (200) (e.g., processor (202)) may perform monitoring for movement. Operation 1003 may be understood with reference to operation 917 of FIG. 9 . For example, the electronic device (200) (e.g., processor (202)) may perform monitoring for movement (e.g., movement of the electronic device (200), movement of the third wearable device (330), or movement of the smart tag) after transmitting a first request that causes the measurement of the first signal of operation 901 to be stopped, or after stopping the reception of the first data of operation 903. Duplicate descriptions will be omitted.
[0123] In operation 1005, according to one embodiment, the electronic device (200) (e.g., processor 202) may determine whether motion is detected by monitoring for motion. Operation 1005 may be understood with reference to operation 919 of FIG. 9. According to one embodiment, the electronic device (200) (e.g., processor 202) may perform operation 1009 based on the fact that motion (e.g., motion of the electronic device (200), motion of the third wearable device (330), or motion of the smart tag) is not detected. According to one embodiment, the electronic device (200) (e.g., processor 202) may perform operation 1007 while motion (e.g., motion of the electronic device (200), motion of the third wearable device (330), or motion of the smart tag) is detected by monitoring for motion.
[0124] In operation 1007, according to one embodiment, the electronic device (200) (e.g., processor 202) may determine whether an EEG measurement event has occurred. The “EEG measurement event” may include the execution of an application for measuring EEG. For example, based on the execution of the application for measuring EEG, the electronic device (200) (e.g., processor 202) may determine the occurrence of an EEG measurement event. According to one embodiment, the electronic device (200) (e.g., processor 202) may continue to perform operation 1003 based on the fact that the EEG measurement event has not occurred. According to one embodiment, the electronic device (200) (e.g., processor 202) may perform operation 1009 based on the fact that the EEG measurement event has occurred. In FIG. 10, operation 1007 is illustrated as being performed after operations 1003 and 1005, but this is for convenience of explanation. According to one embodiment, the electronic device (200) (e.g., processor (202)) may perform operation 1007, regardless of operations 1003 and 1005, after operation 1001 is performed.
[0125] In operation 1009, according to one embodiment, the electronic device (200) (e.g., processor (202)) may request resumption of the operation. For example, the electronic device (200) may request resumption of the operation to the wearable device (310). Operation 1009 may be understood with reference to operation 921 of FIG. 9 . For example, the electronic device (200) (e.g., processor (202)) may transmit a second request to the wearable device (310) via the communication circuit (190; 201) that causes resumption of measurement of the first signal of operation 901. For example, the electronic device (200) (e.g., processor (202)) may request resumption of transmission of the first data of operation 903 to the wearable device (310). Duplicate descriptions will be omitted.
[0126] In operation 1011, according to one embodiment, the electronic device (200) (e.g., processor (202)) may resume operation. For example, the electronic device (200) (e.g., processor (202)) may resume receiving the first data of operation 903 via the communication circuit (190; 201).
[0127] In operation 1013, according to one embodiment, the electronic device (200) (e.g., processor (202)) may stop monitoring the movement of operation 1003 based on transmitting the second request in operation 1009 or resuming reception of the first data in operation 1011.
[0128] In one embodiment, the electronic device (200) (e.g., processor (202)) may not perform operation 1009 based on the execution of an application that does not require EEG measurement, even if no motion is detected in operation 1005. For example, the electronic device (200) (e.g., processor (202)) may not perform operation 1009 while the application that does not require EEG measurement is being executed, even if no motion is detected in operation 1005. For example, the electronic device (200) (e.g., processor (202)) may also stop performing operation 1003 while the application that does not require EEG measurement is being executed. For example, the electronic device (200) (e.g., processor (202)) may resume performing operation 1003 based on the termination of the application that does not require EEG measurement after stopping performing operation 1003.
[0129] Figure 11 is a flowchart illustrating a method of operating an electronic device according to one embodiment. Figure 11 can be explained with reference to previously described embodiments and embodiments described below. Referring to Figure 11, a method of setting a second reference value (e.g., a reference value corresponding to a BCI analysis model) for each user can be explained.
[0130] FIG. 11 can be described with reference to FIG. 12, FIG. 13, FIG. 14, and FIG. 15. FIG. 12 is a diagram illustrating the operation of an electronic device according to one embodiment. FIG. 13 is a diagram illustrating the operation of an electronic device according to one embodiment. FIG. 14 is a diagram illustrating the operation of an electronic device according to one embodiment. FIG. 15 is a diagram illustrating the operation of an electronic device according to one embodiment.
[0131] At least some of the operations of FIG. 11 may be omitted. The order of the operations of FIG. 11 may be changed. Operations other than those of FIG. 11 may be performed before, during, or after the operations of FIG. 11.
[0132] Referring to FIG. 11, in operation 1101, according to one embodiment, the electronic device (200) (e.g., processor (202)) may control the display (160; 204) to display a guide screen for setting a second reference value (e.g., a reference value corresponding to a BCI analysis model).
[0133] In operation 1103, according to one embodiment, the electronic device (200) (e.g., the processor (202)) may receive second data for a second signal from the wearable device (310). The second signal may be a signal acquired while the guide screen of operation 1101 is displayed, based on a potential difference between the first electrode (314) and the second electrode (315) of the wearable device (310).
[0134] In operation 1105, according to one embodiment, the electronic device (200) (e.g., the processor (202)) may apply the BCI analysis model to the second data of operation 1103. In operation 1107, according to one embodiment, the electronic device (200) (e.g., the processor (202)) may set a second reference value (e.g., a reference value corresponding to the BCI analysis model) by applying the BCI analysis model to the second data. Through the operations of FIG. 11, the second reference value (e.g., a reference value corresponding to the BCI analysis model) may be set for each user.
[0135] The operation of FIG. 11 can be explained with reference to FIGS. 12, 13, 14, and 15. FIG. 12 may represent a screen (1200) for selecting a gesture to input. FIG. 13 may represent a standby screen (1300) before recording a gesture (e.g., blinking). FIG. 14 may represent a guide screen (1410, 1420) that guides a user to input a gesture (e.g., blinking) at the correct timing. FIG. 15 may represent a feedback screen (1510, 1520) for an input gesture.
[0136] Referring to FIG. 12, according to one embodiment, an electronic device (200) (e.g., a processor (202)) may display a screen (1200) on a display (204) for selecting a gesture to be input in order to set a second reference value (e.g., a reference value corresponding to a BCI analysis model). The screen (1200) of FIG. 12 may include a list (1207) for selecting a gesture to be input. The list (1207) may include object(s) (e.g., 1201, 1202, 1206) corresponding to the gesture(s). The gesture(s) to be input may include, for example, blinking an eye once (e.g., Eye blink(Once)), blinking an eye twice (e.g., Eye blink(Twice)), looking upward (e.g., Eye movement(Up)), looking downward (e.g., Eye movement(Down)), looking left (e.g., Eye movement(Left)), and looking right (e.g., Eye movement(Right)). The screen (1200) of FIG. 12 may include a list representing stored records (e.g., a list including 1208).
[0137] Referring to FIG. 13, according to one embodiment, an electronic device (200) (e.g., processor (202)) may display a screen (1300) of FIG. 13 based on a user input selecting, for example, 1201 in FIG. 12. The screen (1300) of FIG. 13 may be a standby screen (1300) before recording a gesture (e.g., eye blinking).
[0138] Referring to FIG. 14, according to one embodiment, the electronic device (200) (e.g., the processor (202)) may display the first screen (1410) of FIG. 14 and then display the second screen (1420) of FIG. 14 based on the start of recording of a gesture (e.g., eye blinking) after displaying the screen (1300) of FIG. 13. The first screen (1410) and the second screen (1420) of FIG. 14 may be guide screens (1410, 1420) that guide a user to input a gesture (e.g., eye blinking) at an accurate timing. The guide screens (1410, 1420) may include a first object (1401) and a second object (1402) for guiding the user's eye blinking. The first object (1401) may be a moving object. The second object (1402) may be a fixed object. The user may be guided to blink at the moment when the first object (1401) overlaps with the second object (1402) after the first object (1401) starts moving, via the guide screens (1410, 1420). For example, at a first point in time, the first object (1401) may be displayed at a first location on the guide screen (1410). At the first point in time, the second object (1402) may be displayed at a second location on the guide screen (1410). After the first point in time, the first object (1401) may start moving toward the second object (1402). At the second point in time, the first object (1401) and the second object (1402) may be displayed at a second location on the guide screen (1420).
[0139] The screen of Fig. 14 is only an example. For example, the guide screen for setting the second reference value may be a guide screen for receiving input when images overlap and come down from the top, as in Fig. 14. For example, the guide screen for setting the second reference value may be a guide screen for receiving input when images can move in various directions other than the top-down direction (e.g., left / right / down) and overlap. For example, the guide screen for setting the second reference value may be a guide screen for receiving input when the characteristics (e.g., shape, transparency, color) of a single, fixed image that does not move change. For example, the guide screen for setting the second reference value may include a number timer. For example, the guide screen for setting the second reference value may be displayed and input may be received while a specified sound is played.
[0140] As described above in operation 1103, according to one embodiment, the electronic device (200) (e.g., processor (202)) may receive second data for a second signal from the wearable device (310). The second signal may be a signal acquired while the guide screen of operation 1101 (e.g., 1410, 1420 of FIG. 14) is displayed, based on a potential difference between the first electrode (314) and the second electrode (315) of the wearable device (310). Based on operations 1105 and 1107, according to one embodiment, the electronic device (200) (e.g., processor (202)) may set a second reference value.
[0141] Referring to (a) of FIG. 15, according to one embodiment, the electronic device (200) (e.g., processor (202)) may display the screen (1510) of (a) of FIG. 15 based on setting the second reference value. The screen (1510) of FIG. 15 may include an object (1511) indicating that the second reference value has been set. The screen (1510) of FIG. 15 may include an object (1512) for termination. The screen (1510) of FIG. 15 may include an object (1513) for retry.
[0142] Referring to (b) of FIG. 15, according to one embodiment, the electronic device (200) (e.g., the processor (202)) may display the screen (1520) of (b) of FIG. 15 based on failure to receive data in operation 1103 or failure to set the second reference value in operation 1107. The screen (1520) of FIG. 15 (b) may include an object (1521) indicating failure to set the second reference value. The screen (1520) of FIG. 15 (b) may include an object (1522) for retry. The screen (1520) of FIG. 15 (b) may include an object (1523) for termination.
[0143] The operations of FIGS. 11 to 15 can be explained with reference to FIGS. 16 and 17.
[0144] Figure 16 is a flowchart illustrating a method of operating an electronic device according to one embodiment. Figure 16 can be explained with reference to previously described embodiments and embodiments described below. Referring to Figure 16, a method of setting a second reference value (e.g., a reference value corresponding to a BCI analysis model) for each user by using data for a specified period of time among the second data can be explained.
[0145] FIG. 16 can be explained with reference to FIG. 17. FIG. 17 is a diagram illustrating the operation of an electronic device according to one embodiment. With reference to FIG. 17, data for a specified period of time among the second data can be explained.
[0146] At least some of the operations of FIG. 16 may be omitted. The order of the operations of FIG. 16 may be changed. Operations other than those of FIG. 16 may be performed before, during, or after the operations of FIG. 16.
[0147] Referring to FIG. 16, in operation 1601, according to one embodiment, the electronic device (200) (e.g., processor (202)) may display a guide screen (e.g., 1410, 1420 of FIG. 14) for setting a second reference value (e.g., a reference value corresponding to a BCI analysis model). According to one embodiment, the electronic device (200) (e.g., processor (202)) may transmit a signal indicating that the guide screen (e.g., 1410, 1420 of FIG. 14) is displayed to the wearable device (310) through the communication circuit (201). According to one embodiment, the electronic device (200) (e.g., processor (202)) may not transmit a signal indicating that the guide screen (e.g., 1410, 1420 of FIG. 14) is displayed to the wearable device (310).
[0148] In operation 1603, according to one embodiment, the wearable device (310) (e.g., processor (312)) may obtain a second signal based on a potential difference between the first electrode (314) and the second electrode (315) while a guide screen (e.g., 1410, 1420 of FIG. 14) is displayed on the display (204) of the electronic device (200). According to one embodiment, the wearable device (310) (e.g., processor (312)) may obtain the second signal based on receiving a signal indicating that the guide screen (e.g., 1410, 1420 of FIG. 14) is displayed. According to one embodiment, the wearable device (310) (e.g., processor (312)) may acquire a second signal while the guide screen (e.g., 1410, 1420 of FIG. 14) is displayed on the display (204) of the electronic device (200), regardless of whether a signal indicating that the guide screen (e.g., 1410, 1420 of FIG. 14) is displayed is received. For example, the wearable device (310) (e.g., processor (312)) may acquire a second signal while the guide screen (e.g., 1410, 1420 of FIG. 14) is displayed on the display (204) of the electronic device (200), even if a signal indicating that the guide screen (e.g., 1410, 1420 of FIG. 14) is not received.
[0149] In operation 1605, according to one embodiment, the wearable device (310) (e.g., processor (312)) may transmit second data to the electronic device (200) through the communication circuit (311) based on the second signal of operation 1603. The second data may be data about the second signal. The second data may include information about the second signal. The electronic device (200) (e.g., processor (202)) may receive second data about the second signal from the wearable device (310) through the communication circuit (201). The electronic device (200) (e.g., processor (202)) may verify the second signal based on the second data. According to one embodiment, the second data may include information about when the second signal was acquired. For example, the second data may include information indicating that the second signal was acquired while the guide screen (e.g., 1410, 1420 of FIG. 14) was displayed on the display (204) of the electronic device (200). For example, the second data may include information about the time point at which the second signal was acquired, regardless of the display time point of the guide screen (e.g., 1410, 1420 of FIG. 14). According to one embodiment, the second data may not include information about the time point at which the second signal was acquired. According to one embodiment, the electronic device (200) (e.g., the processor (202)) may compare the time point at which the guide screen (e.g., 1410, 1420 of FIG. 14) was displayed on the display (204) of the electronic device (200) with the time point at which the second signal was acquired, based on the second data. According to one embodiment, when the second data includes information about a point in time, the electronic device (200) (e.g., processor (202)) may, based on the second data, match the point in time when the guide screen (e.g., 1410, 1420 of FIG. 14) was displayed on the display (204) of the electronic device (200) with the point in time when the second signal was acquired.In one embodiment, the electronic device (200) (e.g., processor (202)) may not determine when the second signal was acquired.
[0150] In operation 1607, according to one embodiment, the electronic device (200) (e.g., processor (202)) may check, among the second data of operation 1605, data for a specified period of time. The "specified period of time" may be a specified period of time before and after the moment when a gesture (e.g., eye blinking) is input. For example, the "specified period" may be a specified period (e.g., 3 seconds) before and after the second point in time (e.g., 1.5 seconds before and 1.5 seconds after the second point in time) at which the first object (1401) and the second object (1402) are overlapped and displayed in the guide screen (1420) of FIG. 14. However, since the user may not blink his / her eyes exactly at the second point in time at which the first object (1401) and the second object (1402) are overlapped and displayed in FIG. 14, it is necessary to resolve this problem. Therefore, the specified period is set in relation to the corresponding gesture (e.g., blinking), but it is necessary to determine the start point of the specified period.
[0151] In relation to operation 1607, referring to FIG. 17, according to one embodiment, the electronic device (200) (e.g., the processor (202)) may identify a plurality of sub-data from among the second data. The electronic device (200) (e.g., the processor (202)) may identify sub-data to be used in operation 1609 from among the plurality of sub-data. For example, the second data may be divided into a plurality of sub-data including first sub-data (1701), second sub-data (1702), third sub-data (1703), fourth sub-data (1704), and fifth sub-data (1707). Each of the plurality of sub-data may include data for a specified period of time (e.g., a specified period corresponding to a corresponding gesture). The starting points of the plurality of sub-data may be different. For example, the starting point of the first sub-data (1701) may be the starting point of the second data. For example, the starting point of the first sub-data (1701) may be the first point in time in the guide screen (1410) of FIG. 14. The interval between sub-data may be a specified interval. For example, the starting point of the second sub-data may be a point in time after a specified interval from the starting point of the first sub-data. According to one embodiment, the electronic device (200) (e.g., the processor (202)) may compare the first RMS (root mean square) of the first sub-data with the RMS of other sub-data. For example, the electronic device (200) (e.g., the processor (202)) may calculate the first RMS (root mean square) of the first sub-data corresponding to a specified period from the first point in time among the second data. The electronic device (200) (e.g., the processor (202)) may calculate a plurality of RMSs of a plurality of sub-data corresponding to a specified period from a plurality of points in time after the first point in time among the second data.The electronic device (200) (e.g., processor (202)) can compare a plurality of RMSs with the first RMS to identify a second RMS having the largest difference from the first RMS among the plurality of RMSs. The electronic device (200) (e.g., processor (202)) can identify a second sub-data (e.g., 1704 of FIG. 17) corresponding to the second RMS among the plurality of sub-data. The electronic device (200) (e.g., processor (202)) can use the second sub-data (e.g., 1704 of FIG. 17) corresponding to the second RMS in operation 1607. According to one embodiment, the electronic device (200) (e.g., processor (202)) can also adjust a designated period corresponding to the corresponding gesture. For example, the electronic device (200) (e.g., processor (202)) may select a designated period during which the difference in RMS becomes greater by comparing the difference between the first RMS of the first sub-data and the plurality of RMSs of the plurality of sub-data while adjusting a designated period corresponding to the gesture.
[0152] In operation 1609, according to one embodiment, the electronic device (200) (e.g., the processor (202)) may apply the BCI analysis model to the sub-data of operation 1607 (e.g., 1704 of FIG. 17) among the second data. In operation 1611, according to one embodiment, the electronic device (200) (e.g., the processor (202)) may set a second reference value based on the magnitude of the BCI signal confirmed by applying the BCI analysis model to the sub-data of operation 1607 (e.g., 1704 of FIG. 17) among the data of the second operation. For example, the electronic device (200) (e.g., the processor (202)) may set the maximum value of the magnitude of the confirmed BCI signal as the second reference value corresponding to the BCI analysis model.
[0153] FIG. 18 is a flowchart of a method of operating a wearable device according to one embodiment. FIG. 18 can be explained with reference to previously described embodiments and embodiments to be described below. Referring to FIG. 18, an embodiment in which a wearable device (310) performs analysis on a signal (e.g., a biosignal) using an analysis model (e.g., an EEG analysis model, a BCI analysis model, or an EMG analysis model) can be explained.
[0154] At least some of the operations of FIG. 18 may be omitted. The order of the operations of FIG. 18 may be changed. Operations other than those of FIG. 18 may be performed before, during, or after the operations of FIG. 18.
[0155] Referring to FIG. 18, in operation 1801, according to one embodiment, the wearable device (310) (e.g., the processor (312)) may obtain a first signal based on a potential difference between a first electrode (314) and a second electrode (315). The wearable device (310) may obtain the first signal based on the potential difference between the first electrode (314) and the second electrode (315) while the wearable device (310) is worn on a user's body (e.g., on either ear). According to one embodiment, as described above, the wearable device (310) may also adjust the potential difference between the first electrode (314) and the second electrode (315) using a signal from the ground electrode (316).
[0156] In operation 1803, according to one embodiment, the wearable device (310) (e.g., processor (312)) may determine the magnitude of the first signal of operation 1801.
[0157] In operation 1805, according to one embodiment, the wearable device (310) (e.g., processor (312)) may compare the magnitude of the first signal of operation 1803 with a first reference value. The first reference value (e.g., ±100 μV) may be a reference value corresponding to an EEG analysis model (or an EMG analysis model), as described above. The description of the first reference value is omitted as it overlaps with the description of operation 907 of FIG. 9 . According to one embodiment, operation 1807 may be performed based on the magnitude of the first signal being less than the first reference value.
[0158] In operation 1807, according to one embodiment, the wearable device (310) (e.g., the processor (312)) may perform analysis on the first signal by using an EEG analysis model and a BCI analysis model based on the fact that the magnitude of the first signal in operation 1803 is less than a first reference value. As described above, a signal having a magnitude less than the first reference value may be used not only for EEG analysis (or EMG analysis) but also for BCI analysis. The wearable device (310) may perform EEG analysis on the first signal by using the EEG analysis model based on the fact that the magnitude of the first signal is less than the first reference value. The wearable device (310) may perform BCI analysis on the first signal by using the BCI analysis model based on the fact that the magnitude of the first signal is less than the first reference value. According to one embodiment, the wearable device (310) can identify a brain wave component included in a first signal and transmit the analysis result to the electronic device (200) (e.g., operation 1809). The electronic device (200) can perform a first function corresponding to the identified brain wave component based on the analysis result provided by the wearable device (310). According to one embodiment, the wearable device (310) can identify a BCI component included in a first signal and transmit the analysis result to the electronic device (200) (e.g., operation 1809). The electronic device (200) can perform a second function corresponding to the identified BCI component based on the analysis result provided by the wearable device (310). Here, there is no limitation on the first function and the second function.
[0159] In operation 1811, according to one embodiment, the wearable device (310) (e.g., processor (312)) may compare the magnitude of the first signal of operation 1803 with a second reference value. The second reference value (e.g., ±500 μV) may be a reference value corresponding to the BCI analysis model. However, as described above, the second reference value may be set differently for each user, and this has been described with reference to FIGS. 11 to 17. In the embodiments of FIGS. 11 to 17, the electronic device (200) may transmit information about the second reference value set for each user to the wearable device (310). The wearable device (310) may store information about the second reference value set for each user, which is provided from the electronic device (200), in the memory (313). The description of the second reference value is omitted as it overlaps with the description of operation 911 of FIG. 9. According to one embodiment, operation 1813 may be performed based on the magnitude of the first signal being greater than or equal to the first reference value and less than the second reference value.
[0160] In operation 1813, according to one embodiment, the wearable device (310) (e.g., processor (312)) may perform an analysis on the first signal by using a BCI analysis model based on the fact that the magnitude of the first signal in operation 1803 is greater than or equal to a first reference value and less than a second reference value. According to one embodiment, the wearable device (310) may identify a BCI component included in the first signal and transmit the analysis result to the electronic device (200) (e.g., operation 1809). The electronic device (200) may perform a second function corresponding to the identified BCI component based on the analysis result provided by the wearable device (310). Here, there is no limitation on the second function.
[0161] In operation 1815, according to one embodiment, the performance of the operation may be stopped based on the magnitude of the first signal being greater than or equal to the second threshold value. For example, "stopping the performance of the operation" may include stopping the measurement of the first signal in operation 1801. For example, "stopping the performance of the operation" may be stopping the analysis of the first signal. For example, "stopping the performance of the operation" may be stopping the transmission of the analysis result of the first signal. According to one embodiment, the wearable device (310) (e.g., the processor (312)) may stop the measurement of the first signal based on the magnitude of the first signal being greater than or equal to the second threshold value. For example, the wearable device (310) (e.g., the processor (312)) may reduce power consumption by controlling the electrode channel to be turned off to stop the measurement of the first signal. For example, as described below, the wearable device (310) (e.g., the processor (312)) may control the switch(es) (e.g., the switch(es) of FIG. 20) connected to the electrode(s) (e.g., the first electrode (314) and / or the second electrode (315)) to turn off in order to stop measuring the first signal. According to one embodiment, the electronic device (200) (e.g., the processor (202)) may perform monitoring for movement (e.g., movement of the electronic device (200), movement of the third wearable device (330), or movement of the smart tag) after operation 1815. “Monitoring for movement” overlaps with the description of operation 917 and is therefore omitted.
[0162] In operation 1817, according to one embodiment, the wearable device (310) (e.g., processor (312)) may receive a request to resume the operation. The “resumption of the operation” may be a resumption of the operation that was stopped in operation 1815. According to one embodiment, the electronic device (200) (e.g., processor (202)) may request the wearable device (310) to resume the operation based on the detection of a movement (e.g., movement of the electronic device (200), movement of the third wearable device (330), or movement of a smart tag) through movement monitoring.
[0163] In operation 1819, according to one embodiment, the wearable device (310) (e.g., processor 312) may resume the operation stopped in operation 1815 based on receiving a request to resume the operation. For example, the wearable device (310) (e.g., processor 312) may resume measuring the first signal. For example, the wearable device (310) (e.g., processor 312) may resume analyzing the first signal. For example, the wearable device (310) (e.g., processor 312) may resume transmitting the analysis results for the first signal.
[0164] FIG. 19 is a flowchart illustrating a method of operating an electronic device according to one embodiment. FIG. 19 may be explained with reference to previously described embodiments and embodiments described below. Referring to FIG. 19, a method for a wearable device (310) to set a second reference value (e.g., a reference value corresponding to a BCI analysis model) for each user may be explained.
[0165] At least some of the operations of FIG. 19 may be omitted. The order of the operations of FIG. 19 may be changed. Operations other than those of FIG. 19 may be performed before, during, or after the operations of FIG. 19.
[0166] Referring to FIG. 19, in operation 1901, according to one embodiment, the wearable device (310) (e.g., processor (312)) may receive a signal from the electronic device (200) indicating that a guide screen (e.g., 1410, 1420 of FIG. 14) is displayed on the display (204) of the electronic device (200). According to one embodiment, the electronic device (200) (e.g., processor (202)) may transmit a signal indicating that a guide screen (e.g., 1410, 1420 of FIG. 14) is displayed to the wearable device (310).
[0167] In operation 1903, according to one embodiment, the wearable device (310) (e.g., processor (312)) may obtain a second signal based on a potential difference between the first electrode (314) and the second electrode (315) while a guide screen (e.g., 1410, 1420 of FIG. 14) is displayed on the display (204) of the electronic device (200). According to one embodiment, the wearable device (310) (e.g., processor (312)) may obtain the second signal based on receiving a signal indicating that the guide screen (e.g., 1410, 1420 of FIG. 14) is displayed. According to one embodiment, the wearable device (310) (e.g., processor (312)) may acquire a second signal while the guide screen (e.g., 1410, 1420 of FIG. 14) is displayed on the display (204) of the electronic device (200), regardless of whether a signal indicating that the guide screen (e.g., 1410, 1420 of FIG. 14) is displayed is received. For example, the wearable device (310) (e.g., processor (312)) may acquire a second signal while the guide screen (e.g., 1410, 1420 of FIG. 14) is displayed on the display (204) of the electronic device (200), even if a signal indicating that the guide screen (e.g., 1410, 1420 of FIG. 14) is not received.
[0168] In operation 1905, according to one embodiment, the wearable device (310) (e.g., processor (312)) may apply a BCI analysis model to data for a designated period of time among the second signals of operation 1903. The “designated period” may be a designated period of time before and after the moment when a gesture (e.g., eye blinking) is input, as described above. The description of the designated period overlaps with that of operation 1607 of FIG. 16 and is therefore omitted. For example, the designated period is set in relation to the corresponding gesture (e.g., eye blinking), but it is necessary to determine the start time of the designated period. According to one embodiment, the wearable device (310) (e.g., processor (312)) may identify a plurality of sub-data among the second signals. The wearable device (310) (e.g., processor (312)) may identify sub-data to be used in operation 1905 among the plurality of sub-data. For example, the second signal may be divided into a plurality of sub-data including first sub-data (e.g., 1701 of FIG. 17), second sub-data (e.g., 1702 of FIG. 17), third sub-data (e.g., 1703 of FIG. 17), fourth sub-data (e.g., 1704 of FIG. 17), and fifth sub-data (e.g., 1707 of FIG. 17). Each of the plurality of sub-data may include data for a specified period (e.g., a specified period corresponding to the corresponding gesture). The starting points of the plurality of sub-data may be different. For example, the starting point of the first sub-data (e.g., 1701 of FIG. 17) may be the starting point of the second signal. For example, the starting point of the first sub-data (e.g., 1701 of FIG. 17) may be the first point in time on the guide screen (1410) of FIG. 14. The interval between sub-data may be a specified interval. For example, the start point of the second sub-data may be a specified interval after the start point of the first sub-data.According to one embodiment, the wearable device (310) (e.g., the processor (312)) may compare the first root mean square (RMS) of the first sub-data with the RMS of other sub-data. For example, the wearable device (310) (e.g., the processor (312)) may calculate the first root mean square (RMS) of the first sub-data corresponding to a specified period from the first time point, among the second signals. The wearable device (310) (e.g., the processor (312)) may calculate a plurality of RMSs of a plurality of sub-data corresponding to specified periods from a plurality of time points after the first time point, among the second signals. The wearable device (310) (e.g., the processor (312)) may compare the plurality of RMSs with the first RMS to determine the second RMS having the largest difference from the first RMS, among the plurality of RMSs. The wearable device (310) (e.g., processor (312)) can identify the second sub-data (e.g., 1704 of FIG. 17) corresponding to the second RMS among the plurality of sub-data. The wearable device (310) (e.g., processor (312)) can use the second sub-data (e.g., 1704 of FIG. 17) corresponding to the second RMS in operation 1905. According to one embodiment, the wearable device (310) (e.g., processor (312)) may adjust a designated period corresponding to the corresponding gesture. For example, the wearable device (310) (e.g., processor (312)) may select a designated period in which the difference in RMS becomes larger by comparing the difference between the first RMS of the first sub-data and the plurality of RMSs of the plurality of sub-data while adjusting the designated period corresponding to the corresponding gesture.
[0169] In operation 1907, according to one embodiment, the wearable device (310) (e.g., processor (312)) may set a second reference value based on the magnitude of the BCI signal identified by applying the BCI analysis model to the sub-data of operation 1905 (e.g., 1704 of FIG. 17) among the second signals. For example, the wearable device (310) (e.g., processor (312)) may set the maximum value of the magnitude of the identified BCI signal as the second reference value corresponding to the BCI analysis model.
[0170] FIG. 20 is a block diagram of a wearable device according to one embodiment.
[0171] Referring to FIG. 20, according to one embodiment, the wearable device (310) may include a first switch (2001) connected to a first electrode (314). According to one embodiment, the wearable device (310) may include a second switch (2002) connected to a second electrode (315). As described above, according to one embodiment, the wearable device (310) (e.g., the processor (312)) may control the switch(es) (e.g., the first switch (2001) and / or the second switch (2002) of FIG. 20) connected to the electrode(s) (e.g., the first electrode (314) and / or the second electrode (315)) to be turned off in order to stop measuring the first signal. The connection structure of the electrodes and switches of FIG. 20 is exemplary.
[0172] FIG. 21 is a flowchart illustrating a method of operating an electronic device according to one embodiment. FIG. 21 may be described with reference to previously described embodiments and embodiments described below. Referring to FIG. 21, an embodiment in which a server (400) performs analysis on a signal (e.g., a biosignal) using an analysis model (e.g., an EEG analysis model, a BCI analysis model, or an EMG analysis model) may be described.
[0173] At least some of the operations of FIG. 21 may be omitted. The order of the operations of FIG. 21 may be changed. Operations other than those of FIG. 21 may be performed before, during, or after the operations of FIG. 21.
[0174] Referring to FIG. 21, in operation 2101, according to one embodiment, the electronic device (200) (e.g., processor (202)) may receive data (e.g., data on a signal acquired based on a potential difference between the first electrode (314) and the second electrode (315) of the wearable device (310)) from the wearable device (310). Operation 2101 may be understood with reference to operation 903 of FIG. 9. Duplicate descriptions will be omitted.
[0175] In operation 2103, according to one embodiment, the electronic device (200) (e.g., the processor (202)) may transmit data to the server (400) through the communication circuit (201) based on data received from the wearable device (310). The data transmitted to the server (400) may include information about a signal measured by the wearable device (310) (e.g., a signal obtained based on a potential difference between the first electrode (314) and the second electrode (315) of the wearable device (310). According to one embodiment, the server (400) may perform an analysis on the data provided from the electronic device (200). For example, the server (400) may perform an analysis on the data provided from the electronic device (200) using an EEG analysis model, a BCI analysis model, and / or an EMG analysis model. The server (400) can transmit the analysis results to the electronic device (200).
[0176] In operation 2105, according to one embodiment, the electronic device (200) (e.g., processor (202)) may receive, from the server (400), the results analyzed by the server (400). For example, the electronic device (200) may obtain information on brain wave components included in the signal acquired from the wearable device (310) based on the analysis results of the server (400). For example, the electronic device (200) may obtain information on BCI components included in the signal acquired from the wearable device (310) based on the analysis results of the server (400). For example, the electronic device (200) may obtain information on electromyography components included in the signal acquired from the wearable device (310) based on the analysis results of the server (400).
[0177] In operation 2107, according to one embodiment, the electronic device (200) (e.g., processor (202)) may perform a function corresponding to the analysis result of the server (400). For example, the electronic device (200) may perform a first function corresponding to the brainwave component based on the analysis result of the server (400). For example, the electronic device (200) may perform a second function corresponding to the BCI component based on the analysis result of the server (400). For example, the electronic device (200) may perform a third function corresponding to the electromyography component based on the analysis result of the server (400). Here, there is no limitation on the first function, the second function, and the third function.
[0178] Those skilled in the art will appreciate that the embodiments described herein may be applied interchangeably, within the scope of their applicability. For example, those skilled in the art will appreciate that at least some operations of one embodiment described herein may be omitted and applied, or at least some operations of one embodiment may be applied in conjunction.
[0179] The technical tasks to be achieved in this document are not limited to the technical tasks mentioned above, and other technical tasks not mentioned will be clearly understood by those with ordinary skill in the technical field to which this document pertains from the description below.
[0180] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the art to which the present disclosure belongs from the description below.
[0181] According to one embodiment, an electronic device (101; 200) may include a communication circuit (190; 201), at least one processor (120; 202), and a memory (130; 203) storing instructions. The instructions, when executed by the at least one processor (120; 202), may be configured to cause the electronic device (101; 200) to receive, through the communication circuit (190; 201), first data for a first signal obtained based on a potential difference between a first electrode (314) and a second electrode (315) of the wearable device (310). The instructions, when executed by the at least one processor (120; 202), may be configured to cause the electronic device (101; 200) to determine the magnitude of the first signal based on the first data. The instructions, when executed by the at least one processor (120; 202), may be configured to cause the electronic device (101; 200) to perform an analysis on the first signal by using an EEG analysis model and a BCI (Brain-Computer Interface) analysis model based on the magnitude of the first signal being less than a first reference value. The instructions, when executed by the at least one processor (120; 202), may be configured to cause the electronic device (101; 200) to perform an analysis on the first signal by using the BCI analysis model based on the magnitude of the first signal being greater than or equal to the first reference value and less than a second reference value that is greater than the first reference value.The instructions, when executed by the at least one processor (120; 202), may be configured to cause the electronic device (101; 200) to transmit a first request to the wearable device (310) via the communication circuit (190; 201) to stop measurement of the first signal based on the magnitude of the first signal being greater than or equal to the second reference value, or to cause the electronic device (101; 200) to stop receiving the first data via the communication circuit (190; 201).
[0182] According to one embodiment, the instructions, when executed by the at least one processor (120; 202), may be configured to cause the electronic device (101; 200) to transmit the first request causing the measurement of the first signal to be stopped, or to monitor the movement of the electronic device (101; 200) after stopping the reception of the first data. The instructions, when executed by the at least one processor (120; 202), may be configured to cause the electronic device (101; 200) to continue the monitoring based on the determination of the movement of the electronic device (101; 200). The instructions, when executed by the at least one processor (120; 202), may be configured to cause the electronic device (101; 200) to transmit a second request to the wearable device (310) via the communication circuit (190; 201) to resume measurement of the first signal based on the movement of the electronic device (101; 200) not being detected, or to resume reception of the first data via the communication circuit (190; 201).
[0183] According to one embodiment, the instructions, when executed by the at least one processor (120; 202), may be configured to cause the electronic device (101; 200) to stop monitoring the movement of the electronic device (101; 200) based on transmitting the second request or resuming reception of the first data.
[0184] According to one embodiment, the electronic device (101; 200) may include a display (160; 204). The instructions, when executed by the at least one processor (120; 202), may be configured to cause the electronic device (101; 200) to control the display (160; 204) to display a guide screen for setting the second reference value. The instructions, when executed by the at least one processor (120; 202), may be configured to cause the electronic device (101; 200) to receive, through the communication circuit (190; 201), second data for a second signal acquired while the guide screen is displayed based on the potential difference between the first electrode (314) and the second electrode (315) of the wearable device (310). The above instructions, when executed by the at least one processor (120; 202), may be configured to cause the electronic device (101; 200) to set the second reference value by using the BCI analysis model on the second data.
[0185] According to one embodiment, the guide screen may include a first object and a second object for guiding the user's eye blinking. At a first point in time, the first object may be displayed at a first location on the guide screen. At the first point in time, the second object may be displayed at a second location on the guide screen. After the first point in time, the first object may start moving toward the second object. At a second point in time, the first object and the second object may be displayed at the second location. The instructions may be configured to cause the electronic device (101; 200) to set the second reference value based on data for a specified period of time among the second data when executed by the at least one processor (120; 202).
[0186] According to one embodiment, the instructions, when executed by the at least one processor (120; 202), may be configured to cause the electronic device (101; 200) to calculate a first root mean square (RMS) of first sub-data corresponding to the designated period from the first time point, among the second data. The instructions, when executed by the at least one processor (120; 202), may be configured to cause the electronic device (101; 200) to calculate a plurality of RMSs of a plurality of sub-data corresponding to the designated period from a plurality of time points after the first time point, among the second data. The instructions, when executed by the at least one processor (120; 202), may be configured to cause the electronic device (101; 200) to compare the plurality of RMSs with the first RMS, thereby identifying a second RMS having a largest difference from the first RMS among the plurality of RMSs. The instructions, when executed by the at least one processor (120; 202), may be configured to cause the electronic device (101; 200) to set the second reference value based on second sub-data corresponding to the second RMS among the plurality of sub-data.
[0187] According to one embodiment, a method of operating an electronic device (101; 200) may include receiving, from a wearable device (310), first data regarding a first signal obtained based on a potential difference between a first electrode (314) and a second electrode (315) of the wearable device (310). The method may include determining a magnitude of the first signal based on the first data. The method may include performing an analysis on the first signal by using an EEG analysis model and a Brain-Computer Interface (BCI) analysis model based on the magnitude of the first signal being less than a first reference value. The method may include performing an analysis on the first signal by using the BCI analysis model based on the magnitude of the first signal being greater than or equal to the first reference value and less than a second reference value that is greater than the first reference value. The method may include an operation of transmitting a first request to the wearable device (310) to cause a stop of measurement of the first signal based on the magnitude of the first signal being greater than or equal to the second reference value, or an operation of stopping reception of the first data.
[0188] According to one embodiment, the method may include an operation of performing monitoring for movement of the electronic device (101; 200) after transmitting the first request causing the measurement of the first signal to be stopped or after the reception of the first data has been stopped. The method may include an operation of continuing the monitoring based on the confirmation of the movement of the electronic device (101; 200). The method may include an operation of transmitting a second request to the wearable device (310) causing the resumption of measurement of the first signal or an operation of resuming the reception of the first data based on the confirmation of the movement of the electronic device (101; 200).
[0189] According to one embodiment, the method may include an action of stopping the monitoring of the movement of the electronic device (101; 200) based on transmitting the second request or resuming reception of the first data.
[0190] According to one embodiment, the method may include an operation of displaying a guide screen for setting the second reference value. The method may include an operation of receiving second data for a second signal acquired while the guide screen is displayed based on the potential difference between the first electrode (314) and the second electrode (315) of the wearable device (310). The method may include an operation of setting the second reference value by using the BCI analysis model on the second data.
[0191] According to one embodiment, in the method, the guide screen may include a first object and a second object for guiding the user's eye blinking. At a first point in time, the first object may be displayed at a first location on the guide screen. At the first point in time, the second object may be displayed at a second location on the guide screen. After the first point in time, the first object may start moving toward the second object. At a second point in time, the first object and the second object may be displayed at the second location. The operation of setting the second reference value may include an operation of setting the second reference value based on data for a specified period of time among the second data.
[0192] According to one embodiment, the operation of setting the second reference value may include an operation of calculating a first root mean square (RMS) of first sub-data corresponding to the specified period from the first time point among the second data. The operation of setting the second reference value may include an operation of calculating a plurality of RMSs of a plurality of sub-data corresponding to the specified period from a plurality of time points after the first time point among the second data. The operation of setting the second reference value may include an operation of comparing the plurality of RMSs with the first RMS, thereby identifying a second RMS having the largest difference from the first RMS among the plurality of RMSs. The operation of setting the second reference value may include an operation of setting the second reference value based on second sub-data corresponding to the second RMS among the plurality of sub-data.
[0193] According to one embodiment, a storage medium storing computer-readable instructions may be configured to cause at least one processor (120; 202) of an electronic device (101; 200) to perform at least one operation when the instructions are executed. The at least one operation may include receiving, from a wearable device (310), first data for a first signal obtained based on a potential difference between a first electrode (314) and a second electrode (315) of the wearable device (310). The at least one operation may include determining a magnitude of the first signal based on the first data. The at least one operation may include performing an analysis on the first signal by using an EEG analysis model and a BCI (Brain-Computer Interface) analysis model based on the magnitude of the first signal being less than a first reference value. The at least one operation may include performing an analysis on the first signal by using the BCI analysis model based on the magnitude of the first signal being greater than or equal to the first reference value and less than a second reference value that is greater than the first reference value. The at least one operation may include transmitting a first request to the wearable device (310) to cause a stop of measurement of the first signal based on the magnitude of the first signal being greater than or equal to the second reference value, or an operation of stopping reception of the first data.
[0194] According to one embodiment, in the recording medium, the at least one operation may include an operation of transmitting the first request causing a cessation of measurement of the first signal, or an operation of monitoring movement of the electronic device (101; 200) after stopping reception of the first data. The at least one operation may include an operation of continuing the monitoring based on confirming the movement of the electronic device (101; 200). The at least one operation may include an operation of transmitting a second request causing a resumption of measurement of the first signal to the wearable device (310) based on not confirming the movement of the electronic device (101; 200), or an operation of resuming reception of the first data.
[0195] According to one embodiment, in the recording medium, the at least one operation may include an operation of stopping the monitoring of the movement of the electronic device (101; 200) based on transmitting the second request or resuming reception of the first data.
[0196] According to one embodiment, in the recording medium, the at least one operation may include an operation of displaying a guide screen for setting the second reference value. The at least one operation may include an operation of receiving second data for a second signal acquired while the guide screen is displayed based on the potential difference between the first electrode (314) and the second electrode (315) of the wearable device (310). The at least one operation may include an operation of setting the second reference value by using the BCI analysis model on the second data.
[0197] According to one embodiment, in the recording medium, the guide screen may include a first object and a second object for guiding the user's eye blinking. At a first point in time, the first object may be displayed at a first location on the guide screen. At the first point in time, the second object may be displayed at a second location on the guide screen. After the first point in time, the first object may start moving toward the second object. At a second point in time, the first object and the second object may be displayed at the second location. The operation of setting the second reference value may include an operation of setting the second reference value based on data for a specified period of time among the second data.
[0198] According to one embodiment, in the recording medium, the operation of setting the second reference value may include an operation of calculating a first root mean square (RMS) of first sub-data corresponding to the specified period from the first time point among the second data. The operation of setting the second reference value may include an operation of calculating a plurality of RMSs of a plurality of sub-data corresponding to the specified period from a plurality of time points after the first time point among the second data. The operation of setting the second reference value may include an operation of comparing the plurality of RMSs with the first RMS, thereby identifying a second RMS having the largest difference from the first RMS among the plurality of RMSs. The operation of setting the second reference value may include an operation of setting the second reference value based on second sub-data corresponding to the second RMS among the plurality of sub-data.
[0199] According to one embodiment, a wearable device (310) may include a first electrode (314), a second electrode (315), a communication circuit (311), at least one processor (312), and a memory (313) storing instructions. The instructions, when executed by the at least one processor (312), may be configured to cause the wearable device (310) to acquire a first signal based on a potential difference between the first electrode (314) and the second electrode (315) while the wearable device (310) is worn on either ear of a user. The instructions, when executed by the at least one processor (312), may be configured to cause the wearable device (310) to determine a magnitude of the first signal. The instructions may be configured to cause the wearable device (310) to perform analysis on the first signal by using an EEG analysis model and a BCI (Brain-Computer Interface) analysis model based on the magnitude of the first signal being less than a first reference value when executed by the at least one processor (312). The instructions may be configured to cause the wearable device (310) to perform analysis on the first signal by using the BCI analysis model based on the magnitude of the first signal being greater than or equal to the first reference value and less than a second reference value that is greater than the first reference value.The instructions, when executed by the at least one processor (312), may be configured to cause the wearable device (310) to stop measuring the first signal through the first electrode (314) and the second electrode (315), or to stop transmitting data including an analysis result of the first signal to the electronic device (101; 200) through the communication circuit (311), based on the magnitude of the first signal being greater than or equal to the second reference value.
[0200] According to one embodiment, the instructions, when executed by the at least one processor (312), may be configured to cause the wearable device (310) to resume measurement of the first signal or resume transmission of the data based on receiving a request transmitted from the electronic device (101; 200) based on no movement of the electronic device (101; 200) being detected after stopping measurement of the first signal or stopping transmission of the data.
[0201] According to one embodiment, the instructions, when executed by the at least one processor (312), may be configured to cause the wearable device (310) to acquire a second signal based on the potential difference between the first electrode (314) and the second electrode (315) while a guide screen for setting a second reference value is displayed through the display (160; 204) of the electronic device (101; 200). The instructions, when executed by the at least one processor (312), may be configured to cause the wearable device (310) to set the second reference value based on an analysis of the second signal by using the BCI analysis model.
[0202] According to one embodiment, the guide screen may include a first object and a second object for guiding the user's eye blinking. At a first point in time, the first object may be displayed at a first location on the guide screen, and the second object may be displayed at a second location on the guide screen. After the first point in time, the first object may start moving toward the second object. At a second point in time, the first object and the second object may be displayed at the first location. The instructions may be configured to cause the wearable device (310) to set the second reference value based on data for a specified period of time among the second signals when executed by the at least one processor (312).
[0203] According to one embodiment, the instructions, when executed by the at least one processor (312), may be configured to cause the wearable device (310) to calculate a first root mean square (RMS) of first sub-data corresponding to the designated period from the first time point, among the second signals. The instructions, when executed by the at least one processor (312), may be configured to cause the wearable device (310) to calculate a plurality of RMSs of a plurality of sub-data corresponding to the designated period from a plurality of time points after the first time point, among the second signals. The instructions, when executed by the at least one processor (312), may be configured to cause the wearable device (310) to compare the plurality of RMSs with the first RMS, thereby identifying a second RMS from the plurality of RMSs that has a largest difference from the first RMS. The above instructions, when executed by the at least one processor (312), may be configured to cause the wearable device (310) to set the second reference value based on second sub-data corresponding to the second RMS among the plurality of sub-data.
[0204] According to one embodiment, the wearable device (310) may include a ground electrode (316). The operation of obtaining the first signal may include an operation of adjusting the potential difference between the first electrode (314) and the second electrode (315) using the signal of the ground electrode (316).
[0205] According to one embodiment, the instructions, when executed by the at least one processor (312), may be configured to cause the wearable device (310) to control the first switch connected to the first electrode (314) or the second switch connected to the second electrode (315) to turn off in order to stop measuring the first signal.
[0206] According to one embodiment, a method of operating a wearable device (310) may include an operation of acquiring a first signal based on a potential difference between a first electrode (314) and a second electrode (315) of the wearable device (310) while the wearable device (310) is worn on one ear of a user. The method may include an operation of checking a magnitude of the first signal. The method may include an operation of performing an analysis on the first signal by using an EEG analysis model and a Brain-Computer Interface (BCI) analysis model based on the magnitude of the first signal being less than a first reference value. The method may include an operation of performing an analysis on the first signal by using the BCI analysis model based on the magnitude of the first signal being greater than or equal to the first reference value and less than a second reference value that is greater than the first reference value. The method may include an operation of stopping the measurement of the first signal through the first electrode (314) and the second electrode (315) or stopping the operation of transmitting data including the analysis result of the first signal to the electronic device (101; 200) through the communication circuit (311) based on the magnitude of the first signal being greater than or equal to the second reference value.
[0207] According to one embodiment, the method may include an operation of resuming measurement of the first signal or resuming transmission of the data based on receiving a request transmitted from the electronic device (101; 200) based on no movement of the electronic device (101; 200) being detected after stopping measurement of the first signal or stopping transmission of the data.
[0208] According to one embodiment, the method may include an operation of obtaining a second signal based on the potential difference between the first electrode (314) and the second electrode (315) while a guide screen for setting a second reference value is displayed through a display (160; 204) of the electronic device (101; 200). The method may include an operation of setting the second reference value based on an analysis of the second signal by using the BCI analysis model.
[0209] According to one embodiment, in the method, the guide screen may include a first object and a second object for guiding the user's eye blinking. At a first point in time, the first object may be displayed at a first location on the guide screen, and the second object may be displayed at a second location on the guide screen. After the first point in time, the first object may start moving toward the second object. At a second point in time, the first object and the second object may be displayed at the first location. The method may include an operation of setting the second reference value based on data for a specified period of time among the second signals.
[0210] According to one embodiment, the method may include an operation of calculating a first root mean square (RMS) of first sub-data corresponding to the designated period from the first time point, among the second signals. The method may include an operation of calculating a plurality of RMSs of a plurality of sub-data corresponding to the designated period from a plurality of time points after the first time point, among the second signals. The method may include an operation of comparing the plurality of RMSs with the first RMS, thereby identifying a second RMS having a largest difference from the first RMS, among the plurality of RMSs. The method may include an operation of setting the second reference value based on second sub-data corresponding to the second RMS, among the plurality of sub-data.
[0211] According to one embodiment, in the method, the wearable device (310) may include a ground electrode (316). The operation of obtaining the first signal may include an operation of adjusting the potential difference between the first electrode (314) and the second electrode (315) using the signal of the ground electrode (316).
[0212] According to one embodiment, the method may include an operation of controlling a first switch connected to the first electrode (314) or a second switch connected to the second electrode (315) to be turned off to stop measurement of the first signal.
[0213] According to one embodiment, a storage medium storing computer-readable instructions may be configured to cause the wearable device (310) to perform at least one operation when executed by at least one processor (312) of the wearable device (310). The at least one operation may include: acquiring a first signal based on a potential difference between a first electrode (314) and a second electrode (315) of the wearable device (310) while the wearable device (310) is worn on one ear of a user. The at least one operation may include determining a magnitude of the first signal. The at least one operation may include performing an analysis on the first signal by using an electroencephalography (EEG) analysis model and a brain-computer interface (BCI) analysis model based on the magnitude of the first signal being less than a first reference value. The at least one operation may include an operation of performing an analysis on the first signal by using the BCI analysis model based on the magnitude of the first signal being greater than or equal to the first reference value and less than a second reference value that is greater than the first reference value. The at least one operation may include an operation of stopping the measurement of the first signal through the first electrode (314) and the second electrode (315), or stopping the operation of transmitting data including the analysis result of the first signal to the electronic device (101; 200) through the communication circuit (311), based on the magnitude of the first signal being greater than or equal to the second reference value.
[0214] According to one embodiment, in the recording medium, the at least one operation may include an operation of resuming measurement of the first signal or resuming transmission of the data based on receiving a request transmitted from the electronic device (101; 200) based on no movement of the electronic device (101; 200) being detected after stopping measurement of the first signal or stopping transmission of the data.
[0215] According to one embodiment, in the recording medium, the at least one operation may include an operation of obtaining a second signal based on the potential difference between the first electrode (314) and the second electrode (315) while a guide screen for setting a second reference value is displayed through the display (160; 204) of the electronic device (101; 200). The at least one operation may include an operation of setting the second reference value based on an analysis of the second signal by using the BCI analysis model.
[0216] According to one embodiment, in the recording medium, the guide screen may include a first object and a second object for guiding the user's eye blinking. At a first point in time, the first object may be displayed at a first location on the guide screen, and the second object may be displayed at a second location on the guide screen. After the first point in time, the first object may start moving toward the second object. At a second point in time, the first object and the second object may be displayed at the first location. The at least one operation may include an operation of setting the second reference value based on data for a specified period of time among the second signals.
[0217] According to one embodiment, in the recording medium, the at least one operation may include calculating a first root mean square (RMS) of first sub-data corresponding to the designated period from the first time point, among the second signals. The at least one operation may include calculating a plurality of RMSs of a plurality of sub-data corresponding to the designated period from a plurality of time points after the first time point, among the second signals. The at least one operation may include comparing the plurality of RMSs with the first RMS to determine a second RMS having a largest difference from the first RMS, among the plurality of RMSs. The at least one operation may include setting the second reference value based on second sub-data corresponding to the second RMS, among the plurality of sub-data.
[0218] According to one embodiment, in the recording medium, the wearable device (310) may include a ground electrode (316). The operation of obtaining the first signal may include an operation of adjusting the potential difference between the first electrode (314) and the second electrode (315) using a signal of the ground electrode (316).
[0219] According to one embodiment, in the recording medium, the at least one operation may include an operation of controlling the first switch connected to the first electrode (314) or the second switch connected to the second electrode (315) to be turned off in order to stop measurement of the first signal.
[0220] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.
[0221] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.
[0222] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0223] Various embodiments of the present document may be implemented as software (e.g., a program) including one or more instructions stored on a storage medium that can be read by a machine (e.g., an electronic device). For example, a processor (e.g., a controller) of the machine may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and this term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily in the storage medium.
[0224] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
[0225] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
Claims
1. In an electronic device (101; 200), Communication circuit (190; 201); At least one processor (120; 202); and Contains a memory (130; 203) for storing instructions, The above instructions, when executed by the at least one processor (120; 202), cause the electronic device (101; 200) to: Through the above communication circuit (190; 201), first data for a first signal obtained based on the potential difference between the first electrode (314) and the second electrode (315) of the wearable device (310) is received from the wearable device (310), Based on the above first data, the size of the first signal is checked, Based on the fact that the magnitude of the first signal is less than the first reference value, an analysis is performed on the first signal by using an EEG analysis model and a BCI (Brain-Computer Interface) analysis model, Based on the fact that the magnitude of the first signal is greater than or equal to the first reference value and less than a second reference value that is greater than the first reference value, analysis is performed on the first signal by using the BCI analysis model, Based on the magnitude of the first signal being greater than or equal to the second reference value, a first request causing a stop of measurement of the first signal is transmitted to the wearable device (310) through the communication circuit (190; 201), or is set to cause a stop of reception of the first data through the communication circuit (190; 201). Electronic devices (101; 200).
2. In paragraph 1, The above instructions, when executed by the at least one processor (120; 202), cause the electronic device (101; 200) to: After transmitting the first request causing the measurement of the first signal to be stopped or after stopping the reception of the first data, monitoring of the movement of the electronic device (101; 200) is performed, Based on the confirmation of the above movement of the above electronic device (101; 200), the above monitoring is continuously performed, Based on the fact that the movement of the electronic device (101; 200) is not detected, a second request causing the resumption of measurement of the first signal is transmitted to the wearable device (310) via the communication circuit (190; 201), or causing the resumption of reception of the first data via the communication circuit (190; 201). Electronic devices (101; 200).
3. In paragraph 1 or 2, The above instructions, when executed by the at least one processor (120; 202), cause the electronic device (101; 200) to: is set to cause said monitoring of said movement of said electronic device (101; 200) to be stopped based on transmitting said second request or resuming reception of said first data; Electronic devices (101; 200).
4. In any one of paragraphs 1 to 3, Including further displays (160; 204), The above instructions, when executed by the at least one processor (120; 202), cause the electronic device (101; 200) to: Control the display (160; 204) to display a guide screen for setting the second reference value, Through the above communication circuit (190; 201), second data for a second signal acquired while the guide screen is displayed is received based on the potential difference between the first electrode (314) and the second electrode (315) of the wearable device (310), By using the BCI analysis model on the second data, it is set to cause the second reference value to be set. Electronic devices (101; 200).
5. In any one of paragraphs 1 to 4, The above guide screen includes a first object and a second object for guiding the user's eye blinking, At the first point in time, the first object is displayed at the first position of the guide screen, At the first point in time, the second object is displayed at the second position on the guide screen, After the first point in time, the first object starts moving toward the second object, At the second point in time, the first object and the second object are displayed at the second position on the guide screen, The above instructions, when executed by the at least one processor (120; 202), cause the electronic device (101; 200) to: Among the above second data, it is set to cause the second reference value to be set based on the data for a specified period of time. Electronic devices (101; 200).
6. In any one of paragraphs 1 to 5, The above instructions, when executed by the at least one processor (120; 202), cause the electronic device (101; 200) to: Among the above second data, the first RMS (root mean square) of the first sub-data corresponding to the specified period from the first time point is calculated, Among the above second data, multiple RMSs of multiple sub-data corresponding to the specified period are calculated from multiple points in time after the first point in time, By comparing the above plurality of RMSs with the above first RMS, the second RMS having the largest difference from the above plurality of RMSs is identified, It is set to cause the second reference value to be set based on the second sub-data corresponding to the second RMS among the plurality of sub-data. Electronic devices (101; 200).
7. In the operating method of an electronic device (101; 200), An operation of receiving first data for a first signal obtained based on a potential difference between a first electrode (314) and a second electrode (315) of the wearable device (310) from the wearable device (310); An operation of checking the size of the first signal based on the first data, An operation of performing an analysis on the first signal by using an EEG analysis model and a BCI (Brain-Computer Interface) analysis model based on the magnitude of the first signal being less than the first reference value, An operation of performing an analysis on the first signal by using the BCI analysis model based on the fact that the magnitude of the first signal is greater than or equal to the first reference value and less than a second reference value that is greater than the first reference value; An operation of transmitting a first request to the wearable device (310) to cause a stop of measurement of the first signal based on the magnitude of the first signal being greater than or equal to the second reference value, or an operation of stopping reception of the first data. method.
8. In paragraph 7, An operation of monitoring the movement of the electronic device (101; 200) after transmitting the first request causing the measurement of the first signal to be stopped or after stopping the reception of the first data; An operation of continuing the monitoring based on the confirmation of the movement of the electronic device (101; 200), An operation of transmitting a second request to the wearable device (310) to cause resumption of measurement of the first signal based on the movement of the electronic device (101; 200) not being detected, or an operation of resuming reception of the first data. method.
9. In paragraph 7 or 8, An action of stopping said monitoring of said movement of said electronic device (101; 200) based on transmitting said second request or resuming reception of said first data, method.
10. In any one of paragraphs 7 to 9, An action for displaying a guide screen for setting the above second reference value, and An operation of receiving second data for a second signal obtained while the guide screen is displayed based on the potential difference between the first electrode (314) and the second electrode (315) of the wearable device (310); By using the BCI analysis model on the second data, the operation of setting the second reference value is included. method.
11. In any one of paragraphs 7 to 10, The above guide screen includes a first object and a second object for guiding the user's eye blinking, At the first point in time, the first object is displayed at the first position of the guide screen, At the first point in time, the second object is displayed at the second position on the guide screen, After the first point in time, the first object starts moving toward the second object, At the second point in time, the first object and the second object are displayed at the second position on the guide screen, The operation of setting the above second reference value is as follows: An operation of setting the second reference value based on data for a specified period of time among the second data, method.
12. In any one of paragraphs 7 to 11, The operation of setting the above second reference value is as follows: An operation of calculating a first RMS (root mean square) of the first sub-data corresponding to the specified period from the first time point among the second data, An operation of calculating multiple RMSs of multiple sub-data corresponding to the specified period from multiple points in time after the first point in time among the above second data, An operation of comparing the plurality of RMSs with the first RMS to determine the second RMS having the largest difference from the first RMS among the plurality of RMSs; An operation of setting the second reference value based on the second sub-data corresponding to the second RMS among the plurality of sub-data, method.
13. In a storage medium storing computer-readable instructions, the instructions are set to cause the electronic device (101; 200) to perform at least one operation when executed by at least one processor (120; 202) of the electronic device (101; 200). At least one of the above actions: An operation of receiving first data for a first signal obtained based on a potential difference between a first electrode (314) and a second electrode (315) of the wearable device (310) from the wearable device (310); An operation of checking the size of the first signal based on the first data, An operation of performing an analysis on the first signal by using an EEG analysis model and a BCI (Brain-Computer Interface) analysis model based on the magnitude of the first signal being less than the first reference value, An operation of performing an analysis on the first signal by using the BCI analysis model based on the fact that the magnitude of the first signal is greater than or equal to the first reference value and less than a second reference value that is greater than the first reference value; An operation of transmitting a first request to the wearable device (310) to cause a stop of measurement of the first signal based on the magnitude of the first signal being greater than or equal to the second reference value, or an operation of stopping reception of the first data. Recording medium.
Citation Information
Patent Citations
RF removal device and method with electrode / tissue contact assessment scheme and ECG filtering
JP2003502104A
Method and system of biofeedback based on thedetection of electro-encephalogram
KR1020010045348A
Touch sensing device
KR1020240010138A
Roller apparatus included in folding system for evenly shaping folded terrace of secondary battery cell
KR102344914B1
Brain computer interface systems and methods of use thereof
WO2018109715A1