Electronic device for controlling touch sensitivity on basis of radar and operation method thereof

Abstract

This electronic device comprises: a memory storing instructions; a radar configured to transmit an electromagnetic wave signal and receive a radar signal which is the electromagnetic wave signal reflected from at least one object; a touch pad configured to sense a user's touch on the basis of a touch threshold value; and at least one processor operatively coupled to the memory, the radar, and the touch pad. The instructions, when executed by the at least one processor, may cause the electronic device to: acquire the radar signal received by the radar; identify the surrounding environment of the electronic device on the basis of the radar signal; and adjust the touch threshold value on the basis of the surrounding environment.

Description

Electronic device for controlling touch sensitivity based on radar and method for operating the same

[0001] The present disclosure relates to an electronic device for controlling touch sensitivity based on radar and a method of operating the electronic device.

[0002] Radar (radio detection and ranging) is a technology that detects objects by measuring the reflected waves that return after the irradiated electromagnetic waves hit the object, and determines the direction, distance, and speed of the object. Ultra-wideband (UWB) technology, a type of radar technology, can perform short-range and high-bandwidth communication using very low energy through relatively low radio spectrum density across a wide frequency band. UWB can have an occupied bandwidth of more than 20% of the center frequency or an occupied bandwidth of more than 500 MHz. UWB can use signals with a bandwidth of 500 MHz and an extremely short pulse width of several ns (nano-seconds) in the 3.1 to 10.6 GHz frequency band, making it robust to noise. UWB can be used for ranging with high accuracy in the centimeter (cm) range by using the double-sided two-way ranging (DS-TWR) method.

[0003] UWB can be used for sensor data collection, precise locating, and tracking. Because it enables highly precise spatial awareness, it can also enable mobile electronic devices to perceive their surroundings. With the advancement of wireless communication systems, a variety of services have become available, and this has led to a growing demand for methods to effectively deliver these services through electronic devices. For example, technologies that enhance the user experience by controlling the operation of electronic devices using UWB could be explored.

[0004] The operation of the electronic device is initiated based on the surrounding environment of the electronic device recognized by the radar.

[0005] Embodiments of the present disclosure can adjust the touch sensitivity of an electronic device including a touch pad according to the surrounding contact environment of the electronic device.

[0006] An electronic device according to one embodiment of the present disclosure may include a memory storing instructions, a radar configured to transmit an electromagnetic signal and receive a radar signal, which is a signal in which the electromagnetic signal is reflected from at least one target object, a touch pad configured to detect a user's touch based on a touch threshold, and at least one processor operatively coupled to the memory, the radar, and the touch pad. The instructions, when executed by the at least one processor, may cause the electronic device to obtain the radar signal received by the radar. The instructions, when executed by the at least one processor, may cause the electronic device to identify a surrounding environment of the electronic device based on the radar signal. The instructions, when executed by the at least one processor, may cause the electronic device to adjust the touch threshold based on the surrounding environment.

[0007] A method performed by an electronic device according to one embodiment of the present disclosure may include transmitting an electromagnetic signal via a radar of the electronic device and acquiring a radar signal, which is a signal reflected from at least one target object by the electromagnetic signal. The method may include identifying a surrounding environment of the electronic device based on the radar signal. The method may include adjusting a touch threshold for a touch pad of the electronic device based on the surrounding environment.

[0008] A non-transitory computer-readable storage medium storing one or more programs according to one embodiment, wherein the one or more programs may include instructions that, when executed by at least one processor of an electronic device, cause the electronic device to: transmit an electromagnetic signal through a radar of the electronic device, obtain a radar signal that is a signal reflected from at least one target object by the electromagnetic signal, identify a surrounding environment of the electronic device based on the radar signal, and adjust a touch threshold for a touch pad of the electronic device based on the surrounding environment.

[0009] The above and other aspects, features and advantages of specific embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings.

[0010] FIG. 1 illustrates a configuration of an electronic device within a network environment according to various embodiments.

[0011] FIG. 2 illustrates a configuration of an electronic device including a radar according to one embodiment of the present disclosure.

[0012] FIG. 3a illustrates touch detection in glove mode according to one embodiment.

[0013] FIG. 3b illustrates touch detection in underwater mode according to one embodiment.

[0014] Figure 4 illustrates recognition of the surrounding environment through radar according to one embodiment.

[0015] Figure 5 illustrates environmental recognition using radar according to one embodiment.

[0016] FIG. 6 illustrates clustered signal patterns of reflection characteristics using radar according to one embodiment.

[0017] FIG. 7 illustrates a procedure of an electronic device for controlling touch sensitivity depending on the surrounding environment according to one embodiment.

[0018] Fig. 8 illustrates an operation of determining environmental recognition conditions using radar according to one embodiment.

[0019] Figure 9 illustrates an operation for determining environmental recognition conditions according to one embodiment.

[0020] Fig. 10 illustrates an example of posture classification based on changes in signals measured by an acceleration sensor according to one embodiment.

[0021] FIG. 11 illustrates detection of a hovering touch according to one embodiment.

[0022] Fig. 12 is a diagram for explaining motion detection by radar signal change according to one embodiment.

[0023] FIG. 13 illustrates vectorization of a radar signal according to one embodiment.

[0024] FIG. 14 illustrates radar-based motion control for preventing touch errors according to one embodiment.

[0025] FIG. 15 illustrates radar-based motion control for improving touch sensitivity according to one embodiment.

[0026] FIG. 16 illustrates radar-based motion control for improving touch sensitivity of a wearable device according to one embodiment.

[0027] FIG. 17 illustrates radar-based motion control for lost notification according to one embodiment.

[0028] FIG. 18 illustrates radar-based motion control in vibration mode according to one embodiment.

[0029] Before beginning the detailed description below, it may be helpful to set forth definitions of certain words and phrases used throughout this disclosure. The term "coupled" and its derivatives mean direct or indirect communication between two or more elements, whether or not the two or more elements are in physical contact with each other. The terms "transmit," "receive," and "communicate," and their derivatives, include both direct and indirect communication. The terms "include" and "comprises" and their derivatives mean including without limitation. The term "or" is an inclusive term meaning "and / or." The phrase "associated" and its derivatives mean include, include, interconnect, contain, include, connect, connect, connect, communicate, cooperate, interpose, juxtapose, proximate, be bound or tethered, have properties of, relate to, and the like. The term "controller" means any device, system, or part thereof that controls at least one operation. These controllers can be implemented as hardware or a combination of hardware, software, and / or firmware. Functions associated with a particular controller can be centralized or distributed locally or remotely. The term "set" refers to one or more. Therefore, an item set can be a single item or a collection of two or more items.

[0030] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.

[0031] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display (160), an audio module (170), a sensor (176), an interface (177), a connection terminal (178), a haptic module (179), a camera (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor (176), the camera (180), or the antenna (197)) may be integrated into one component (e.g., the display (160)).

[0032] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculation, the processor (120) may store a command or data received from another component (e.g., a sensor (176) or a communication module (190)) in a volatile memory (132), process the command or data stored in the volatile memory (132), and store the resulting data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor)) that may operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0033] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display (160), a sensor (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, in the electronic device (101) itself where artificial intelligence is performed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0034] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0035] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0036] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0037] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0038] The display (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display (160) may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling the device. In one embodiment, the display (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the strength of a force generated by the touch.

[0039] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0040] The sensor (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0041] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0042] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0043] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0044] The camera (180) can capture still images and moving images. In one embodiment, the camera (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0045] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0046] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0047] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0048] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0049] The antenna (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna (197).

[0050] According to various embodiments, the antenna (197) may form a mmWave antenna. In one embodiment, the mmWave antenna may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.

[0051] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0052] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0053] FIG. 2 is a block diagram illustrating the configuration of an electronic device including a radar according to one embodiment of the present disclosure.

[0054] Referring to FIG. 2, an electronic device (200) (e.g., electronic device (101)) may include at least one of a processor (210) (e.g., processor (120)), a radar (220) (e.g., wireless communication module (192)), a touch pad (230) (e.g., display (160)), a sensor (240) (e.g., sensor (176)), or a memory (250) (e.g., memory (130)) that stores instructions. The at least one processor (210) may correspond to one processor or two or more processors (and combinations thereof). In the present disclosure, the at least one processor (210) may be referred to as a “processor (210)” and a “processor (210).” At least one processor (210) may include or correspond to a central processing unit (CPU), a microprocessor unit (MPU), an application processor (AP), a coprocessor (CP), a system-on-chip (SoC), or an integrated circuit (IC). In one embodiment, the at least one processor (210) corresponds to two processors, one processor being configured to perform some tasks (functions) and the other processor being configured to perform the remaining tasks.

[0055] In one embodiment, the radar (220) may support ultra wide-band (UWB) technology or frequency modulation continuous wave (FMCW) technology, and may transmit or receive electromagnetic waves through at least one antenna (e.g., antennas (202, 204)).

[0056] In one embodiment, the radar (220) may be incorporated into the wireless communication module (192) of the electronic device (200), or may be electrically connected to the electronic device (200) as hardware independent from the wireless communication module (192). In one embodiment, at least a portion of the radar (220) (e.g., RF circuitry and / or antennas (202, 204)) may be incorporated into the electronic device (200) (e.g., the wireless communication module (192)).

[0057] In one embodiment, the radar (220) may include at least one radar sensor and may perform a ranging operation to recognize a measurement target (e.g., a surface of an object contacted by the electronic device (200)) based on radar technology (e.g., UWB technology). In one embodiment, the ranging operation may include a range ranging operation and / or an angle of arrival (AoA) ranging operation. The range ranging operation may include an operation of measuring a distance between the radar (220) and the measurement target. The range ranging operation may be performed based on, but is not limited to, a time of flight (ToF) measurement using a range ranging antenna (e.g., antenna (202)). The AoA ranging operation may identify an angle of arrival of a signal reflected from the measurement target and received by the radar (220). The AoA ranging operation may be performed based on, but is not limited to, the difference in reception times of signals at each of one or more AoA ranging antennas (e.g., antennas (202, 204)).

[0058] In one embodiment, the processor (210) may be configured independently of the radar (220), or may include a controller or processing circuit implemented as part of the radar (220). The processor (210) may execute instructions stored in the memory (250). The instructions, when executed by the processor (210), may control components of the electronic device (200) (e.g., the radar (220), the sensor (240), and / or the touch pad (230)) to cause the electronic device (200) to operate according to embodiments of the present disclosure. In one embodiment, the radar (220) may generate an RF signal based on the control of the processor (210), transmit the RF signal to at least one antenna (e.g., the antennas 202, 204), and / or process a signal (e.g., a radar signal) received by at least one antenna (202, 204) and transmit the result of the processing to the processor (210).

[0059] In one embodiment, a signal (e.g., an RF signal) transmitted from the radar (220) may be reflected after reaching an external object (e.g., an object contacted by the electronic device (200)) located within the field of view (FoV) of the radar, and the radar (220) may receive the reflected signal (i.e., referred to as a radar signal). Among the transmitted signals, signals from an area that has not contacted an external object may continue to be emitted, and only signals from an area that has contacted an external object may be reflected. Some of the radar signals that contact some objects (e.g., an object contacted by the electronic device (200)) may be transmitted. By using this property, the electronic device (e.g., the processor (210)) may recognize the surrounding environment (e.g., a finger, a gloved finger, or an underwater environment) that the electronic device (200) is contacting from the radar signal.

[0060] In one embodiment, signals transmitted and received based on UWB technology may be defined as signals having a bandwidth higher than a designated center frequency (e.g., 0.5 GHz). In one example, the signals may be specified as a band of 3.1 to 10.6 GHz. The radar (220) generates very short RF pulses in the sub-nanosecond range, which can be used for detection of external objects and imaging applications.

[0061] In one embodiment, the radar (220) may extract data samples from the radar signal received through the antennas (202, 204) by passing the data through a high pass filter (HPF), a low noise amplifier (LNA), and a mixer and sampling the data, and may store (e.g., buffer) a specified number (e.g., 10 to 20) of data samples. Each of the stored data samples may indicate a distance from the radar (220) at which the radar signal was reflected. The electronic device (200) (e.g., the processor (210)) may analyze the collected radar signal (e.g., the data samples) to recognize the surrounding environment that the electronic device (200) has come into contact with.

[0062] In one embodiment, the sensor (240) may include (or correspond to) at least one sensor element (e.g., at least one of an acceleration sensor, a geomagnetic sensor, a magnetic sensor, a proximity sensor, or a touch sensor), and may transmit sensor data collected by each sensor or the result of its processing to the processor (210).

[0063] The processor (210) can detect the surrounding environment of the electronic device (200) (e.g., the surrounding environment that the electronic device (200) has come into contact with) based on the radar signal or the processing result thereof and / or the sensor data or the processing result thereof. In one embodiment, the surrounding environment can include at least one of (1) a glove mode in which a user touches the electronic device (200) (e.g., the touch pad (230)) with a gloved finger, (2) an underwater mode in which the electronic device (200) is located in water, or (3) a soft surface mode in which the electronic device (200) is located on a relatively soft material such as a sofa or mattress. The processor (210) can adjust the touch sensitivity of the touch pad (230) based on the detected surrounding environment.

[0064] In one embodiment, the touch pad (230) may include a set of electrodes (e.g., a plurality of electrodes (1110)) arranged in the X and Y directions to detect an approach or contact of a touch means (e.g., a finger or a stylus pen). Capacitance may be added to the electrodes that the touch means approaches. The touch pad (230) may detect an approach or contact of the touch means to the touch pad (230) based on a change in the self-capacitance of the electrode or a change in the mutual capacitance between adjacent electrodes. The touch pad (230) may support multi-touch that detects an approach of the touch means simultaneously on a plurality of electrodes.

[0065] The touch pad (230) can detect the approach of the touch means based on the magnitude of the physical quantity that responds to the voltage applied to the electrodes, and can detect the coordinates at which the touch means is detected. Here, the physical quantity (e.g., touch input value) used to detect the touch means may include any one of charging time, voltage, current, or capacitance. The touch pad (230) can recognize the approach or contact of the touch means and designate the coordinates when the physical quantity detected at a specific coordinate exceeds a designated threshold value (e.g., at least one touch threshold value). In one embodiment, the magnitude of the detected physical quantity generated by noise may be smaller than the magnitude of the detected physical quantity generated by the user's intended touch means. Therefore, increasing the touch threshold value may lower the probability of recognizing noise as the touch means, but at the same time, may lower the probability of detecting the touch means.

[0066] The threshold value for comparing the detected physical quantity in the touch pad (230) may be related to the level of sensitivity (e.g., touch sensitivity) for detecting the touch means. The lower the threshold value, the lower the touch sensitivity of the touch pad (230). However, in a given contact environment (e.g., glove mode, underwater mode, or soft surface mode), the processor (210) may control the threshold value to lower or increase the touch sensitivity.

[0067] In one embodiment, the processor (210) can detect, using the radar (220) and / or the sensor (240), that a first state of a hand gripping the electronic device (200) and a second state of a finger contacting the touchpad (230) are different (e.g., glove mode), and transmit a signal to the touchpad (230) instructing it to perform an operation to reduce (e.g., lower) a threshold associated with the touch sensitivity of the touchpad (230). Based on the lower threshold, the touchpad (230) can more accurately detect a touch by a finger contacting the touchpad (230).

[0068] In one embodiment, the processor (210) may detect that the electronic device (200) is in glove mode using the radar (220) and / or the sensor (240) and may transmit a signal to the touch pad (230) instructing it to increase a threshold associated with the touch sensitivity of the touch pad (230). Based on the higher threshold, the touch pad (230) may more accurately detect touches by gloved fingers.

[0069] In one embodiment, the processor (210) may detect that the electronic device (200) is in an underwater mode using the radar (220) and / or the sensor (240) and may transmit a signal to the touch pad (230) instructing it to lower the threshold associated with the touch sensitivity of the touch pad (230). Based on the lower threshold, the touch pad (230) may more accurately detect a touch by a finger underwater.

[0070] FIG. 3A is a diagram for explaining touch detection in glove mode according to one embodiment.

[0071] Referring to FIG. 3A, a user may touch a display (e.g., a touchpad (230)) of an electronic device (200) with a finger (310) wearing a glove. Since the electronic device (200) attempts to detect a touch by the finger (310) using a normal touch threshold without recognizing that the user is wearing gloves, it may fail to detect the touch of the finger (310) wearing the glove.

[0072] FIG. 3b is a diagram for explaining touch detection in underwater mode according to one embodiment.

[0073] Referring to FIG. 3B, a user may touch a display (e.g., a touchpad (230)) of an electronic device (200) with a finger (320) while the electronic device (200) is underwater. If the electronic device (200) attempts to detect a touch using a normal touch threshold without recognizing that the electronic device (200) is underwater, the electronic device (200) may fail to detect the touch of the finger (320).

[0074] In one embodiment, the electronic device (200) can adjust the touch threshold associated with the touch sensitivity of the touch pad (230) depending on the surrounding environment that the electronic device (200) is in contact with or belongs to.

[0075] In one embodiment, the electronic device (200) can control the operation of the electronic device (200) (e.g., call notification or loss alert) depending on the surrounding environment of the electronic device (200). For example, when the electronic device (200) is placed on a soft surface such as a blanket, sofa, or mattress, it may be difficult for the user to detect the vibration caused by the incoming call even if the electronic device (200) receives the incoming call. The electronic device (200) can activate a sound mode for call notification based on detecting that the surrounding environment is a soft surface. For example, when the electronic device (200) is located underwater and the electronic device (200) detects that there is no movement for a specified period of time, the electronic device (200) can output a notification for a loss alert (e.g., blink the display screen at a specified brightness level (e.g., maximum brightness level)).

[0076] FIG. 4 is a diagram for explaining recognition of the surrounding environment through radar according to one embodiment.

[0077] Referring to FIG. 4, the electronic device (200) can recognize the surrounding environment of the electronic device (200) based on signal waveforms representing the power level of the radar signal measured by the radar (220) according to the distance. In one embodiment, the signal waveform (402) and the signal waveform (406) may mean a situation in which the electronic device (200) is placed on a mattress. In one embodiment, the signal waveform (404) may mean a situation in which the electronic device (200) is placed on a desk. In one embodiment, the signal waveform (408) may mean a situation in which the electronic device (200) is placed on a mat frame. In one embodiment, the signal waveform (410) may mean a situation in which the electronic device (200) is placed on a drawer. In one embodiment, the signal waveform (412) and the signal waveform (418) may mean a situation in which the electronic device (200) is placed on a sink. In one embodiment, signal waveform (414) may mean a situation in which the electronic device (200) is placed on a side table. In one embodiment, signal waveform (416) may mean a situation in which the electronic device (200) is placed on a wooden table. In one embodiment, signal waveform (420) may mean a situation in which the electronic device (200) is placed on a sofa. In one embodiment, signal waveform (422) and signal waveform (426) may mean a situation in which the electronic device (200) is placed on a table. In one embodiment, signal waveform (424) may mean a situation in which the electronic device (200) is placed on a sink.

[0078] In one embodiment, the electronic device (200) can determine the surrounding environment of the electronic device (200) by comparing the radar signal measured through the radar (220) with the signal waveforms (402, 404, 406, 408, 410 412, 414, 416, 418, 420, 422, 424, 426).

[0079] FIG. 5 is a diagram for explaining recognition of the surrounding environment using radar according to one embodiment.

[0080] Referring to FIG. 5, the radar (220) may include a transmitter (510), a receiver (520), a signal processing unit (530), at least one transmitting antenna (502) (e.g., antenna (202)) and at least one receiving antenna (504) (e.g., antenna (204)). The transmitter (510) may transmit a designated electromagnetic signal (506) through the at least one transmitting antenna (502). The electromagnetic signal (506) may be reflected at interfaces between materials of a target object (500) (e.g., a finger, a gloved finger, water, a sofa, a mattress, etc.). The receiver (520) may receive the reflected signal (e.g., radar signal (508)) through the at least one receiving antenna (504).

[0081] The signal processing unit (530) can process (e.g., sample) the radar signal and output the processing result (e.g., sampling) to, for example, the processor (210). In one embodiment, the electronic device (200) can recognize the target object (500) based on the radar signal received through the signal processing unit (530) or the processing result (e.g., sampling). For example, the electronic device (200) can recognize the surrounding environment (e.g., underwater) in which the electronic device (200) is located based on analyzing the signal pattern of the radar signal.

[0082] FIG. 6 is a diagram for explaining clustered signal patterns of reflection characteristics using radar according to one embodiment.

[0083] Referring to FIG. 6, the electronic device (200) can compare the CIR (channel impulse response) characteristics of the radar signal received when the signal transmitted by the radar (220) is reflected from a target object (e.g., target object (500)) with pre-stored signal patterns (e.g., first signal pattern (602) and second signal pattern (612)).

[0084] In one embodiment, the first signal pattern (602) may represent, for example, a radar signal characteristic reflected from water, and the electronic device (200) may determine that the electronic device (200) is in water based on whether the first radar signal (604) (or a magnitude signal of the first radar signal (604)) received via the radar (220) corresponds to the first signal pattern (602).

[0085] In one embodiment, the second signal pattern (612) may represent, for example, a radar signal characteristic reflected from the surface of a glove worn on a finger, and the electronic device (200) may determine that a gloved finger is approaching or making contact with the electronic device (200) based on whether the second radar signal (614) (or a magnitude signal of the second radar signal (614)) received via the radar (220) corresponds to the second signal pattern (612).

[0086] FIG. 7 is a flowchart illustrating a procedure for controlling touch sensitivity of an electronic device based on the surrounding environment, according to one embodiment. In one embodiment, at least one of the operations described below may be executed by the processor (210) of the electronic device (200). Depending on the embodiments, at least one of the operations described below may be omitted, modified, or the order may be changed.

[0087] Referring to FIG. 7, in operation 705, the electronic device (200) may determine whether a pre-specified condition (e.g., an environmental recognition condition) for recognizing the surrounding environment through the radar (220) is satisfied. In one embodiment, the pre-specified condition may include at least one of arrival of a specified period, a change in acceleration, a hovering touch, a change in radar signal, or a change in magnetic field. If the pre-specified condition is satisfied, the electronic device (200) may proceed to operation 710. If the pre-specified condition is not satisfied, the electronic device (200) may return to operation 705. A description of one embodiment of operation 705 may be described later with reference to FIG. 9. In one embodiment, operation 705 may include at least one of operation 905, operation 910, operation 915, operation 920, or operation 925 of FIG. 9.

[0088] In operation 710, the electronic device (200) can obtain a radar signal through the radar (220). In one embodiment, the radar (220) (e.g., the transmitter (510)) can transmit a designated electromagnetic wave signal based on a command from the processor (210), and the radar (220) (e.g., the receiver (520)) can receive a radar signal that is reflected and returned by a target object (e.g., the target object (500) with which the electronic device (200) is in contact). In one embodiment, the electronic device (200) can collect a radar signal including a designated number of data samples (e.g., 10 to 20).

[0089] In operation 715, the electronic device (200) may generate a vectorized signal (hereinafter referred to as a vector signal) by vectorizing the radar signal using a signal vectorization module (utilizing a deep learning (DL) model). In one embodiment, the vector signal (e.g., vector signal 1308) may include one or more signal elements representing characteristic parameters of a reflected signal (e.g., the radar signal). An embodiment of the signal vectorization may be described with reference to FIG. 13. In one embodiment, operation 715 may be omitted, and the electronic device (200) may proceed to operation 720 to determine the surrounding environment based on the radar signal.

[0090] In operation 720, the electronic device (200) may determine the surrounding environment of the electronic device (200) based on at least one of the vector signal and the sensor data collected from the sensor (240). In one embodiment, the electronic device (200) may compare the vector signal with at least one of signal patterns (e.g., signal patterns (602, 612)) according to a pre-specified surrounding environment classification model to calculate a similarity, and may determine the surrounding environment corresponding to the vector signal based on the value of the similarity. In one embodiment, the electronic device (200) may read signal patterns generated based on a surrounding environment classification model utilizing deep learning (e.g., at least one of a neural network (NN), a convolution neural network (CNN), a long-short term memory (LSTM), or a Transformer) from a memory (e.g., a memory (130)), and may determine the surrounding environment by comparing at least one of the signal patterns with the vector signal.

[0091] For example, the above-described surrounding environment may include at least one of a glove mode in which a finger wearing a glove is detected approaching or touching a touch pad (230) of an electronic device (200), an underwater mode in which the electronic device (200) is located in water, or a soft surface mode in which the electronic device (200) is placed on a soft surface such as a sofa or mattress.

[0092] In one embodiment, the electronic device (200) may be a wearable device (e.g., a smart watch), and the electronic device (200) may analyze the movement of the electronic device (200) through radar (220) and / or sensor (240) to determine that the movement of the electronic device (200) corresponds to a specified motion pattern (e.g., a motion of a user looking at the smart watch).

[0093] In operation 725, the electronic device (200) may control the operation of the electronic device (200) based on the determined surrounding environment. In one embodiment, the electronic device (200) may control the touch sensitivity of the touch pad (230) included in the electronic device (200) (e.g., increase or decrease the touch threshold) based on determining that the electronic device (200) is in a glove mode or an underwater mode. In one embodiment, the electronic device (200) may activate a sound mode for incoming call notification of the electronic device (200) when the electronic device (200) is in a vibration mode based on determining that the electronic device (200) is in a soft surface mode. One or more embodiments of operation 720 and operation 725 may include at least one procedure of FIG. 14, FIG. 15, FIG. 16, FIG. 17, or FIG. 18.

[0094] In one embodiment, the electronic device (200) may disable touch input of a touch pad (230) included in the electronic device (200) (e.g., touch lock or water lock) or activate an underwater operation function (e.g., water removal function) of a hardware button (e.g., volume button and / or power button) included in the electronic device (200) based on determining that the electronic device (200) is in underwater mode. In one embodiment, the electronic device (200) may output a notification for a loss warning (e.g., blinking a display screen at maximum brightness) based on detecting that there is no movement of the electronic device (200) for a specified period of time in underwater mode.

[0095] In one embodiment, the electronic device (200) may reset the touch threshold of the touch pad (230) to its original state or return to a vibration mode for incoming call notification based on determining that the electronic device (200) has exited the glove mode, underwater mode, or soft surface mode (e.g., returned to normal mode).

[0096] FIG. 8 is a diagram for explaining an operation of determining environmental recognition conditions using radar according to one embodiment.

[0097] Referring to FIG. 8, the radar (220) may include a transmitter (810), a receiver (820), at least one transmit antenna (802) (e.g., antenna (202)), and at least one receive antenna (804) (e.g., antenna (204)). In one embodiment, the transmitter (810) and the receiver (820) may be configured to support UWB or FMCW. The transmitter (810) may transmit a designated electromagnetic signal (806) via one or more radar transmit channels (e.g., Radar TX CH_1, Radar TX CH_2, ..., and Radar TX CH_N) using the at least one transmit antenna (802). The electromagnetic signal (806) may be reflected from a target object (800) (e.g., a finger, a gloved finger, water, a sofa, a mattress, etc.). The receiver (820) can receive the reflected signal (e.g., radar signal (808)) via one or more radar receiving channels (e.g., Radar RX CH_1, Radar RX CH_2, ..., and Radar RX CH_M) using at least one receiving antenna (804).

[0098] The electronic device (200) can analyze the radar signal (808) to determine whether the radar signal (808) is pre-registered in the electronic device (200). The electronic device (200) can compare the radar signal (808) with pre-stored signal patterns (e.g., a first signal pattern (602) and a second signal pattern (612)). If the similarity between the radar signal (808) and the pre-stored signal patterns exceeds a specified threshold, the electronic device (200) can determine that the radar signal (808) is pre-registered, and can determine the surrounding environment of the electronic device (200) based on the pre-registered signal pattern corresponding to the radar signal (808). In one embodiment, the electronic device (200) can update the corresponding pre-registered signal pattern based on the radar signal (808).

[0099] In one embodiment, if the similarity between the radar signal (808) and the pre-stored signal patterns does not exceed the threshold value, the electronic device (200) may determine that the radar signal (808) is not pre-registered and may register (e.g., store) the signal pattern of the radar signal (808). In one embodiment, the registered signal pattern of the radar signal (808) may be used for future environmental recognition.

[0100] FIG. 9 is a flowchart illustrating an operation for determining environmental recognition conditions according to one embodiment. In one embodiment, at least one of the operations described below may be executed by the processor (210) of the electronic device (200). Depending on the embodiments, at least one of the operations described below may be omitted, modified, or the order of operations may be changed.

[0101] Referring to FIG. 9, in operation 905, the electronic device (200) can determine whether a predetermined cycle for recognizing the surrounding environment through the radar (220) has been reached. If the predetermined cycle has been reached, the electronic device (200) can proceed to operation 930. If the predetermined cycle has not been reached, the electronic device (200) can proceed to operation 910.

[0102] In operation 910, the electronic device (200) may determine whether an acceleration change is detected. In one embodiment, the electronic device (200) may detect an acceleration change of the electronic device (200) based on sensor data collected by an acceleration sensor included in the sensor (240). In one embodiment, the electronic device (200) may determine a posture of the electronic device (200) or a user carrying the electronic device (200) based on the acceleration change detected by the acceleration sensor. One embodiment of posture detection based on the acceleration change may be described with reference to FIG. 10. If the acceleration change is detected, the electronic device (200) may proceed to operation 930. If the acceleration change is not detected, the electronic device (200) may proceed to operation 915.

[0103] In operation 915, the electronic device (200) may determine whether a hovering touch is detected on the touch pad (230). In one embodiment, the electronic device (200) may detect a hovering touch of the electronic device (200) based on sensor data collected by a touch sensor included in the sensor (240). One embodiment of detection of the hovering touch may be described with reference to FIG. 11. If the hovering touch is detected, the electronic device (200) may proceed to operation 930. If the hovering touch is not detected, the electronic device (200) may proceed to operation 920.

[0104] In operation 920, the electronic device (200) may determine whether a change in a radar signal is detected. In one embodiment, the electronic device (200) may detect movement of the electronic device (200) based on identifying movement of a target object (e.g., target object (800)) located at a close distance using a radar signal received through the radar (220). One embodiment of movement detection according to the change in radar signal may be described with reference to FIG. 12. If the change in radar signal is detected, the electronic device (200) may proceed to operation 930. If the change in radar signal is not detected, the electronic device (200) may proceed to operation 925.

[0105] In operation 925, the electronic device (200) may determine whether a magnetic field change is detected. In one embodiment, the electronic device (200) may detect a magnetic field change around the electronic device (200) based on a change in sensor data (e.g., a magnetic sensor signal) collected by a magnetic sensor included in the sensor (240). If the magnetic field change is detected, the electronic device (200) may proceed to operation 930. If the radar signal change is not detected, the electronic device (200) may return to operation 905.

[0106] At operation 930, the electronic device (200) may determine that the environmental recognition condition is satisfied and may begin recognizing the surrounding environment. In one embodiment, the electronic device (200) may proceed to operation 710 to operate the radar (220) and acquire a radar signal through the radar (220) to recognize the surrounding environment.

[0107] Fig. 10 illustrates an example of posture classification based on changes in signals measured by an acceleration sensor according to one embodiment.

[0108] Graph (a) of Fig. 10 shows a Y-axis raw signal (1002) measured by an acceleration sensor, and graph (b) of Fig. 10 shows a Z-axis raw signal (1004) measured by an acceleration sensor. Graphs (c) and (d) of Fig. 10 show a Y-axis DC (direct current) signal (1006) and a Z-axis DC signal (1008) extracted through low-pass filtering of the Y-axis and Z-axis signals measured in the attitude change section.

[0109] The electronic device (200) can detect at least one posture among standing up (SU), sitting down with lowering subjects head (SDH), sitting down and leaning against (SDA), lying down straight (LDS), or lying upside down (LUD) based on changes in signal levels of signals measured by the acceleration sensor (e.g., Y-axis DC signal (1006) and Z-axis DC signal (1008)).

[0110] FIG. 11 is a diagram for explaining detection of a hovering touch according to one embodiment.

[0111] Referring to FIG. 11, a touch pad (230) included in an electronic device (200) may include a plurality of electrodes (1110) capable of detecting touch and hovering. The touch pad (230) may measure capacitance at the electrodes (1110). For example, if the measured value of the capacitance exceeds a specified first threshold value, the electronic device (200) may determine that a finger (1100) has contacted the touch pad (230). For example, if the measured value of the capacitance exceeds a second threshold value that is lower than the first threshold value, the electronic device (200) may determine that a finger (110) has approached (e.g., hovered) the touch pad (230) without contacting it, and may specify coordinates (1105) at which a capacitance exceeding the second threshold value is measured.

[0112] Fig. 12 is a diagram for explaining motion detection by radar signal change according to one embodiment.

[0113] Referring to FIG. 12, the electronic device (200) can track changes in a radar signal received through the radar (220). In one embodiment, the size of the radar signal according to the number of samples may have a signal pattern (1210) shown in the graph (a) of FIG. 12 when the electronic device (200) is not moving, and may have a signal pattern (1220) shown in the graph (b) of FIG. 12 when the electronic device (200) is moving. The electronic device (200) can detect movement of the electronic device (200) based on the radar signal by comparing the radar signal received through the radar (220) with a pre-stored signal pattern (e.g., signal pattern (1200)) corresponding to a specific movement of the electronic device (200) (e.g., a movement of lifting the electronic device (200) and bringing the display screen of the electronic device (200) to the user's eyes).

[0114] FIG. 13 is a diagram for explaining vectorization of a radar signal according to one embodiment.

[0115] Referring to FIG. 13, the electronic device (200) may include a preprocessor, an encoder (1304), and a decoder (1306). A radar signal (e.g., radar signal (1300)) received by the radar (220) may be converted by the signal preprocessor (1302) into input layer data having a designated signal format for the encoder (1304). The encoder (1304) may compress the input layer data according to a designated encoding method to generate a representation vector of a hidden layer between the input layer and the output layer. The decoder (1306) may decompress the representation vector to output output layer data. The electronic device (200) may output a vector signal (1308) including the representation vector generated during the compression and decompression.

[0116] FIG. 14 is a flowchart illustrating radar-based motion control for preventing touch errors according to one embodiment. In one embodiment, at least one of the operations described below may be executed by the processor (210) of the electronic device (200). Depending on embodiments, at least one of the operations described below may be omitted, modified, or the order may be changed. In one embodiment, operations 720 and 725 may include at least one of operations 1405, 1410, 1415, 1420, or 1425.

[0117] Referring to FIG. 14, in operation 1405, the electronic device (200) may recognize a user's touch based on the radar (220). In one embodiment, the electronic device (200) may determine that the user's touch has been detected based on detecting the presence of a touch means (e.g., a finger) at a close range (e.g., within a specified distance) of the electronic device (200) based on a radar signal acquired through the radar (220). In one embodiment, the electronic device (200) may detect the touch at the front of the electronic device (200) (e.g., in the direction in which the display is facing). In response to (or based on) recognizing the touch through the radar (220), the electronic device (200) may proceed to operation 1410.

[0118] In operation 1410, the electronic device (200) can obtain a touch input value (e.g., a physical quantity measured at at least one electrode) from the touch pad (230).

[0119] In operation 1415, the electronic device (200) may compare the touch input value with a designated touch threshold value related to the touch sensitivity of the touch pad (230) to determine whether the touch input value is less than the touch threshold value. If the touch input value is less than the touch threshold value, the electronic device (200) may proceed to operation 1420. On the other hand, if the touch input value is greater than or equal to the touch threshold value, the electronic device (200) may proceed to operation 1425.

[0120] In operation 1420, the electronic device (200) may lower the touch threshold for the touch pad (230). In one embodiment, the electronic device (200) may lower the touch threshold by a specified unit, or change the touch threshold to a specified lower value. The changed (reduced) touch threshold may be used to determine the next touch input value obtained from the touch pad (230). Based on the reduced touch threshold, the electronic device (200) may more sensitively detect a user's touch through the touch pad (230).

[0121] FIG. 15 is a flowchart illustrating radar-based motion control for improving touch sensitivity according to one embodiment. In one embodiment, at least one of the operations described below may be executed by the processor (210) of the electronic device (200). Depending on embodiments, at least one of the operations described below may be omitted, modified, or the order may be changed. In one embodiment, operations 720 and 725 may include at least one of operations 1505, 1510, 1515, 1520, 1525, or 1530.

[0122] Referring to FIG. 15, in operation 1505, the electronic device (200) may recognize that the user has grasped the electronic device (200). In one embodiment, the electronic device (200) may detect the grasping of the electronic device (200) based on sensor data collected by at least one sensor (e.g., at least one of a magnetic sensor, a proximity sensor, or a touch sensor) included in the sensor (240). In one embodiment, the electronic device (200) may detect the grasping of the electronic device (200) based on a radar signal acquired by the radar (220). In one embodiment, the electronic device (200) (e.g., the processor (210)) may detect the grasping of the electronic device (200) based on sensor data and / or a radar signal.

[0123] In operation 1510, the electronic device (200) can recognize the surrounding environment based on the radar signal acquired through the radar (220). In one embodiment, the electronic device (200) can identify the surrounding environment (e.g., armor mode or underwater mode) corresponding to the radar signal based on comparing the radar signal with pre-registered signal patterns (e.g., signal patterns (602, 612)) corresponding to a plurality of surrounding environments.

[0124] In operation 1515, the electronic device (200) may determine whether the recognized surrounding environment indicates a glove mode. If the surrounding environment indicates a glove mode, the electronic device (200) may proceed to operation 1530. In one embodiment, if the surrounding environment does not indicate a glove mode, the electronic device (200) may proceed to operation 1520.

[0125] In operation 1520, the electronic device (200) may determine whether the recognized surrounding environment indicates an underwater mode. If the surrounding environment indicates an underwater mode, the electronic device (200) may proceed to operation 1525. In one embodiment, if the surrounding environment does not indicate an underwater mode, the electronic device (200) may terminate the procedure, and the touch threshold associated with the touch sensitivity of the touch pad (230) may be maintained in a normal mode.

[0126] In operation 1525, the electronic device (200) may lower a touch threshold for the touch pad (230). In one embodiment, the electronic device (200) may lower the touch threshold by a specified unit, or change the touch threshold to a specified lower value. The changed (reduced) touch threshold may be used to determine a next touch input value obtained from the touch pad (230). Based on the reduced touch threshold, the electronic device (200) may more accurately detect a user's touch through the touch pad (230) while the electronic device (200) is underwater.

[0127] In operation 1530, the electronic device (200) may increase a touch threshold for the touchpad (230). In one embodiment, the electronic device (200) may increase the touch threshold by a specified unit, or change the touch threshold to a specified higher value. The changed (increased) touch threshold may be used to determine a next touch input value obtained from the touchpad (230). Based on the increased touch threshold, the electronic device (200) may more accurately detect a finger of a user wearing gloves through the touchpad (230).

[0128] In another embodiment, the electronic device (200) may disable touch input of the touch pad (230) (e.g., touch lock) instead of adjusting the touch threshold of the touch pad (230) based on determining that the electronic device (200) is in an underwater mode. In one embodiment, the electronic device (200) may activate an underwater operation function of a hardware button (e.g., a volume button, and / or a power button) included in the electronic device (200) based on determining that the electronic device (200) is in an underwater mode.

[0129] FIG. 16 is a flowchart illustrating radar-based motion control for improving touch sensitivity of a wearable device according to one embodiment. In one embodiment, at least one of the operations described below may be executed by the processor (210) of the electronic device (200). Depending on embodiments, at least one of the operations described below may be omitted, modified, or the order may be changed. In one embodiment, operations 720 and 725 may include at least one of operations 1605, 1610, 1615, or 1620.

[0130] Referring to FIG. 16, in operation 1605, the electronic device (200) may recognize a movement in a designated motion pattern. In one embodiment, the electronic device (200) may be a smartwatch, and the designated motion pattern may mean, for example, a motion of a user looking at the smartwatch. The electronic device (200) may detect that the movement of the electronic device (200) corresponds to the designated motion pattern based on sensor data collected by at least one sensor (e.g., a geomagnetic sensor) included in the sensor (240). In one embodiment, the electronic device (200) may recognize the movement of the electronic device (200) based on sensor data and / or radar signals.

[0131] In operation 1610, the electronic device (200) can recognize the surrounding environment based on the radar signal acquired through the radar (220). In one embodiment, the electronic device (200) can identify the surrounding environment (e.g., underwater mode) corresponding to the radar signal based on comparing the radar signal with pre-registered signal patterns (e.g., signal patterns (602, 612)) corresponding to a plurality of surrounding environments.

[0132] At step 1615, the electronic device (200) may determine whether the recognized surrounding environment indicates an underwater mode. If the surrounding environment indicates an underwater mode, the electronic device (200) may proceed to step 1620. In one embodiment, if the surrounding environment does not indicate an underwater mode, the electronic device (200) may terminate the procedure and maintain the touch threshold for the touch pad (230) in a normal mode.

[0133] In operation 1620, the electronic device (200) may lower a touch threshold associated with the touch sensitivity of the touch pad (230). In one embodiment, the electronic device (200) may lower the touch threshold by a specified unit or change the touch threshold to a specified lower value. The changed (reduced) touch threshold may be used to determine a next touch input value obtained from the touch pad (230). Based on the reduced touch threshold, the electronic device (200) may more accurately detect a user's touch through the touch pad (230) while the electronic device (200) (e.g., a smartwatch) is in water.

[0134] In another embodiment, the electronic device (200) may disable touch input of the touch pad (230) (e.g., touch lock or water lock) instead of adjusting the touch threshold of the touch pad (230) based on determining that the electronic device (200) is in an underwater mode. In one embodiment, the electronic device (200) may activate an underwater operation function of a hardware button (e.g., a volume button and / or a power button) included in the electronic device (200) based on determining that the electronic device (200) is in an underwater mode.

[0135] FIG. 17 is a flowchart illustrating radar-based operation control for loss notification according to one embodiment. In one embodiment, at least one of the operations described below may be executed by the processor (210) of the electronic device (200). Depending on embodiments, at least one of the operations described below may be omitted, modified, or the order may be changed. In one embodiment, operations 720 and 725 may include at least one of operations 1705, 1710, 1715, or 1720.

[0136] Referring to FIG. 17, in operation 1705, the electronic device (200) may recognize that the electronic device (200) is stationary (e.g., no movement for a specified period of time). In one embodiment, the electronic device (200) may detect that the electronic device (200) is stationary for a specified period of time based on sensor data collected by at least one sensor (e.g., a geomagnetic sensor) included in the sensor (240). In one embodiment, the electronic device (200) may recognize that the electronic device (200) is not moving based on sensor data and / or radar signals.

[0137] In operation 1710, the electronic device (200) can recognize the surrounding environment based on the radar signal acquired through the radar (220). In one embodiment, the electronic device (200) can identify the surrounding environment (e.g., underwater mode) corresponding to the radar signal based on comparing the radar signal with pre-registered signal patterns (e.g., signal patterns (602, 612)) corresponding to a plurality of surrounding environments.

[0138] In operation 1715, the electronic device (200) may determine whether the recognized surrounding environment indicates an underwater mode. If the surrounding environment indicates an underwater mode, the electronic device (200) may proceed to operation 1720. On the other hand, if the surrounding environment does not indicate an underwater mode, the electronic device (200) may terminate the procedure.

[0139] In operation 1720, the electronic device (200) may output a notification for a loss alert (e.g., flashing the display screen at maximum brightness). The notification may inform the user that the electronic device (200) (e.g., a smartwatch) is in the water.

[0140] FIG. 18 is a flowchart illustrating radar-based motion control in a vibration mode according to one embodiment. In one embodiment, at least one of the operations described below may be executed by the processor (210) of the electronic device (200). Depending on embodiments, at least one of the operations described below may be omitted, modified, or the order may be changed. In one embodiment, operations 720 and 725 may include at least one of operations 1805, 1810, 1815, 1820, 1825, or 1830.

[0141] Referring to FIG. 18, in operation 1805, the electronic device (200) may recognize that the electronic device (200) is in a vibration mode. In operation 1810, the electronic device (200) may recognize a surrounding environment based on a radar signal acquired through the radar (220). In one embodiment, the electronic device (200) may identify a surrounding environment (e.g., a soft surface mode or a hard surface mode) corresponding to the radar signal based on comparing the radar signal with pre-registered signal patterns corresponding to a plurality of surrounding environments.

[0142] For example, a soft surface mode may refer to a situation where the electronic device (200) is placed on a relatively soft material, such as a sofa or mattress. The electronic device (200) may determine that the surrounding environment of the electronic device (200) is in a soft surface mode based on the radar signal corresponding to a predefined signal pattern indicative of a soft material (e.g., a signal pattern of signal waveforms (402, 406, 422)). For example, a hard surface mode may refer to a situation where the electronic device (200) is placed on a relatively hard material, such as a table, a desk, or a chair. The electronic device (200) can determine that the surrounding environment of the electronic device (200) is in a hard surface mode based on the fact that the radar signal corresponds to a predefined signal pattern indicating a hard material (e.g., a signal pattern of signal waveforms (404, 410, 412, 414, 416, 418, 422, 424, 426)).

[0143] In operation 1815, the electronic device (200) may determine whether the recognized surrounding environment indicates a soft surface mode. If the surrounding environment indicates a soft surface mode, the electronic device (200) may proceed to operation 1820. In one embodiment, if the surrounding environment does not indicate a soft surface mode, the electronic device (200) may proceed to operation 1825.

[0144] At step 1825, the electronic device (200) may determine whether the recognized surrounding environment exhibits a hard surface mode. If the surrounding environment exhibits a hard surface mode, the electronic device (200) may proceed to step 1830. On the other hand, if the surrounding environment does not exhibit a hard surface mode, the electronic device (200) may terminate the procedure, and the vibration mode (and vibration intensity) of the electronic device (200) may be maintained.

[0145] At operation 1820, the electronic device (200) may disable the vibration mode of the electronic device (200) and activate the sound mode (e.g., switch to the sound mode). In one embodiment, the electronic device (200) may output an incoming call notification tone that mimics a predetermined vibration pattern in response to receiving an incoming call while in the soft surface mode. This mode switch allows the electronic device (200) to better notify the user of an incoming call notification while the electronic device (200) is placed on a soft material.

[0146] In operation 1830, the electronic device (200) may reduce the vibration intensity of the electronic device (200). In one embodiment, the electronic device (200) (e.g., the processor (210)) may reduce the vibration intensity by a specified unit or change the vibration intensity to a specified lower value. Based on the changed (reduced) vibration intensity, the electronic device (200) (e.g., the processor (210)) may provide a more improved user experience to the user.

[0147] According to one embodiment, an electronic device (200) may include a memory (250) for storing instructions, a radar (220) configured to transmit an electromagnetic signal and receive a radar signal, which is a signal in which the electromagnetic signal is reflected from at least one target object, a touch pad (230) configured to detect a user's touch by a touch threshold, and at least one processor (210) operatively coupled to the memory, the radar, and the touch pad. The instructions, when executed by the at least one processor, may cause the electronic device to obtain the radar signal received by the radar. The instructions, when executed by the at least one processor, may cause the electronic device to identify a surrounding environment of the electronic device based on the radar signal. The instructions, when executed by the at least one processor, may cause the electronic device to adjust the touch threshold based on the surrounding environment.

[0148] In one embodiment, the instructions may cause the electronic device to identify the surrounding environment by comparing the radar signal to one or more signal patterns, each of which represents one or more surrounding environments.

[0149] In one embodiment, the electronic device may further include a sensor comprising at least one of an acceleration sensor and a magnetic sensor. In one embodiment, the instructions may cause the electronic device to use the radar and / or the sensor to determine whether a specified environmental recognition condition is satisfied, and to acquire the radar signal through the radar based on the satisfaction of the environmental recognition condition.

[0150] In one embodiment, the specified environmental recognition condition may include at least one of: reaching a specified period, detecting a change in acceleration of the electronic device by the sensor, detecting a hovering touch by the touch pad, detecting a movement of the electronic device by the radar, or detecting a change in a magnetic field by the sensor.

[0151] In one embodiment, the instructions may cause the electronic device to detect a user's touch on the electronic device via the radar, determine whether a touch input value measured by the touch pad is less than the touch threshold, and decrease the touch threshold based on identifying that the touch input value is less than the touch threshold when the user's touch is detected via the radar.

[0152] In one embodiment, the commands may cause the electronic device to recognize, via the radar and / or the sensor, that a user is holding the electronic device, and increase the touch threshold based on the surrounding environment indicating a glove mode in which the user touches the touchpad with a gloved finger while the electronic device is held.

[0153] In one embodiment, the commands may cause the electronic device to decrease the touch threshold based on the surrounding environment indicating an underwater mode in which the electronic device is positioned underwater while the electronic device is in a gripped state.

[0154] In one embodiment, the electronic device may be a smartwatch. In one embodiment, the commands may cause the electronic device to identify, through the sensor, that the electronic device is moving according to a specified motion pattern, and to decrease the touch threshold based on the surrounding environment indicating an underwater mode in which the electronic device is located in water while the electronic device is identified as moving according to the specified motion pattern.

[0155] In one embodiment, the instructions may cause the electronic device to identify, through the sensor, that the electronic device has been motionless for a specified period of time, and to cause the display screen of the electronic device to flash at a specified brightness level based on the electronic device's presence in an underwater mode in which the electronic device is in motionless for the specified period of time.

[0156] In one embodiment, the instructions may cause the electronic device to identify that the electronic device is in a vibration mode, and to switch the electronic device to a sound mode based on the ambient environment indicating a soft surface mode in which the electronic device is placed on a soft material while the electronic device is in the vibration mode, and to reduce a vibration intensity for the vibration mode of the electronic device based on the ambient environment indicating a hard surface mode in which the electronic device is placed on a hard material while the electronic device is in the vibration mode.

[0157] According to one embodiment, a method performed by an electronic device (200) may include an operation (710) of transmitting an electromagnetic wave signal through a radar (220) of the electronic device and obtaining a radar signal, which is a signal reflected from at least one target object by the electromagnetic wave signal. The method may include an operation (720) of identifying a surrounding environment of the electronic device based on the radar signal. The method may include an operation (725) of adjusting a touch threshold for a touch pad (230) of the electronic device based on the surrounding environment.

[0158] In one embodiment, the act of identifying the surrounding environment may include comparing the radar signal with one or more signal patterns, each representing one or more surrounding environments.

[0159] In one embodiment, the method may further include an operation (705) of determining whether a specified environmental recognition condition is satisfied using the radar and / or a sensor of the electronic device. The radar signal may be acquired based on the satisfaction of the specified environmental recognition condition.

[0160] In one embodiment, the specified environmental recognition condition may include at least one of: reaching a specified period, detecting a change in acceleration of the electronic device by the sensor, detecting a hovering touch by the touch pad, detecting a movement of the electronic device by the radar, or detecting a change in a magnetic field by the sensor.

[0161] In one embodiment, the method may further include an operation (1405) of detecting a user's touch on the electronic device through the radar, an operation (1415) of determining whether a touch input value measured by the touch pad is less than the touch threshold value, and an operation (1420) of decreasing the touch threshold value based on identifying that the touch input value is less than the touch threshold value in a state where the user's touch is detected through the radar.

[0162] In one embodiment, the method may further include an operation (1505) of recognizing that a user is holding the electronic device through the radar and / or the sensor, and an operation (1530) of increasing the touch threshold based on the surrounding environment indicating a glove mode in which the user touches the touch pad with a gloved finger while the electronic device is held.

[0163] In one embodiment, the method may further include an operation (1525) of decreasing the touch threshold based on the surrounding environment indicating an underwater mode in which the electronic device is positioned in water while the electronic device is in a gripped state.

[0164] In one embodiment, the method may further include an operation (1605) of identifying that the electronic device is a smartwatch and that the electronic device moves according to a specified motion pattern through the sensor, and an operation (1620) of reducing the touch threshold based on the surrounding environment indicating an underwater mode in which the electronic device is located in water while identifying that the electronic device moves according to the specified motion pattern.

[0165] In one embodiment, the method may further include an operation (1705) of identifying, through the sensor, that the electronic device has not moved for a specified period of time, and an operation (1720) of blinking a display screen of the electronic device (200) at a specified brightness level based on the surrounding environment indicating an underwater mode in which the electronic device is located underwater while the electronic device has not moved for the specified period of time.

[0166] In one embodiment, the method may further include an operation (1805) of identifying that the electronic device is in a vibration mode; an operation (1820) of switching the electronic device to a sound mode based on the ambient environment indicating a soft surface mode in which the electronic device is placed on a soft material while the electronic device is in the vibration mode; and an operation (1830) of reducing a vibration intensity for the vibration mode of the electronic device based on the ambient environment indicating a hard surface mode in which the electronic device is placed on a hard material while the electronic device is in the vibration mode.

[0167] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0168] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0169] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0170] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0171] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0172] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device (200), Memory (250) for storing commands; A radar (220) configured to transmit an electromagnetic signal and receive a radar signal which is a signal reflected from at least one target object; A touch pad (230) configured to detect a user's touch by a touch threshold; and At least one processor (210) operatively coupled with the memory, the radar, and the touch pad; The above instructions, when executed by the at least one processor, cause the electronic device to: Acquire the radar signal received by the above radar; Identifying the surrounding environment of the electronic device based on the radar signal; An electronic device characterized in that it adjusts the touch threshold based on the surrounding environment.

2. In the first paragraph, the commands cause the electronic device to: An electronic device characterized in that it identifies the surrounding environment by comparing the radar signal with one or more signal patterns each representing one or more surrounding environments.

3. In paragraph 1 or 2, The electronic device further comprises a sensor (240) including at least one of an acceleration sensor and a magnetic sensor, The above commands cause the electronic device to: Using the above radar or sensor, determine whether the specified environmental recognition conditions are satisfied, An electronic device characterized in that it acquires the radar signal through the radar based on identifying that the above environmental recognition condition is satisfied.

4. In the third paragraph, the specified environmental recognition condition is, Reaching a specified period, Detection of changes in acceleration of the electronic device by the above sensor, Detection of hovering touch by the above touch pad, Detection of movement of said electronic device by said radar, or An electronic device characterized by comprising at least one of the detection of a change in magnetic field by the above sensor.

5. In any one of paragraphs 1 to 4, the commands cause the electronic device to: Detecting the user's touch on the electronic device through the radar, Determine whether the touch input value measured by the above touch pad is less than the above touch threshold value, An electronic device characterized in that the touch threshold value is reduced based on identifying that the touch input value is smaller than the touch threshold value when the user's touch is detected through the radar.

6. In any one of paragraphs 3 to 5, the commands cause the electronic device to: Recognizes that the user is grasping the electronic device through the radar or sensor, An electronic device characterized in that the touch threshold is increased based on the surrounding environment indicating a glove mode in which the user touches the touch pad with a gloved finger while the electronic device is in a grip state.

7. In any one of paragraphs 3 to 6, the commands cause the electronic device to: An electronic device characterized in that the touch threshold is reduced based on the surrounding environment indicating an underwater mode in which the electronic device is located in water while the electronic device is in a submerged state.

8. In any one of paragraphs 3 to 7, the commands cause the electronic device to: The electronic device is a smartwatch and the sensor identifies that the electronic device moves according to a specified motion pattern, An electronic device characterized in that the touch threshold is reduced based on the surrounding environment indicating an underwater mode in which the electronic device is located in water, while the electronic device identifies that the electronic device is moving according to the designated motion pattern.

9. In any of paragraphs 3 to 8, the commands cause the electronic device to: The electronic device identifies through the sensor that there has been no movement for a specified period of time, An electronic device characterized in that the display screen of the electronic device blinks at a specified brightness level based on the surrounding environment indicating an underwater mode in which the electronic device is located underwater while the electronic device is in a state of stillness for the specified period of time.

10. In any one of paragraphs 1 to 9, the commands cause the electronic device to: Identify that the above electronic device is in vibration mode, Switching the electronic device to a sound mode based on the surrounding environment indicating a soft surface mode in which the electronic device is placed on a soft material while the electronic device is in a vibration mode; An electronic device characterized in that the vibration intensity for the vibration mode of the electronic device is reduced based on the surrounding environment indicating a hard surface mode in which the electronic device is placed on a hard material while the electronic device is in the vibration mode.

11. In a method performed by an electronic device (200), An operation (710) of transmitting an electromagnetic wave signal through a radar (220) of the electronic device and obtaining a radar signal, which is a signal reflected from at least one target object, An operation (720) for identifying the surrounding environment of the electronic device based on the radar signal; A method characterized by comprising an operation (725) of adjusting a touch threshold for a touch pad (230) of the electronic device based on the surrounding environment.

12. In the 11th paragraph, the operation of identifying the surrounding environment is as follows: Comprising the operation of comparing said radar signal with one or more signal patterns each representing one or more surrounding environments, The method further includes an operation (705) of determining whether a specified environmental recognition condition is satisfied by using the radar or a sensor of the electronic device. The above radar signal is acquired based on identifying that the above specified environmental recognition condition is satisfied, The above specified environmental recognition conditions are: Reaching a specified period, Detection of changes in acceleration of the electronic device by the above sensor, Detection of hovering touch by the above touch pad, Detection of movement of said electronic device by said radar, or A method characterized by comprising at least one of detecting a change in a magnetic field by the above sensor.

13. In paragraph 12, An operation (1405) of detecting a user's touch on the electronic device via the radar; An operation (1415) for determining whether a touch input value measured by the touch pad is smaller than the touch threshold value; An operation (1420) of reducing the touch threshold value based on identifying that the touch input value is smaller than the touch threshold value when the user's touch is detected through the radar; An action (1505) of recognizing that a user is holding the electronic device through the radar or the sensor; A method characterized in that it further includes at least one of the actions (1530) of increasing the touch threshold based on the surrounding environment indicating a glove mode in which the user touches the touch pad with a gloved finger while the electronic device is in a grip state.

14. In clause 12 or 13, An operation (1525) of reducing the touch threshold based on the surrounding environment indicating an underwater mode in which the electronic device is located in water while the electronic device is in a suspended state; An action (1605) of identifying that the electronic device is a smartwatch and that the electronic device moves according to a specified motion pattern through the sensor; A method characterized in that it further includes at least one of the actions (1620) of reducing the touch threshold based on the surrounding environment indicating an underwater mode in which the electronic device is located in water while identifying that the electronic device is moving according to the designated motion pattern.

15. In any of paragraphs 12 to 14, An operation (1705) of identifying that there is no movement of the electronic device for a specified period of time through the sensor; An action (1720) of flashing the display screen of the electronic device at a specified brightness level based on the surrounding environment indicating an underwater mode in which the electronic device is located underwater while the electronic device is inactive for a specified period of time; An action (1805) to identify that the electronic device is in vibration mode; An operation (1820) of switching the electronic device to a sound mode based on the surrounding environment indicating a soft surface mode in which the electronic device is placed on a soft material while the electronic device is in a vibration mode; A method further comprising the step of reducing a vibration intensity for the vibration mode of the electronic device (1830) based on the surrounding environment indicating a hard surface mode in which the electronic device is placed on a hard material while the electronic device is in the vibration mode.

Images