Electronic device and operating method thereof
By using ultrasonic sensors inside the side bezel to recognize touch inputs through ultrasonic waves and reflex signals, the electronic device effectively implements virtual touch keys, addressing the lack of efficient side key functionality in existing devices.
Patent Information
- Application Number
- PCT/KR2024/016926
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-01-31
- Filing Date
- 2024-10-31
- Publication Date
- 2025-05-08
AI Technical Summary
Existing electronic devices lack an efficient method to implement side keys without physical buttons, which limits their functionality and user interaction.
The electronic device employs a plurality of ultrasonic sensors inside the side bezel to create virtual touch keys, using different frequencies of ultrasonic waves and receiving reflex signals to recognize touch inputs, including touch, touch length, touch intensity, single touch, and multi-touch.
This solution enables the electronic device to accurately identify touch inputs and register custom touch keys, enhancing user interaction and functionality without physical buttons.
Smart Images

Figure KR2024016926_08052025_PF_FP_ABST
Abstract
Description
Electronic device and method of operation thereof
[0001] An embodiment of the present disclosure relates to an electronic device capable of implementing a side key without a button and a method of operating the same.
[0002] An electronic device may refer to a device that performs a specified function according to a program installed on it, such as, for example, a home appliance, an electronic organizer, a portable multimedia player, a mobile communication terminal, a tablet PC, an audio / video device, a desktop / laptop computer, or an in-vehicle navigation system. An electronic device (e.g., a smartphone, a mobile phone, a tablet PC) may provide various functions by converging them. For example, an electronic device may provide various functions, such as a calling function and a multimedia file playback function. A side key for performing functions, such as adjusting the volume of a calling function, adjusting the volume of a multimedia file playback function, or turning the screen on / off, may be arranged on a side (e.g., one side or both sides) of the electronic device. When a contact portion of a side key provided on the side of the electronic device is pressed, the contact portion of the side key moves inwardly of the electronic device, and a switch module that comes into contact with the contact portion of the side key is activated by the movement of the side key, thereby generating an electrical signal. The generated electrical signal is transmitted to a processor mounted on the main printed circuit board so that functions related to side key input can be performed.
[0003] Electronic devices (e.g., smartphones, mobile phones, tablet PCs) can sense a user's bio-signals (e.g., touch signals for finger touches) using various sensors and perform functions using the sensed bio-signals (e.g., touch signals for finger touches). For example, the electronic device can sense the user's touch using a capacitive method, a pressure method, or an ultrasonic method. The electronic device can include a capacitive touch sensor, a pressure touch sensor, or an ultrasonic sensor that identifies the user's touch using ultrasonic waves. For example, the capacitive method can sense touch using a change in electrostatic capacity according to the touch. For example, the pressure method can sense touch using a change in resistance value according to a change in pressure.
[0004] The information described above is provided solely as background information to aid in understanding the disclosed subject matter. No determination has been made, and no assertion has been made, as to whether any of the above material constitutes prior art with respect to the disclosed subject matter.
[0005] An ultrasonic sensor that uses ultrasonic waves to identify a user's touch can transmit ultrasonic waves (e.g., lamb waves) to the side bezel of the housing of an electronic device and receive a reflected wave (e.g., a reflected signal) of the ultrasonic waves (e.g., lamb waves). The electronic device can sense the touch of a user's finger using the ultrasonic sensor.
[0006] The present disclosure addresses at least the aforementioned problems and / or disadvantages and provides at least the advantages described below. Accordingly, the present disclosure provides an electronic device and a method of operating the same, wherein a plurality of ultrasonic sensors are arranged within a side bezel of a housing to form a plurality of touch keys (e.g., soft keys, button-less keys).
[0007] The aspect of the initiation of the initiation can provide an electronic device and a method of operating the same capable of recognizing the touch of a plurality of touch keys (e.g., soft keys, button-less keys) by generating ultrasonic waves (e.g., Pan waves) of different frequencies (e.g., center frequencies) from a plurality of ultrasonic sensors and receiving reflected waves (e.g., reflected signals) according to the ultrasonic waves (e.g., Pan waves).
[0008] The aspect of the initiation of the initiation can provide an electronic device and an operating method thereof that can determine at least one of the presence or absence of a touch, touch length, touch intensity, single touch, and multi-touch using a plurality of touch keys (e.g., soft keys, button-less keys).
[0009] The aspect of the disclosure may provide an electronic device and a method of operating the same that allows a user to register (e.g., customize) multiple touch keys (e.g., soft keys, button-less keys) at desired locations.
[0010] Additional aspects will be partly explained in the following description, and partly will become apparent from the description, and may be understood by practicing the embodiments presented.
[0011] An electronic device according to one embodiment of the disclosure includes a housing, a sensor component including a first sensor and a second sensor, a memory storing one or more computer programs, and one or more processors communicatively coupled to the sensor components, wherein the first sensor and the second sensor are positioned to contact an interior surface of a wall, and instructions for operating the electronic device when the one or more computer programs are individually or collectively executed by the one or more processors. When the one or more computer programs are individually or collectively executed by the one or more processors, the sensor component may include a first sensor (e.g., a first ultrasonic sensor) and a second sensor (e.g., a second ultrasonic sensor). The first sensor and the second sensor may be positioned to contact an interior surface of the wall. The first sensor may transmit a first wave such that the first wave propagates through the wall toward the second sensor. The second sensor may transmit a second wave such that the second wave propagates through the wall toward the first sensor. The first sensor can receive the second wave transmitted from the second sensor. The first sensor can receive a first reflected wave corresponding to the first wave generated by a touch applied to the outer surface of the wall. The second sensor can receive the first wave transmitted from the first sensor. The second sensor can receive a second reflected wave corresponding to the second wave generated by the touch applied to the outer surface of the wall. When the instructions are executed by the processor, the electronic device can identify a touch location based on the first reflected wave and the second reflected wave according to the touch applied to the outer surface of the wall.
[0012] In one embodiment of the disclosure, a method of operating an electronic device includes: a first sensor of a sensor component can transmit a first wave so that the first wave propagates toward a second sensor of the sensor component through the wall; the second sensor can transmit a second wave so that the second wave propagates toward the first sensor through the wall; the electronic device can receive the second wave transmitted from the second sensor through the first sensor, and receive a first reflected wave corresponding to the first wave generated by a touch applied to an outer surface of the wall; the electronic device can receive the first wave transmitted from the first sensor through the second sensor, and receive a second reflected wave corresponding to the second wave generated by a touch applied to the outer surface of the wall; and the electronic device can identify a touch location based on the first reflected wave and the second reflected wave according to a touch applied to the outer surface of the wall.
[0013] In another embodiment of the present disclosure, one or more non-transitory computer-readable storage media are provided storing one or more computer programs comprising computer-executable instructions that, when individually or collectively executed by one or more processors of an electronic device, cause the electronic device to perform operations. The operations may include transmitting a first wave by the electronic device through a first sensor such that the first wave propagates toward a second sensor through a wall. Transmitting a second wave by the electronic device through the second sensor such that the second wave propagates toward the first sensor through the wall. The electronic device may receive the second wave transmitted from the second sensor through the first sensor and receive a first reflected wave corresponding to the first wave generated by a touch applied to an outer surface of the wall. The electronic device may receive the first wave transmitted from the first sensor through the second sensor and receive a second reflected wave corresponding to the second wave generated by a touch applied to an outer surface of the wall. By the electronic device, the touch location can be identified based on the first reflected wave and the second reflected wave according to the touch applied to the outer surface of the wall.
[0014] An electronic device and an operating method thereof according to an embodiment of the disclosure can sense a touch of a user's finger using a plurality of ultrasonic sensors.
[0015] An electronic device and an operating method thereof according to one embodiment of the disclosure can form a plurality of touch keys (e.g., soft keys, button-less keys) by arranging a plurality of ultrasonic sensors inside a side bezel of a housing.
[0016] An electronic device and an operating method thereof according to one embodiment of the disclosure can recognize touch of a plurality of touch keys (e.g., soft keys, button-less keys) by generating ultrasonic waves (e.g., Pan waves) of different frequencies (e.g., center frequencies) from a plurality of ultrasonic sensors and receiving reflected waves (e.g., reflected signals) according to the ultrasonic waves (e.g., Pan waves).
[0017] An electronic device and an operating method thereof according to an embodiment of the disclosure may provide an electronic device and an operating method thereof capable of determining at least one of the presence or absence of a touch, a touch length, a touch intensity, a single touch, and a multi-touch using a plurality of touch keys (e.g., a soft key, a button-less key).
[0018] An electronic device and its operating method according to one embodiment of the disclosure can register (e.g., customize) a plurality of touch keys (e.g., soft keys, button-less keys) at a location desired by a user.
[0019] Other aspects, advantages and important features of the disclosure will become apparent to those skilled in the art from the detailed description which follows, taken in conjunction with the accompanying drawings, which disclose various embodiments of the disclosure.
[0020] In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.
[0021] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment of the disclosure.
[0022] FIG. 2 is a perspective view of the front of an electronic device according to one embodiment of the disclosure.
[0023] FIG. 3 is a perspective view of the rear surface of an electronic device according to one embodiment of the disclosure.
[0024] FIGS. 4 and 5 are block diagrams illustrating the configuration of an electronic device according to one embodiment.
[0025] FIG. 6 is a drawing showing a plurality of ultrasonic sensors arranged to correspond to a sensor area according to an embodiment of the present disclosure.
[0026] FIG. 7 is a diagram illustrating examples of ultrasonic sensors that generate lamb waves according to embodiments of the present disclosure.
[0027] FIG. 8 is a diagram illustrating a method of sensing a touch using a plurality of ultrasonic sensors according to an embodiment of the present disclosure.
[0028] FIG. 9 is a drawing showing a sensor area (e.g., touch area, touch plate, sensor plate) according to an embodiment of the present disclosure divided into a plurality of areas to form a plurality of touch keys (e.g., soft keys, button-less keys).
[0029] FIG. 10 is a diagram showing modes applied to a plurality of ultrasonic sensors according to an embodiment of the present disclosure.
[0030] FIG. 11 is a diagram showing data of ultrasonic waves (e.g., lamb waves) that can be obtained when a user's finger touches the side bezel according to an embodiment of the present disclosure.
[0031] FIG. 12 and FIG. 13 are diagrams illustrating distinguishing between a normal touch and a strong touch (e.g., force touch) based on reflection signals of ultrasonic signals according to an embodiment of the present disclosure.
[0032] FIGS. 14 and 15 are diagrams illustrating determining a position where a user's finger touches a side bezel based on the time at which a reflected wave (e.g., a reflected signal) is received (e.g., arrives) by an ultrasonic sensor according to an embodiment of the present disclosure.
[0033] FIG. 16 is a diagram showing controlling pulse repetition frequency (PRF) depending on the presence or absence of touch according to an embodiment of the present disclosure.
[0034] FIG. 17 is a diagram illustrating registering (e.g., customizing) a plurality of touch keys (e.g., side keys, soft keys, button-less keys) by distinguishing the sensor area of the side bezel according to an embodiment of the present disclosure.
[0035] FIG. 18 is a diagram illustrating obtaining a signal (e.g., a multi-touch signal) according to a multi-touch according to an embodiment of the present disclosure.
[0036] FIG. 19 is a diagram showing that interference occurs between signals when the frequencies (e.g., center frequencies) of a plurality of ultrasonic sensors according to an embodiment of the present disclosure are the same.
[0037] FIG. 20 is a diagram illustrating that interference between signals is prevented (e.g., interference is substantially prevented or interference is reduced) when the frequencies (e.g., center frequencies) of a plurality of ultrasonic sensors according to an embodiment of the present disclosure are different.
[0038] FIG. 21 is a diagram illustrating a method for obtaining background signals (e.g., background signals) of a plurality of ultrasonic sensors according to an embodiment of the present disclosure.
[0039] FIG. 22 is a diagram illustrating a method of obtaining a touch signal using a plurality of ultrasonic sensors according to an embodiment of the present disclosure.
[0040] FIG. 23 is a diagram illustrating a method of registering (e.g., customizing) a plurality of touch keys (e.g., side keys, soft keys, button-less keys) by distinguishing a sensor area of a side bezel according to an embodiment of the present disclosure.
[0041] FIGS. 24 to 29 are diagrams illustrating a user interface (UI) for registering (e.g., customizing) a plurality of touch keys (e.g., side keys, soft keys, button-less keys) by distinguishing a sensor area of a side bezel according to an embodiment of the present disclosure.
[0042] FIG. 30 is a diagram illustrating a method of recognizing a touch using a plurality of touch keys (e.g., a side key, a soft key, a button-less key) according to an embodiment of the present disclosure.
[0043] Throughout the drawings, it is understood that the same reference numbers represent identical or similar elements, features and structures.
[0044] The following description, with reference to the attached drawings, is provided to facilitate a comprehensive understanding of various embodiments of the present disclosure as defined by the claims and their equivalents. While it includes numerous specific details to aid understanding, these are to be considered merely exemplary. Accordingly, those skilled in the art will recognize that various changes and modifications can be made to the various embodiments described herein without departing from the scope and spirit of the present disclosure. Furthermore, descriptions of well-known functions and configurations may be omitted for clarity and brevity.
[0045] The terms and words used in the following description and claims are not limited to their meanings in the literature and are merely used to facilitate a clear and consistent understanding of the disclosure made by the inventors. Accordingly, it should be understood by those skilled in the art that the following description of various embodiments of this document is provided for illustrative purposes only and is not intended to limit this document as defined by the appended claims and their equivalents.
[0046] Singular forms should be understood to include plural referents unless the context clearly dictates otherwise. Thus, reference to "component surfaces" may include reference to one or more such surfaces.
[0047] It should be understood that each block of the flowchart and the combination of the flowcharts can be performed by one or more computer programs containing instructions. The entirety of one or more computer programs may be stored in a single memory device, or the one or more computer programs may be divided into different parts stored in multiple different memory devices.
[0048] Any function or operation described in the present disclosure may be processed by a single processor or a combination of processors. A single processor or a combination of processors is a circuit that performs processing and may include an application processor (AP, e.g., a central processing unit (CPU)), a communication processor (CP, e.g., a modem), a graphics processing unit (GPU), a neural processing unit (NPU) (e.g., an artificial intelligence (AI) chip), a Wi-Fi chip, a Bluetooth® chip, a global positioning system (GPS) chip, a near field communication (NFC) chip, a connection chip, a sensor controller, a touch controller, a fingerprint sensor controller, a display driver integrated circuit (IC), an audio codec chip, a universal serial bus (USB) controller, a camera controller, an image processing IC, a microprocessor unit (MPU), a system on a chip (SoC), or an integrated circuit (IC or the like).
[0049] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.
[0050] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).
[0051] The processor (120) may control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing, for example, software (e.g., a program (140)), and may perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculation, the processor (120) may store a command or data received from another component (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the command or data stored in the volatile memory (132), and store the resulting data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.
[0052] The auxiliary processor (123) may control at least a part of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, in the electronic device (101) itself where artificial intelligence is performed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.
[0053] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).
[0054] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0055] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0056] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.
[0057] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.
[0058] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).
[0059] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0060] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0061] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0062] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
[0063] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0064] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).
[0065] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0066] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).
[0067] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) may support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.
[0068] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the selected at least one antenna. According to one embodiment, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).
[0069] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent to a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.
[0070] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).
[0071] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service by itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0072] According to one embodiment, the display module (160) illustrated in FIG. 1 is described as including a foldable display or a flexible display, but is not limited thereto. The display module (160) may also include a bar type or plate type display.
[0073] According to one embodiment, the display module (160) illustrated in FIG. 1 may include a flexible display configured such that the screen (e.g., display screen) can be folded or unfolded.
[0074] According to one embodiment, the display module (160) illustrated in FIG. 1 may include a flexible display that is slidably arranged to provide a screen (e.g., a display screen).
[0075] According to one embodiment, the electronic device (101) illustrated in FIG. 1 may include a sensor component (sensor component, 480) that identifies a user's touch using ultrasonic waves (e.g., a first ultrasonic sensor (481), a second ultrasonic sensor (482) of FIG. 4) and a sensor component driving unit (e.g., a sensor component driving unit (490) of FIG. 4) that drives the sensor component (480) (e.g., a plurality of ultrasonic sensors).
[0076] According to one embodiment, the sensor component drive unit (490) may be built into and placed in the sensor component (480).
[0077] According to one embodiment, the sensor component drive unit (490) may be arranged in a separate configuration from the sensor component (480).
[0078] For example, the sensor component driving unit (490) may include a processor (e.g., the processor (491) of FIG. 5, the ultrasonic sensor driving unit) that drives a first ultrasonic sensor (e.g., the first ultrasonic sensor (481) of FIG. 5) and a second ultrasonic sensor (e.g., the second ultrasonic sensor (482) of FIG. 5). An electronic device (101) including a sensor component (480) (e.g., a plurality of ultrasonic sensors) and a sensor component driving unit (490) (e.g., the ultrasonic sensor driving unit) may include a side wall (e.g., the side bezel (218) of FIG. 2, the side bezel (510) of FIG. 5) that forms an external representation of the electronic device (101). For example, it may operate in a manner of transmitting ultrasonic waves (e.g., lamb waves) to a side (e.g., side bezel (218) of FIG. 2, side bezel (510) of FIG. 5) of a housing (e.g., housing (210) of FIG. 2) of an electronic device (101) and receiving a reflected wave (e.g., reflected signal) of the ultrasonic waves (e.g., lamb waves) to sense the touch of a user's finger.
[0079] FIG. 2 is a perspective view of the front of an electronic device according to one embodiment of the disclosure. FIG. 3 is a perspective view of the rear of an electronic device according to one embodiment of the disclosure.
[0080] Referring to FIGS. 2 and 3, an electronic device (200) according to one embodiment of the disclosure (e.g., the electronic device (101) of FIG. 1) may include a first side (or front side) (210A), a second side (or back side) (210B), and a housing (210). A display (201) (e.g., the display (410) of FIG. 4) may be placed in a space formed by the housing (210). The housing (210) may include a side surface (210C) surrounding a space between the first side (210A) and the second side (210B).
[0081] According to one embodiment, the housing (210) may refer to a structure forming a portion of the first side (210A), the second side (210B), and the side surface (210C).
[0082] According to one embodiment, the first side (210A) may be formed by a front plate (202) that is at least partially substantially transparent (e.g., a glass plate or a polymer plate comprising various coating layers).
[0083] According to one embodiment, the second side (210B) may be formed by a substantially opaque back plate (211). The back plate (211) may be formed by, for example, coated or colored glass, ceramic, polymer, metal (e.g., aluminum, stainless steel, titanium, or magnesium), or a combination of at least two of the above materials. However, the present invention is not limited thereto, and the back plate (211) may also be formed by transparent glass.
[0084] According to one embodiment, the side (210C) may be formed by a side bezel (218) (e.g., side bezel (510) of FIG. 5) (e.g., side bezel structure, side of housing, side member) that is coupled with the front plate (202) and the back plate (211) and comprises a metal (e.g., aluminum, stainless steel, titanium) and / or a polymer.
[0085] According to one embodiment, the back plate (211) and the side bezel (218) (e.g., the side bezel structure, the side of the housing, the side member) may be formed integrally and include the same material (e.g., a metal material such as aluminum).
[0086] According to one embodiment, the front plate (202) may include two first regions (210D) that extend seamlessly from the first side (210A) toward the rear plate (211). The two first regions (210D) may be arranged at both ends of a long edge of the front plate (202).
[0087] According to one embodiment, the back plate (211) may include two second regions (210E) that extend seamlessly from the second surface (210B) toward the front plate (202).
[0088] According to one embodiment, the front plate (202) (or the rear plate (211)) may include only one of the first regions (210D) (or the second regions (210E)).
[0089] In one embodiment, some of the first regions (210D) or second regions (210E) may not be included. In embodiments, when viewed from the side of the electronic device (200), the side bezel (218) (e.g., side bezel structure, side of the housing, side member) may have a first thickness (or width) on the side that does not include the first regions (210D) or second regions (210E), and may have a second thickness that is thinner than the first thickness on the side that includes the first regions (210D) or second regions (210E).
[0090] According to one embodiment, the electronic device (200) includes a display (201) (e.g., a display module (160) of FIG. 1, a display (410) of FIG. 4), an audio input device (203) (e.g., an input module (150) of FIG. 1), an audio output device (207, 214) (e.g., an audio output module (155) of FIG. 1), a sensor module (204, 219) (e.g., a sensor module (176) of FIG. 1), a sensor component (480) (e.g., a plurality of ultrasonic sensors) (e.g., a sensor module (176) of FIG. 1, a sensor component (480) of FIG. 4 (e.g., a plurality of ultrasonic sensors)), a camera module (205, 212) (e.g., a camera module (180) of FIG. 1), a flash (213), a touch key (217) (e.g., a side key, a soft key, a button-less key), an indicator (not shown), and a connector. It may include at least one of the holes (208, 209).
[0091] According to one embodiment, the electronic device (200) may replace physical buttons with touch keys (217) (e.g., side keys, soft keys, buttonless keys).
[0092] According to one embodiment, the display (201) may be visually visible through the upper portion of the front plate (202).
[0093] According to one embodiment, at least a portion of the display (201) may be visible through the front plate (202) forming the first surface (210A) and the first area (210D) of the side surface (210C). The display (201) may be coupled to or adjacent to a touch sensing circuit, a pressure sensor capable of measuring the intensity (pressure) of a touch, and / or a digitizer capable of detecting a magnetic field-type stylus pen.
[0094] According to one embodiment, at least a portion of the sensor module (204, 219) and / or at least a portion of the touch key (217) (e.g., side key, soft key, buttonless key) may be disposed in the first area (210D) and / or the second area (210E).
[0095] According to one embodiment, at least one of a sensor module (204), camera modules (205) (e.g., an image sensor), an audio module (214), and a sensor component (480) (e.g., a plurality of ultrasonic sensors) may be included on the back surface of the screen display area of the display (201).
[0096] According to one embodiment, the display (201) may be coupled to or disposed adjacent to a touch sensing circuit, a pressure sensor capable of measuring the intensity (pressure) of a touch, and / or a digitizer capable of detecting a magnetic field type stylus pen.
[0097] According to one embodiment, at least a portion of the sensor modules (204, 219) and / or at least a portion of the touch keys (217) (e.g., side keys, soft keys, buttonless keys) may be disposed in the first areas (210D) and / or the second areas (210E).
[0098] According to one embodiment, the audio input device (203) may include a microphone.
[0099] According to one embodiment, the input device (203) may include a plurality of microphones arranged to detect the direction of sound. The audio output device (207, 214) may include an external speaker (207) and a receiver for calls (e.g., an audio module (214)). In some embodiments, the audio input device (203, e.g., a microphone), the audio output device (207, 214), and the connector holes (208, 209) may be arranged in an internal space of the electronic device (200) and may be exposed to the external environment through at least one hole formed in the housing (210). In some embodiments, the hole formed in the housing (210) may be used in common for the audio input device (203, e.g., a microphone) and the audio output device (207, 214). In some embodiments, the audio output device (207, 214) may include a speaker (e.g., a piezo speaker) that operates without the hole formed in the housing (210).
[0100] According to one embodiment, the sensor module (204, 219) (e.g., the sensor module (176) of FIG. 1) may generate an electrical signal or data value corresponding to an internal operating state of the electronic device (200) or an external environmental state. The sensor module (204, 219) may include, for example, a first sensor module (204) (e.g., a proximity sensor) disposed on a first surface (210A) of the housing (210) and / or a second sensor module (219) (e.g., an HRM sensor) disposed on a second surface (210B) of the housing (210). For example, the second sensor module (219) may further include a fingerprint sensor.
[0101] According to one embodiment, the sensor component (480) (e.g., a plurality of ultrasonic sensors) may be built into the display (201) or may be disposed on a first surface (e.g., a back surface) of the display (201) (e.g., below the display (201) with respect to the z-axis). At least a portion of the sensor component (480) (e.g., a plurality of ultrasonic sensors) may be disposed in the first area (210D).
[0102] According to one embodiment, a processor of an electronic device (200) (e.g., processor (120) of FIG. 1) may perform fingerprint recognition using a sensor component (480) (e.g., a plurality of ultrasonic sensors). For example, the processor (120) may determine to start fingerprint recognition when an application program requiring user authentication (e.g., fingerprint recognition) is executed. When the sensor component (480) (e.g., a plurality of ultrasonic sensors) is in an inactive state, the processor (120) may transmit (e.g., transmit) a control signal to the sensor component (480) (e.g., a plurality of ultrasonic sensors) to instruct to switch the sensor component (480) (e.g., a plurality of ultrasonic sensors) to an active state based on a determination to start fingerprint recognition.
[0103] According to one embodiment, a sensor component (480) (e.g., a plurality of ultrasonic sensors) may detect an operating state of an electronic device (200) (e.g., an electronic device (101) of FIG. 1) or an external environmental state, and provide the detected information to a processor (120).
[0104] According to one embodiment, the sensor component (480) (e.g., a plurality of ultrasonic sensors) can obtain biometric information (e.g., fingerprint information) of a user by scanning a contacted external object (e.g., a finger). For example, the sensor component (480) (e.g., a plurality of ultrasonic sensors) can obtain fingerprint information of a user by fingerprint recognition based on an ultrasonic method. The sensor component (480) (e.g., a plurality of ultrasonic sensors) can collect information (e.g., fingerprint information) related to the shape of an external object based on ultrasonic waves reflected and received by the display (201) and / or the external object (e.g., a finger).
[0105] The electronic device (200) may further include at least one of a sensor module not shown, for example, a gesture sensor, a gyro sensor, a pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0106] According to one embodiment, the camera modules (205, 212) may include a first camera module (205) disposed on a first side (210A) of the electronic device (200), and a second camera module (212) disposed on a second side (210B). A flash (213) may be disposed around the camera modules (205, 212). The camera modules (205, 212) may include one or more lenses, an image sensor, and / or an image signal processor. The flash (213) may include, for example, a light-emitting diode or a xenon lamp.
[0107] According to one embodiment, the first camera module (205) may be placed at the bottom of the display panel of the display (201) in an under display camera (UDC) manner.
[0108] According to one embodiment, two or more lenses (wide-angle and telephoto lenses) and image sensors may be arranged on one side of the electronic device (200).
[0109] According to one embodiment, a plurality of first camera modules (205) may be arranged in an under-display camera (UDC) manner on a first side (e.g., a side on which a screen is displayed) of an electronic device (200).
[0110] According to one embodiment, a touch key (217) (e.g., a side key, a soft key, a button-less key) may be positioned on a side (210C) of the housing (210).
[0111] According to one embodiment, the electronic device (200) may not include some or all of the above-mentioned touch keys (217) (e.g., side keys, soft keys, button-less keys), and the touch keys (217) that are not included (e.g., side keys, soft keys, button-less keys) may be implemented in other forms, such as soft keys, on the display (201).
[0112] According to one embodiment, the touch keys (217) (e.g., side keys, soft keys, buttonless keys) may be implemented using a pressure sensor included in the display (201).
[0113] According to one embodiment, the connector holes (208, 209) may include a first connector hole (208) that can accommodate a connector (e.g., a USB connector) for transmitting and receiving power and / or data with an external electronic device, and / or a second connector hole (209, or an earphone jack) that can accommodate a connector for transmitting and receiving audio signals with an external electronic device. The first connector hole (208) may include a port of a universal serial bus (USB) type A or USB type C. When the first connector hole (208) supports a USB type C, the electronic device (200, e.g., the electronic device (101) of FIG. 1) may support USB power delivery (PD) charging.
[0114] According to one embodiment, some of the first camera modules (205, 212) and / or some of the sensor modules (204, 219) may be arranged to be visually visible through the display (201).
[0115] According to one embodiment, when the first camera module (205) is arranged in an under display camera (UDC) manner, the first camera module (205) may not be visually visible to the outside.
[0116] According to one embodiment, the first camera module (205) may be arranged to overlap with the display area, and may also display a screen in the display area corresponding to the first camera module (205). Some sensor modules (204) may also be arranged to perform their functions without being visually exposed through the front plate (202) in the internal space of the electronic device.
[0117] According to one embodiment, the electronic device (200) illustrated in FIG. 2 may include an ultrasonic sensor (e.g., a sensor component (480) of FIG. 4 (e.g., a plurality of ultrasonic sensors)) that identifies a user's touch using ultrasonic waves, and a sensor component driving unit (e.g., a sensor component driving unit (490) of FIGS. 4 and 5) that drives the sensor component (480) (e.g., a plurality of ultrasonic sensors).
[0118] According to one embodiment, at least a portion of a side bezel (218) (e.g., a side bezel structure, a side of the housing, a side member) disposed on a side of the housing (210) may be used as a sensor area (e.g., a sensor area (620) of FIG. 6) for touch sensing (e.g., a touch area, a touch plate, a sensor plate).
[0119] For example, without arranging a separate configuration for touch sensing, at least a portion of a side bezel (218) (e.g., a side bezel structure, a side of the housing, a side member) arranged on a side of the housing (210) can be used as a sensor area (620) for touch sensing.
[0120] For example, a plurality of ultrasonic sensors (e.g., sensor components (480) of FIG. 4 (e.g., a plurality of ultrasonic sensors)) may be arranged on the inside (e.g., inside) of the side bezel (218) (e.g., side bezel structure, side of the housing, side member) of the housing (210). The plurality of ultrasonic sensors (e.g., sensor components (480) of FIG. 4 (e.g., a plurality of ultrasonic sensors)) may be arranged to correspond to a sensor area (e.g., sensor area (620) of FIG. 6) (e.g., touch area, touch plate, sensor plate), and the sensor area (e.g., sensor area (620) of FIG. 6) (e.g., touch area, touch plate, sensor plate) may be divided into a plurality of areas to operate as a plurality of touch keys (217) (e.g., side keys, soft keys, button-less keys).
[0121] According to one embodiment, an electronic device (200) including a sensor component (480) (e.g., a plurality of ultrasonic sensors) and a sensor component driver (490) (e.g., an ultrasonic sensor driver) can sense a touch of a user's finger by transmitting an ultrasonic wave (e.g., a lamb wave) to a side bezel (218) of a housing (210) (e.g., a side bezel structure, a side of the housing, a side member) and receiving a reflected wave (e.g., a reflected signal) of the ultrasonic wave (e.g., a lamb wave).
[0122] FIGS. 4 and 5 are block diagrams illustrating the configuration of an electronic device according to one embodiment.
[0123] Referring to FIGS. 4 and 5, an electronic device (400) according to an embodiment of the disclosure (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIGS. 2 and 3) may include a display module (160) (e.g., the display module (160) of FIG. 1), a processor (420) (e.g., the processor (120) of FIG. 1), a memory (433) (e.g., the memory (130) of FIG. 1), a PMIC (power management integrated circuit) (440) (e.g., the power management module (188) of FIG. 1), a sensor component (480) (e.g., a plurality of ultrasonic sensors), and a sensor component driver (490) (e.g., an ultrasonic sensor driver). For example, a user's touch may be identified using the sensor component (480) (e.g., a plurality of ultrasonic sensors).
[0124] According to one embodiment, the sensor component drive unit (490) may be built into and placed in the sensor component (480).
[0125] According to one embodiment, the sensor component drive unit (490) may be arranged in a separate configuration from the sensor component (480).
[0126] For example, the sensor component driving unit (490) may include a processor (491) (e.g., ultrasonic sensor driving unit) that drives a first ultrasonic sensor (481) and a second ultrasonic sensor (482).
[0127] In FIG. 5, a sensor component (480) (e.g., a plurality of ultrasonic sensors) is disposed on the inner side (511) (e.g., inside) of a side bezel (510) (e.g., a side bezel (218) of FIG. 2) of a housing (e.g., a housing (210) of FIG. 2), a sensor component driver (490) (e.g., an ultrasonic sensor driver) that drives the sensor component (480) (e.g., a plurality of ultrasonic sensors), a PMIC (440) that supplies power, and a processor (420) that controls the operation of the sensor component driver (490) (e.g., an ultrasonic sensor driver).
[0128] According to one embodiment, the display module (160) may include a display driver IC (430, display driver IC) (e.g., a display driving unit) for driving a display (410) (e.g., the display (201) of FIG. 2), a touch circuit (450) for detecting a touch on the display (410), a digitizer (460), and a digitizer driving unit (470). Hereinafter, the display driver IC (430) may be referred to as 'DDIC'.
[0129] According to one embodiment, the DDIC (430) may include an interface module (431), a memory (433) (e.g., a buffer memory), an image processing module (435), or a mapping module (437).
[0130] According to one embodiment, the DDIC (430) can receive image information including image data or an image control signal corresponding to a command for controlling the image data from another component of an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2) through an interface module (431).
[0131] According to one embodiment, the image information may be received from a processor (420) (e.g., the main processor (121) of FIG. 1) (e.g., an application processor) or an auxiliary processor (e.g., the auxiliary processor (123) of FIG. 1) (e.g., a graphics processing unit) that operates independently of the functions of the main processor (121).
[0132] According to one embodiment, the DDIC (430) can communicate with the touch circuit (450) or the sensor module (176) through the interface module (431). In addition, the DDIC (430) can store at least some of the received image information in the memory (433). As an example, the DDIC (430) can store at least some of the received image information in the memory (433) on a frame-by-frame basis.
[0133] According to one embodiment, the image processing module (435) may perform preprocessing or postprocessing (e.g., resolution, brightness, or size adjustment) on at least a portion of the image data based at least on characteristics of the image data or characteristics of the display (410).
[0134] According to one embodiment, the mapping module (437) may generate a voltage value or a current value corresponding to the image data pre-processed or post-processed through the image processing module (435). According to one embodiment, the generation of the voltage value or the current value may be performed at least in part based on, for example, the properties of the pixels of the display (410) (e.g., the arrangement of the pixels (RGB stripe or pentile structure), or the size of each sub-pixel).
[0135] According to one embodiment, at least some pixels of the display (410) may be driven based at least in part on, for example, the voltage value or current value, so that visual information (e.g., text, an image, or an icon) corresponding to the image data may be displayed through the display (410).
[0136] According to one embodiment, the touch circuit (450) may include a touch sensor (451) (e.g., a touch screen) and a touch sensor IC (453, touch fingerprint sensor integrated circuit).
[0137] According to one embodiment, the touch circuit (450) can detect a touch input or hovering input for a specific location of the display (410). The touch sensor IC (453) can control the touch sensor (451) (e.g., a touch screen) to detect the touch input or hovering input. For example, the touch sensor IC (453) can detect the touch input or hovering input by measuring a change in a signal (e.g., voltage, light quantity, resistance, or charge quantity) for a specific location of the display (410). The touch sensor IC (453) can provide information (e.g., location, area, pressure, or time) about the detected touch input or hovering input to the processor (420) (e.g., transmit to the processor (420), input to the processor (420).
[0138] According to one embodiment, the touch sensor (451) (e.g., a touch screen) may be applied in an add-on manner in which the touch sensor (451) is manufactured separately and separately placed on the upper part (e.g., above) of the display (410).
[0139] According to one embodiment, the touch sensor (451) (e.g., a touch screen) may be applied in an on cell manner in which the touch sensor (451) is placed on the upper part of the display (410).
[0140] According to one embodiment, the touch sensor (451) (e.g., a touch screen) may be applied in an in-cell manner in which the touch sensor (451) is arranged together with the pixels of the display (410).
[0141] According to one embodiment, at least a portion of the touch circuit (450) (e.g., touch sensor IC (453)) may be included as part of the DDIC (430) or the display (410).
[0142] According to one embodiment, at least a portion of the touch circuit (450) (e.g., touch sensor IC (453)) may be included as part of another component (e.g., auxiliary processor (123)) disposed external to the display module (160).
[0143] According to one embodiment, the display module (160) may further include at least one sensor (e.g., a fingerprint sensor, an iris sensor, a pressure sensor, or an illuminance sensor) of the sensor module (176), or a control circuit therefor. In this case, the at least one sensor or the control circuit therefor may be embedded in a part of the display module (160) (e.g., the display (410) or the DDIC (430)) or a part of the touch circuit (450).
[0144] For example, if the sensor module (176) embedded in the display module (160) includes a pressure sensor, the pressure sensor can obtain (e.g., receive) pressure information associated with a touch input through a portion or the entire area of the display (410).
[0145] According to one embodiment, the touch sensor (451) or sensor module (176) may be positioned between pixels of a pixel layer of the display (410), or above or below the pixel layer.
[0146] According to one embodiment, the display module (160) may include a digitizer (460) for detecting an input (e.g., a touch input or a hovering input) of an electronic pen (e.g., a stylus pen). For example, a digitizer driving unit (470) for driving the digitizer (460) may be included as a component of the display module (160). For example, the digitizer driving unit (470) for driving the digitizer (460) may be included as a separate component from the display module (160). For example, the digitizer (460) may convert analog coordinates (e.g., a position) of an electronic pen (e.g., a stylus pen) into digital coordinate data. The digitizer (460) may transmit the digital coordinate data to a processor (e.g., the processor (120) of FIG. 1) and / or a DDI (430).
[0147] According to one embodiment, the processor (420) (e.g., the processor (120) of FIG. 1) may obtain (e.g., receive) digital coordinate data input from a digitizer (460). The processor (420) may detect an input (e.g., a touch input or a hovering input) through an electronic pen (e.g., a stylus pen) based on the digital coordinate data. For example, the digitizer (460) may include a plurality of x-axis channels and a plurality of y-axis channels. The processor (420) may sense the position of the electronic pen (e.g., the stylus pen) using sensing signals (e.g., electro magnetic resonance (EMR) signals) received from the x-axis channels and the y-axis channels arranged in the digitizer (460). For example, a digitizer (460) may have a plurality of x-axis channels and a plurality of y-axis channels sequentially arranged, and a processor (420) may sense the position of an electronic pen (e.g., a stylus pen) using sensing signals received from a plurality of consecutive channels (e.g., three adjacent channels).
[0148] In one embodiment, the digitizer (460) may be hidden from the outside by the display (410), electronic components, and mechanisms.
[0149] For example, the digitizer (460) may be disposed integrally with the flat display (410) or disposed adjacent to the flat display (410). For example, when the digitizer (460) is applied to the flat display (410), the digitizer (460) may include one EMR (electro magnetic resonance) sheet (or EMR film). A plurality of x-axis channels and a plurality of y-axis channels for detecting the position of the electronic pen may be disposed on one EMR sheet.
[0150] For example, the digitizer (460) may be disposed integrally with a flexible display (e.g., a rollable display or a foldable display), or may be disposed adjacent to the flexible display. For example, the digitizer (460) may be disposed at the bottom (e.g., below) of the display (410) (e.g., the display (201) of FIG. 2) in the z-axis direction (e.g., the z-axis direction of FIG. 2).
[0151] For example, a digitizer (460) may be placed at the bottom (e.g., below) of a bar type display (e.g., display (201) of FIG. 2).
[0152] According to one embodiment, the electronic device (400) may include a sensor component (480) (e.g., a plurality of ultrasonic sensors) that identifies a user's touch using ultrasonic waves, and a sensor component driving unit (490) (e.g., an ultrasonic sensor driving unit) that drives the sensor component (480) (e.g., a plurality of ultrasonic sensors).
[0153] According to one embodiment, at least a portion of a side bezel (510) (e.g., a side bezel (218) of FIG. 2) (e.g., a side bezel structure, a side surface of the housing, a side member) disposed on a side surface of a housing (e.g., a housing (210) of FIG. 2) of an electronic device (400) (e.g., an electronic device (101) of FIG. 1, an electronic device (200) of FIG. 2) may be used as a sensor area (e.g., a sensor area (620) of FIG. 6) (e.g., a touch area, a touch plate, a sensor plate). For example, a plurality of sensor components (480) (e.g., a plurality of ultrasonic sensors) may be disposed on the inner side (511) (e.g., the inside) of the side bezel (218, 510) (e.g., a side bezel structure, a side surface of the housing, a side member) of the housing (210) of the electronic device (200, 400). A plurality of sensor components (480) (e.g., a plurality of ultrasonic sensors) may be arranged to correspond to a sensor area (e.g., a sensor area (620) of FIG. 6) (e.g., a touch area, a touch plate, a sensor plate). For example, a plurality of sensor components (480) (e.g., a plurality of ultrasonic sensors) may be arranged on the inner side (511) (e.g., inside) of a side bezel (218, 510) (e.g., a side bezel structure, a side of the housing, a side member) of the housing (210).
[0154] According to one embodiment, at least a portion of the bottom surface of the housing (210) (e.g., the second surface (210b) of the rear plate (211) of FIG. 3) can be used as a sensor area (e.g., the sensor area (620) of FIG. 6) (e.g., a touch area, a touch plate, a sensor plate).
[0155] For example, a plurality of sensor components (480) (e.g., a plurality of ultrasonic sensors) may be arranged on the inside (e.g., the inside) of the bottom surface (e.g., the second surface (210b) of the rear plate (211) of FIG. 3) of the housing (210) of the electronic device (200, 400).
[0156] For example, the sensor component (480) (e.g., a plurality of ultrasonic sensors) may include a first ultrasonic sensor (481) and a second ultrasonic sensor (482). Without being limited thereto, the sensor component (480) (e.g., a plurality of ultrasonic sensors) may include three or more ultrasonic sensors.
[0157] For example, the first ultrasonic sensor (481) and the second ultrasonic sensor (482) may be positioned to contact the inner side (511) (e.g., inside) of the side bezel (218, 510) of the housing (210) (e.g., side bezel structure, side of the housing, side member).
[0158] For example, a plurality of sensor components (480) (e.g., a plurality of ultrasonic sensors) may be arranged to contact the inside (e.g., the inside) of the bottom surface of the housing (210) (e.g., the second surface (210b) of the rear plate (211) of FIG. 3).
[0159] For example, ultrasonic waves (e.g., vibrations) generated from the first ultrasonic sensor (481) and the second ultrasonic sensor (482) can be transmitted to the side bezel (218, 510) as lamb waves.
[0160] For example, ultrasonic waves (e.g., vibrations) generated from the first ultrasonic sensor (481) and the second ultrasonic sensor (482) can be transmitted as lamb waves to the bottom surface of the housing (210) (e.g., the second surface (210b) of the rear plate (211) of FIG. 3).
[0161] FIG. 6 is a drawing showing a plurality of ultrasonic sensors arranged to correspond to a sensor area according to an embodiment of the present disclosure.
[0162] Referring to FIG. 6, a sensor area (620) (e.g., a touch area, a touch plate, a sensor plate) may be formed on at least a portion of a housing (e.g., a side bezel (510) of a housing (210) of FIG. 2 (e.g., a side bezel (218) of FIG. 2, a side bezel (510) of FIG. 5) of an electronic device (e.g., an electronic device (101) of FIG. 1, an electronic device (200) of FIG. 2, an electronic device (400) of FIG. 4).
[0163] According to one embodiment, at least a portion of the side bezel (218, 510) may be utilized as a sensor area (620) (e.g., touch area, touch plate, sensor plate).
[0164] In one embodiment, the entire side bezel (218, 510) can be used as a sensor area (620) (e.g., touch area, touch plate, sensor plate).
[0165] For example, at least a portion of the side bezel (218, 510) may be utilized as a plurality of touch keys (e.g., buttons, side key buttons, soft buttons).
[0166] According to one embodiment, at least a portion of the bottom surface of the housing (210) (e.g., the second surface (210b) of the rear plate (211) of FIG. 3) can be used as a sensor area (620) (e.g., a touch area, a touch plate, a sensor plate).
[0167] According to one embodiment, the entire bottom surface of the housing (210) (e.g., the second surface (210b) of the rear plate (211) of FIG. 3) can be used as a sensor area (620) (e.g., touch area, touch plate, sensor plate).
[0168] For example, at least a portion of the bottom surface of the housing (210) (e.g., the second surface (210b) of the rear plate (211) of FIG. 3) can be used as a plurality of touch keys (e.g., a button, a side key button, a soft button).
[0169] According to one embodiment, the first ultrasonic sensor (481) and the second ultrasonic sensor (482) may be positioned at a certain distance (e.g., spaced apart from each other) on the inner side (e.g., the inner side (511) of FIG. 5) of the side bezel (218, 510) (e.g., the side bezel structure, the side of the housing, the side member).
[0170] For example, the first ultrasonic sensor (481) may be positioned at a position corresponding to the first part (621) of the sensor area (620) (e.g., touch area, touch plate, sensor plate) on the inner side (e.g., the inner side (511) of FIG. 5) of the side bezel (218, 510) (e.g., the side bezel structure, the side of the housing, the side member). The first ultrasonic sensor (481) may be positioned so as to contact the inner side (e.g., the inner side (511) of FIG. 5) (e.g., the inside) of the side bezel (218, 510) (e.g., the side bezel structure, the side of the housing, the side member) on the first part (621). Since the first ultrasonic sensor (481) is arranged (e.g., located) on the inner side (e.g., the inner side (511) of FIG. 5) (e.g., inside) of the side bezel (218, 510) (e.g., the side bezel structure, the side of the housing, the side member), the arrangement of the first ultrasonic sensor (481) may not be visible from the outside of the electronic device.
[0171] For example, the second ultrasonic sensor (482) may be positioned at a position corresponding to the second part (622) of the sensor area (620) (e.g., touch area, touch plate, sensor plate) on the inner side (e.g., inner side (511) of FIG. 5) of the side bezel (218, 510) (e.g., side bezel structure, side of the housing, side member). The second ultrasonic sensor (482) may be positioned so as to contact the inner side (e.g., inner side (511) of FIG. 5) (e.g., inside) of the side bezel (218, 510) (e.g., side bezel structure, side of the housing, side member) on the second part (622). Since the second ultrasonic sensor (482) is arranged (e.g., located) on the inner side (e.g., the inner side (511) of FIG. 5) (e.g., inside) of the side bezel (218, 510) (e.g., the side bezel structure, the side of the housing, the side member), the arrangement of the second ultrasonic sensor (482) may not be visible from the outside of the electronic device.
[0172] According to one embodiment, the first ultrasonic sensor (481) and the second ultrasonic sensor (482) may be positioned at a certain distance (e.g., spaced apart from each other) on the inside (e.g., inside) of the bottom surface of the housing (210) (e.g., the second surface (210b) of the rear plate (211) of FIG. 3).
[0173] For example, the first ultrasonic sensor (481) may be positioned at a position corresponding to the first part (621) of the sensor area (620) (e.g., touch area, touch plate, sensor plate) on the inside (e.g., inside) of the bottom surface of the housing (210) (e.g., the second surface (210b) of the rear plate (211) of FIG. 3). The first ultrasonic sensor (481) may be positioned so as to contact the inside (e.g., inside) of the bottom surface of the housing (210) (e.g., the second surface (210b) of the rear plate (211) of FIG. 3) on the first part (621). Since the first ultrasonic sensor (481) is arranged (e.g., located) on the inside (e.g., inside) of the bottom surface of the housing (210) (e.g., the second surface (210b) of the rear plate (211) of FIG. 3), the arrangement of the first ultrasonic sensor (481) may not be visible from the outside of the electronic device.
[0174] For example, the second ultrasonic sensor (482) may be positioned at a position corresponding to the second part (622) of the sensor area (620) (e.g., touch area, touch plate, sensor plate) on the inner side (e.g., inside) of the bottom surface of the housing (210) (e.g., the second side (210b) of the rear plate (211) of FIG. 3). The second ultrasonic sensor (482) may be positioned so as to contact the inner side (e.g., inside) of the bottom surface of the housing (210) (e.g., the second side (210b) of the rear plate (211) of FIG. 3) on the second part (622). Since the second ultrasonic sensor (482) is arranged (e.g., located) on the inside (e.g., inside) of the bottom surface of the housing (210) (e.g., the second surface (210b) of the rear plate (211) of FIG. 3), the arrangement of the second ultrasonic sensor (482) may not be visible from the outside of the electronic device.
[0175] According to one embodiment, data (e.g., instructions) for executing application programs related to touch sensing using an ultrasonic sensor (e.g., a sensor component (480) of FIG. 4 (e.g., a plurality of ultrasonic sensors)) may be stored in a memory (e.g., a memory (130) of FIG. 1, a memory (433) of FIG. 4).
[0176] According to one embodiment, a memory (e.g., memory (130) of FIG. 1, memory (433) of FIG. 4) (e.g., memory (130) of FIG. 1) may store various data (e.g., instructions) used by at least one component (e.g., processor (420), display (410), and / or sensor component (480) (e.g., multiple ultrasonic sensors) of an electronic device (400). For example, the data may include information for driving the sensor component (480) (e.g., multiple ultrasonic sensors), information related to background noise of the ultrasonic sensor. For example, information related to background noise of the ultrasonic sensor may be acquired during the initial operation of the electronic device (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2, electronic device (400) of FIG. 4). For example, information related to background noise of the ultrasonic sensor may be acquired by a plurality of touch keys (e.g., multiple touch keys (217) of FIG. 2, soft keys, It can be obtained through a scan of background noise performed before registering a buttonless key (e.g. customizing multiple touch keys).
[0177] According to one embodiment, the first ultrasonic sensor (481) may generate a first ultrasonic wave (e.g., vibration) of a first frequency (e.g., low frequency) and output it to a side bezel (218, 510) of the housing (210) (e.g., side bezel structure, side of the housing, side member) or a bottom surface of the housing (210). The first ultrasonic wave (e.g., vibration) transmitted to the side bezel (218, 510) (e.g., side bezel structure, side of the housing, side member) or the bottom surface of the housing (210) may be transmitted to the side bezel (218, 510) of the housing (210) or the bottom surface of the housing (210) as a first lamb wave. For example, the first ultrasonic sensor (481) may generate a first ultrasonic wave (e.g., vibration) of a first frequency (e.g., low frequency) lower than that of the second ultrasonic sensor (482). For example, the first ultrasonic sensor (481) can receive a first reflected wave according to a first plate wave of a first frequency. The first ultrasonic sensor (481) can receive a second transmitted wave according to a second plate wave of a second frequency.
[0178] According to one embodiment, the second ultrasonic sensor (482) may generate a second ultrasonic wave (e.g., vibration) of a second frequency (e.g., high frequency) and output it to the side bezel (218, 510) of the housing (210) (e.g., side bezel structure, side of the housing, side member) or the bottom surface of the housing (210). The second ultrasonic wave (e.g., vibration) transmitted to the side bezel (218, 510) (e.g., side bezel structure, side of the housing, side member) or the bottom surface of the housing (210) may be transmitted to the side bezel (218, 510) of the housing (210) or the bottom surface of the housing (210) as a second lamb wave. For example, the second ultrasonic sensor (482) may generate a second ultrasonic wave (e.g., vibration) of a second frequency (e.g., low frequency) higher than that of the first ultrasonic sensor (481). For example, the second ultrasonic sensor (482) can receive a second reflected wave according to a second plate wave of a second frequency. The second ultrasonic sensor (482) can receive a first transmitted wave according to a first plate wave of a first frequency.
[0179] According to one embodiment, when a second plate wave is output from the second ultrasonic sensor (482), the time at which a second transmission wave according to the second plate wave is received by the first ultrasonic sensor (481) (e.g., arrival time of the signal, reception time of the signal) can be known. The first reflected wave and the second transmission wave received by the first ultrasonic sensor (481) can be used to sense the position at which the finger is touched.
[0180] According to one embodiment, when a first plate wave is output from a first ultrasonic sensor (481), the time at which a first transmission wave according to the first plate wave is received by a second ultrasonic sensor (482) (e.g., arrival time of a signal, reception time of a signal) can be known. The second reflected wave and the first transmission wave received by the second ultrasonic sensor (482) can be used to sense the position at which a finger is touched.
[0181] According to one embodiment, the position where a finger is touched can be sensed using the first reflected wave and the second transmitted wave received from the first ultrasonic sensor (481) and the second reflected wave and the first transmitted wave received from the second ultrasonic sensor (482). As the signals received by the first ultrasonic sensor (481) and the signals received by the second ultrasonic sensor (482) increase, the precision of sensing can be increased.
[0182] An electronic device (200, 400) according to one embodiment of the disclosure may include a housing (e.g., housing (210) of FIG. 2) including a wall (e.g., side bezel (218) of FIG. 2, side bezel (510) of FIG. 6) forming an outer surface of the electronic device (200, 400).
[0183] According to one embodiment, the sensor component (e.g., the sensor component (480) of FIGS. 4 and 5) may include a first sensor (e.g., a first ultrasonic sensor (481) of FIG. 5) and a second sensor (e.g., a second ultrasonic sensor (482) of FIG. 5).
[0184] For example, a first sensor (e.g., a first ultrasonic sensor (481)) and a second sensor (e.g., a second ultrasonic sensor (482)) may be positioned to contact an inner surface of a wall (e.g., a side bezel (218) of FIG. 2, a side bezel (510) of FIG. 6).
[0185] For example, a first sensor (e.g., a first ultrasonic sensor (481)) can transmit a first wave (e.g., a first plate wave) so that the first wave propagates toward a second sensor (482) through a wall (e.g., a side bezel (218) of FIG. 2, a side bezel (510) of FIG. 6).
[0186] For example, a second sensor (e.g., a second ultrasonic sensor (482)) can transmit a second wave (e.g., a second plate wave) so that the second wave propagates toward the first sensor (e.g., a first ultrasonic sensor (481)) through a wall (e.g., a side bezel (218) of FIG. 2, a side bezel (510) of FIG. 6).
[0187] For example, a first sensor (e.g., a first ultrasonic sensor (481)) can receive the second wave (e.g., a second plate wave) transmitted from a second sensor (e.g., a second ultrasonic sensor (482)). The first sensor (e.g., a first ultrasonic sensor (481)) can receive a first reflected wave corresponding to the first wave (e.g., a second plate wave) generated by a touch applied to an outer surface of a wall (e.g., a side bezel (218) of FIG. 2, a side bezel (510) of FIG. 6).
[0188] For example, a second sensor (e.g., a second ultrasonic sensor (482)) can receive a first wave (e.g., a first plate wave) transmitted from a first sensor (e.g., a first ultrasonic sensor (481)). The second sensor (e.g., a second ultrasonic sensor (482)) can receive a second reflected wave corresponding to a second wave (e.g., a first plate wave) generated by a touch applied to an outer surface of a wall (e.g., a side bezel (218) of FIG. 2, a side bezel (510) of FIG. 6).
[0189] For example, a memory (e.g., memory (433) of FIG. 4) may store instructions that operate the electronic device (200, 400) when executed by a processor (e.g., processor (420) of FIGS. 4 and 5).
[0190] For example, when instructions are executed by the processor (420), the electronic device (200, 400) can identify a touch location based on a first reflection wave and a second reflection wave according to a touch applied to an outer surface of a wall (e.g., a side bezel (218) of FIG. 2, a side bezel (510) of FIG. 6).
[0191] For example, when instructions are executed by the processor (420), the electronic device (200, 400) can identify touch pressure based on a first reflection wave and a second reflection wave according to a touch applied to an outer surface of a wall (e.g., a side bezel (218) of FIG. 2, a side bezel (510) of FIG. 6).
[0192] For example, when instructions are executed by the processor (420), the electronic device (200, 400) can identify a touch gesture and a touch input time based on a first reflection wave and a second reflection wave according to a touch applied to an outer surface of a wall (e.g., a side bezel (218) of FIG. 2, a side bezel (510) of FIG. 6).
[0193] For example, a first sensor (e.g., a first ultrasonic sensor (481)) can transmit a first wave (e.g., a first plate wave) of a first frequency (e.g., a relatively low frequency compared to a second frequency).
[0194] For example, the second sensor (e.g., the second ultrasonic sensor (482)) may transmit a second wave (e.g., a second plate wave) of a second frequency. The second sensor (e.g., the second ultrasonic sensor (482)) may transmit a second frequency different from the first frequency (e.g., a relatively high frequency compared to the first frequency).
[0195] For example, a sensor component (e.g., a sensor component (480) of FIG. 5) may include a processor (e.g., a processor (491) of FIG. 5) that drives the first sensor (481) and the second sensor (482).
[0196] FIG. 7 is a diagram illustrating examples of ultrasonic sensors that generate lamb waves according to embodiments of the present disclosure.
[0197] Referring to FIGS. 6 and 7, according to one embodiment, a circular ultrasonic sensor (810) (e.g., a plurality of ultrasonic sensors (481, 482)) may be arranged on a side bezel (side bezel (218) of FIG. 2, side bezel (510) of FIG. 5) of an electronic device of the disclosure (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2, electronic device (400) of FIG. 4).
[0198] According to one embodiment, a side bezel (side bezel (218) of FIG. 2, side bezel (510) of FIG. 5) of an electronic device of the disclosure (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2, electronic device (400) of FIG. 4) may be provided with a rectangular ultrasonic sensor (820) (e.g., a plurality of ultrasonic sensors (481, 482)).
[0199] According to one embodiment, an inter-digital transducer (IDT) ultrasonic sensor (830) (e.g., a plurality of ultrasonic sensors (481, 482)) may be disposed on a side bezel (e.g., a side bezel (218) of FIG. 2, a side bezel (510) of FIG. 5) of an electronic device of the disclosure (e.g., an electronic device (101) of FIG. 1, an electronic device (200) of FIG. 2, an electronic device (400) of FIG. 4).
[0200] According to one embodiment, a wedge-shaped ultrasonic sensor (840) (e.g., a plurality of ultrasonic sensors (481, 482)) may be arranged on a side bezel (side bezel (218) of FIG. 2, side bezel (510) of FIG. 5) of an electronic device of the disclosure (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2, electronic device (400) of FIG. 4).
[0201] FIG. 8 is a diagram illustrating a method for sensing a touch using a plurality of ultrasonic sensors according to an embodiment of the present disclosure. FIG. 9 is a diagram illustrating a method for forming a plurality of touch keys (e.g., soft keys, button-less keys) by dividing a sensor area (e.g., touch area, touch plate, sensor plate) into a plurality of areas according to an embodiment of the present disclosure.
[0202] Referring to FIGS. 8 and 9, according to one embodiment, the first ultrasonic sensor (481) and the second ultrasonic sensor (482) may be positioned to contact the inner side (611) (e.g., inner surface) of the sensor area (620) (e.g., touch area, touch plate, sensor plate).
[0203] According to one embodiment, a sensor component (480) (e.g., a plurality of ultrasonic sensors) can transmit an ultrasonic wave (e.g., a lamb wave) to a side bezel (218) of a housing (210) (e.g., a side bezel structure, a side of the housing, a side member) and receive a reflection wave (e.g., a reflection signal) of the ultrasonic wave (e.g., a lamb wave). For example, a processor (e.g., a processor (120) of FIG. 1, a processor (420) of FIG. 4) can sense a touch of a user's finger based on the received reflection wave (e.g., a reflection signal). For example, the processor (120, 420) can determine at least one of a touch presence, a touch location, a touch length, a touch intensity, a single touch, and a multi-touch based on the received reflection wave (e.g., a reflection signal).
[0204] According to one embodiment, the first ultrasonic sensor (481) and the second ultrasonic sensor (482) can generate ultrasonic waves (e.g., lamb waves) of different frequencies (e.g., center frequencies).
[0205] For example, the first ultrasonic sensor (481) can generate a first ultrasonic wave (e.g., a first lamb wave) of a first frequency (e.g., a first center frequency, low frequency).
[0206] For example, the second ultrasonic sensor (482) can generate a second ultrasonic wave (e.g., a second lamb wave) of a second frequency (e.g., a second center frequency, high frequency) higher than the first frequency (e.g., a first center frequency, low frequency).
[0207] For example, the first ultrasonic sensor (481) can generate a first ultrasonic wave (e.g., a first lamb wave) of a first frequency (e.g., a first center frequency, low frequency), and the second ultrasonic sensor (482) can generate a second ultrasonic wave (e.g., a second lamb wave) of a second frequency (e.g., a second center frequency, high frequency), thereby eliminating interference between them (e.g., substantially eliminating or reducing interference between them).
[0208] According to one embodiment, the first ultrasonic wave (e.g., first Pan wave) of the first frequency generated from the first ultrasonic sensor (481) and the second ultrasonic wave (e.g., second Pan wave) of the second frequency generated from the second ultrasonic sensor (482) have different frequencies and thus have different speeds.
[0209] For example, the first ultrasonic sensor (481) may generate a first ultrasonic wave (e.g., a first Pan wave) having a center frequency of about 800 kHz, and the first ultrasonic wave (e.g., a first Pan wave) may be transmitted to an aluminum plate having a thickness of about 1 mm. In this case, the first ultrasonic wave (e.g., a first Pan wave) may move in the sensor area (620) at a first speed (e.g., a speed of about 2,180 m / s). For example, when a user's finger (710) touches an outer surface (612) of the sensor area (620) (e.g., an outer surface of a side bezel), a first reflected wave (e.g., a first reflected signal) of the first ultrasonic wave (e.g., a first Pan wave) may also move in the sensor area (620) at a first speed (e.g., a speed of about 2,180 m / s). The first ultrasonic sensor (481) can transmit a first ultrasonic wave (e.g., a first plate wave) and then receive a first reflected wave (e.g., a reflected signal).
[0210] For example, the second ultrasonic sensor (482) may generate a second ultrasonic wave (e.g., a second Pan wave) having a center frequency of about 1.4 MHz, and the second ultrasonic wave (e.g., a second Pan wave) may be transmitted to an aluminum plate having a thickness of about 1 mm. In this case, the second ultrasonic wave (e.g., a second Pan wave) may move in the sensor area (620) at a second speed (e.g., a speed of about 2,500 m / s). For example, when a user's finger (710) touches an outer surface (612) of the sensor area (620) (e.g., an outer surface of a side bezel), a second reflected wave (e.g., a second reflected signal) of the second ultrasonic wave (e.g., a second Pan wave) may also move in the sensor area (620) at a second speed (e.g., a speed of 2,500 m / s). The second ultrasonic sensor (482) can transmit a second ultrasonic wave (e.g., a second plate wave) and then receive a second reflected wave (e.g., a reflected signal).
[0211] For example, since the first frequency of the first ultrasonic wave and the first reflected wave (e.g., the first reflected wave) and the second frequency of the second ultrasonic wave and the second reflected wave (e.g., the second reflected wave) are different, the first ultrasonic sensor (481) and the second ultrasonic sensor (482) can distinguish between the first reflected wave (e.g., the first reflected signal) and the second reflected wave (e.g., the second reflected signal) that are received.
[0212] For example, since the first speed of the first ultrasonic wave and the first reflected wave (e.g., the first reflected wave) and the second speed of the second ultrasonic wave and the second reflected wave (e.g., the second reflected wave) are different, the processor (e.g., the processor (120) of FIG. 1, the processor (420) of FIG. 4) can calculate a mutually complementary distance between the first ultrasonic sensor (481) and the second ultrasonic sensor (482).
[0213] According to one embodiment, the sensor area (620) (e.g., touch area, touch plate, sensor plate) may be divided into a plurality of areas, and the plurality of areas may be operated by a plurality of touch keys (910, 920) (e.g., a plurality of side keys, a plurality of touch keys, a plurality of soft keys) (e.g., a plurality of touch keys (217) of FIG. 2, a soft key, a button-less key).
[0214] According to one embodiment, the plurality of touch keys (910, 920) (e.g., a plurality of side keys, a plurality of touch keys, a plurality of soft keys) may include a first touch key (910) for performing a first action (e.g., an action according to a long button touch), and a second touch key (920) for performing a second action (e.g., an action according to a short button touch).
[0215] For example, a first touch key (910) for performing a first action (e.g., an action according to a long button touch) may be used as a touch key (side key, soft key, buttonless key) for performing a press action, a release action, a long press action, or a single press action.
[0216] For example, a second touch key (920) for performing a second action (e.g., an action according to a short button touch) may be used as a touch key (side key, soft key, buttonless key) for performing a press action, a release action, a short press action, or a double press action.
[0217] For example, a first touch key (910) for performing a first action (e.g., an action according to a long button touch) may be divided into an up area, and a second touch key (920) for performing a second action (e.g., an action according to a short button touch) may be divided into a down area, thereby performing the actions of the touch keys (side keys, soft keys, buttonless keys).
[0218] For example, when a touch starts from a first touch key (910) and moves to a second touch key (920), a first swipe can be recognized and the action of the first swipe can be performed.
[0219] For example, when a touch starts from the second touch key (920) and moves to the first touch key (910), a second swipe can be recognized and the second swipe action can be performed.
[0220] For example, the electronic device (200, 400) may allow the user to customize multiple touch keys (side keys, soft keys, buttonless keys) to desired locations or actions.
[0221] Without being limited thereto, the plurality of touch keys (910, 920) (e.g., the plurality of side keys, the plurality of touch keys, the plurality of soft keys) may include three or more touch keys. For example, the plurality of touch keys may include a first touch key for performing a first action (e.g., a home button action), a second touch key for performing a second action (e.g., a volume down action), and a third touch key for performing a third action (e.g., a volume up action).
[0222] Fig. 10 is a drawing (1000) showing modes applied to a plurality of ultrasonic sensors. Fig. 10 shows a dispersion curve of ultrasonic waves (e.g., lamb waves) in an aluminum plate having a thickness of about 1 mm. In Fig. 10, the y-axis (e.g., vertical axis) represents the phase velocity of ultrasonic waves, and the x-axis (e.g., horizontal axis) can represent the frequency [MHz] of ultrasonic waves and the thickness of the plate through which ultrasonic waves are transmitted and propagated.
[0223] Referring to FIG. 10, an electronic device according to an embodiment of the present disclosure (e.g., an electronic device (101) of FIG. 1, an electronic device (200) of FIG. 2, an electronic device (400) of FIG. 4) can select a mode of an ultrasonic sensor (e.g., a sensor component (480) of FIGS. 5, 6, and 8 (e.g., a plurality of ultrasonic sensors)) and operate the sensor component (480) (e.g., a plurality of ultrasonic sensors).
[0224] For example, ultrasonic waves (e.g., lamb waves) generated from a sensor component (480) (e.g., a plurality of ultrasonic sensors) travel in various modes (e.g., A0 to A3 modes, S0 to S3 modes) and have dispersion characteristics. The frequency of ultrasonic waves (e.g., lamb waves) generated from a sensor component (480) (e.g., a plurality of ultrasonic sensors) and the material and thickness of a medium (e.g., a side bezel (218) of FIG. 2, a side bezel (510) of FIGS. 5 and 6) through which ultrasonic waves (e.g., lamb waves) travel may vary in the speed at which ultrasonic waves (e.g., lamb waves) travel.
[0225] For example, an electronic device (101, 200, 400) according to an embodiment of the disclosure may use the A0 mode (1010) most suitable for a touch sensing operation using a sensor component (480) (e.g., multiple ultrasonic sensors) among various modes (e.g., A0 to A3 modes, S0 to S3 modes). A0 mode (1010) may have the greatest out-of-displacement characteristic when an ultrasonic wave (e.g., a lamb wave) moves through the side bezel (218, 510). Since the material and thickness of the side bezel (218, 510) are fixed, when the frequency of the ultrasonic wave (e.g., a lamb wave) is determined, the speed of each mode can be determined. At this time, the first frequency (e.g., the first center frequency) of the first ultrasonic wave (e.g., the first Lamb wave) generated from the first ultrasonic sensor (481) and the second frequency (e.g., the second center frequency) of the second ultrasonic wave (e.g., the second Lamb wave) generated from the second ultrasonic sensor (482) may be determined according to the material and thickness of the side bezel (218, 510) and the length of the sensor area (e.g., the sensor area (620) of FIGS. 6 and 8).
[0226] FIG. 11 is a drawing (1100) showing data of ultrasonic waves (e.g., lamb waves) that can be obtained when a user's finger touches a side bezel according to an embodiment of the present disclosure.
[0227] Referring to FIG. 11, an electronic device according to an embodiment of the disclosure (e.g., an electronic device (101) of FIG. 1, an electronic device (200) of FIG. 2, an electronic device (400) of FIG. 4) may acquire data of ultrasonic waves (e.g., lamb waves) using an ultrasonic sensor (e.g., a sensor component (480) of FIG. 6 and FIG. 8 (e.g., a plurality of ultrasonic sensors)) when a user's finger (710) touches a touch area (e.g., a sensor area (620) of FIG. 6 and FIG. 8) of a side bezel (1110) (e.g., a side bezel (218) of FIG. 2, a side bezel (510) of FIG. 5 and FIG. 6).
[0228] According to one embodiment, a first ultrasonic sensor (e.g., the first ultrasonic sensor (481) of FIGS. 6 and 8) may apply a first ultrasonic wave (e.g., a first lamb wave) of a first frequency to the side bezel (1110). The first ultrasonic sensor (481) may receive a first reflected wave (e.g., a first reflected signal) according to the first ultrasonic wave (e.g., the first lamb wave). For example, the first ultrasonic sensor (481) may transmit a first ultrasonic wave (e.g., a first lamb wave) of a first frequency (e.g., a center frequency of about 800 kHz, low frequency) and receive a first reflected wave (e.g., a first reflected signal) of a first frequency (e.g., a center frequency of about 800 kHz, low frequency). The first reflected wave (e.g., the first reflected signal) may be generated by a difference in contact impedance due to a touch of a finger. Additionally, stress may be generated on the plate to which finger pressure is applied, and the speed of the first lamb wave may be changed by the stress on the plate, thereby generating a first reflected wave (e.g., a first reflected signal). This first reflected wave (e.g., a first reflected signal) may be received by the first ultrasonic sensor (481).
[0229] For example, the first ultrasonic sensor (481) can receive a second transmission wave (e.g., a second transmission signal) according to a second ultrasonic wave (e.g., a second Lamb wave) having a center frequency (high frequency) of about 1.4 MHz transmitted from the second ultrasonic sensor (482). When a finger is touched, the second ultrasonic wave (e.g., a second Lamb wave) transmitted from the second ultrasonic sensor (482) is attenuated, but the second transmission wave (e.g., a second transmission signal) that has passed through the portion touched by the finger can be received by the first ultrasonic sensor (481). A second reflection wave (e.g., a second reflection signal) can be generated by a difference in contact impedance due to the touch of the finger. In addition, stress is generated on the plate to which the pressure of the finger is applied, and the speed of the second Lamb wave (lamb wave) changes due to the stress on the plate, and a second reflection wave (e.g., a second reflection signal) can be generated. This second reflected wave (e.g., second reflected signal) can be received by the second ultrasonic sensor (482).
[0230] According to one embodiment, the second ultrasonic sensor (e.g., the second ultrasonic sensor (482) of FIGS. 6 and 8) may apply a second ultrasonic wave (e.g., a second lamb wave) of a second frequency different from the first frequency to the side bezel (1110). The second ultrasonic sensor (482) may receive a second reflected wave (e.g., a second reflected signal) according to the second ultrasonic wave (e.g., the second Lamb wave). For example, the second ultrasonic sensor (482) may transmit a second ultrasonic wave (e.g., a second Lamb wave) of a second frequency (e.g., a center frequency of about 1.4 MHz, high frequency) and receive a second reflected wave (e.g., a second reflected signal) of a second frequency (e.g., a center frequency of about 1.4 MHz, high frequency). For example, the second ultrasonic sensor (482) can receive a first transmission wave (e.g., a first transmission signal) according to a first ultrasonic wave (e.g., a first Pan wave) having a center frequency (low frequency) of about 800 kHz transmitted from the first ultrasonic sensor (481). When a finger is touched, the first ultrasonic wave (e.g., a first Pan wave) transmitted from the first ultrasonic sensor (481) is attenuated, but the first transmission wave (e.g., a first transmission signal) that has passed through the portion touched by the finger can be received by the second ultrasonic sensor (482).
[0231] For example, although there is an attenuation effect of the transmission signal due to the energy transmitted by the finger (710), the presence or absence of a touch can be determined using the reflected wave (e.g., reflected signal) of ultrasonic waves (e.g., Pan waves). The electronic device (101, 200, 400) can detect a change due to the touch of the finger (710) based on the first reflected wave (e.g., first reflected signal) and the second reflected wave (e.g., second reflected signal) received by the first ultrasonic sensor (481) and the second ultrasonic sensor (482). The first ultrasonic sensor (481) generates a first ultrasonic wave (e.g., a first Pan wave) of a first frequency (e.g., a first center frequency), and the second ultrasonic sensor (482) generates a second ultrasonic wave (e.g., a second Pan wave) of a second frequency (e.g., a second center frequency), so that the presence or absence of a touch can be determined based on the first reflected wave (e.g., a first reflected signal) and the second reflected wave (e.g., a second reflected signal).
[0232] The side bezel (1110) of the electronic device (101, 200, 400) (e.g., the side bezel (218) of FIG. 2, the side bezel (510) of FIGS. 5 and 6) has a bar shape, so that the side bezel (1110) can be converted into a one-dimensional axis. A first ultrasonic sensor (481) and a second ultrasonic sensor (482) may be arranged at both ends of the sensor area (620) of the side bezel (1110) (e.g., a first portion (first side) and a second portion (second side) of the sensor area). For example, the first ultrasonic sensor (481) may be arranged at the first portion (e.g., the first portion (621) of FIG. 6) of the sensor area (620). For example, a second ultrasonic sensor (482) may be placed in a second portion of the sensor area (620) (e.g., the second portion (622) of FIG. 6). At this time, the first ultrasonic sensor (481) and the second ultrasonic sensor (482) may operate in a manner of generating ultrasonic waves in the form of pulse-echo (e.g., Pan waves).
[0233] FIG. 12 and FIG. 13 are diagrams illustrating distinguishing between a normal touch and a strong touch (e.g., force touch) based on reflection signals of ultrasonic signals according to an embodiment of the present disclosure.
[0234] In Fig. 12, in an embodiment of the present disclosure, it is illustrated (1200) that the signal size (e.g., signal intensity, signal strength) of a reflected wave (e.g., reflected signal) changes depending on the pressing pressure of a finger (710). In Fig. 13, in an embodiment of the present disclosure, it is illustrated (1300) that a normal touch (e.g., general touch) and a strong touch (e.g., force touch) are determined based on the signal size (e.g., signal intensity, signal strength) of a reflected wave (e.g., reflected signal).
[0235] Referring to FIGS. 12 and 13, the signal size (e.g., signal intensity, signal strength) of a reflected wave (e.g., reflected signal) may vary depending on the pressing pressure of a finger (710) (1200). An electronic device according to an embodiment of the disclosure (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2, electronic device (400) of FIG. 4) may determine whether a touch of a touch area (e.g., sensor area (620) of FIGS. 6 and 8) of a side bezel (1110) is a normal touch (e.g., general touch) or a strong touch (e.g., force touch) based on the measurement data value (1310) (e.g., reflected wave size, signal intensity, signal strength) of the reflected wave (e.g., reflected signal) (1300).
[0236] For example, the electronic device (101, 200, 400) can determine a touch of a touch area of a side bezel (1110) (e.g., sensor area (620) of FIGS. 6 and 8) as a normal touch (e.g., a general touch) when the measurement data value (1310) (e.g., reflected wave size, signal strength, signal intensity) of a reflected wave (e.g., reflected signal) reaches a normal touch reference value (1320) (e.g., above the normal touch reference value (1320)) and is lower than a strong touch reference value (1330).
[0237] For example, when the measurement data value (1310) (e.g., reflected wave size, signal strength, signal intensity) of a reflected wave (e.g., reflected signal) exceeds the normal touch reference value (1320) and reaches the strong touch reference value (1330) (e.g., higher than the strong touch reference value (1330)), the electronic device (101, 200, 400) may determine a touch in the touch area (e.g., sensor area (620) of FIGS. 6 and 8) of the side bezel (1110) as a strong touch (e.g., force touch).
[0238] According to one embodiment, the electronic device (101, 200, 400) of the disclosure provides a button-less type touch key (side key, soft key, button-less key) and can prevent abnormal touch due to unintended contact by the user.
[0239] For example, if the measurement data value (1310) (e.g., reflected wave size, signal strength, signal intensity) of the reflected wave (e.g., reflected signal) of the electronic device (101, 200, 400) does not reach the normal touch reference value (1320) (e.g., lower than the normal touch reference value (1320)), the electronic device (101, 200, 400) may determine that the touch is abnormal due to an unintended contact by the user.
[0240] The electronic device (101, 200, 400) of the disclosure may determine that no touch has occurred in the touch area of the side bezel (1110) (e.g., sensor area (620) of FIGS. 6 and 8) if the measurement data value (1310) (e.g., reflected wave size, signal strength, signal intensity) of the reflected wave (e.g., reflected signal) does not reach the normal touch reference value (1320) (e.g., less than the normal touch reference value (1320)).
[0241] Among ultrasound waves, Pan waves have low attenuation characteristics, so they can be effective in determining touch even when traveling long distances.
[0242] When registering (e.g., customizing) a touch key (side key, soft key, button-less key), the electronic device (101, 200, 400) can obtain a background signal (e.g., reference signal, background signal) of each of the first ultrasonic sensor (481) and the second ultrasonic sensor (482).
[0243] The presence or absence of a touch, a normal touch (e.g., a general touch), and a strong touch (e.g., a force touch) can be determined by reflecting the background signal (e.g., a reference signal, a background signal) of each of the first ultrasonic sensor (481) and the second ultrasonic sensor (482).
[0244] FIGS. 14 and 15 are diagrams illustrating determining a position where a user's finger touches a side bezel based on the time at which a reflected wave (e.g., a reflected signal) is received (e.g., arrives) by an ultrasonic sensor according to an embodiment of the present disclosure.
[0245] Referring to FIGS. 14 and 15, a finger (710) can be touched (1400) at a distance (e.g., location) of about 2 cm from a first ultrasonic sensor (481) or a second ultrasonic sensor (482) on an aluminum plate having a thickness of about 1 mm. In this case, the electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2, and the electronic device (400) of FIG. 4) can determine the presence or absence of a touch and the touch position based on the time (1500) at which a reflected wave (1510) (e.g., a reflected signal) of an ultrasonic wave (e.g., a Pan wave) having a center frequency of about 1.4 MHz is received (e.g., arrives) at the first ultrasonic sensor (481) or the second ultrasonic sensor (482). For example, a stainless steel plate or a titanium plate can be applied instead of an aluminum plate. When the strength is the same, a titanium plate can have a thinner thickness than an aluminum plate. When a titanium plate is applied, ultrasonic characteristics (e.g., speed) can be improved compared to an aluminum plate.
[0246] According to one embodiment, since the distance between the second ultrasonic sensor (482) and the finger (710) is about 2 cm, the total travel distance of the ultrasonic wave (e.g., Pan wave) may be about 4 cm. At this time, when the ultrasonic wave (e.g., Pan wave) moves in the sensor area (620) (e.g., the sensor area (620) of FIGS. 6 and 8) of the side bezel (e.g., the side bezel (510) of FIGS. 6 and 9) at a speed of about 2,500 m / s, the arrival time (e.g., reception time) of the reflected wave (e.g., reflection signal) received by the second ultrasonic sensor (482) may be about 16 us. The arrival time (e.g., reception time) of the reflected wave (e.g., reflection signal) received by the second ultrasonic sensor (482) may vary depending on the distance.
[0247] FIG. 16 is a drawing (1600) showing controlling pulse repetition frequency (PRF) depending on the presence or absence of touch according to an embodiment of the present disclosure.
[0248] Referring to FIGS. 14, 15 and 16, the arrival time (e.g., reception time) of the reflected wave (e.g., reflected signal) to the first ultrasonic sensor (481) or the second ultrasonic sensor (482) varies depending on the travel distance of the signal, thereby determining whether or not there is a touch.
[0249] According to one embodiment, an electronic device (e.g., an electronic device (101) of FIG. 1, an electronic device (200) of FIG. 2, an electronic device (400) of FIG. 4) can determine a location where a finger (e.g., a finger (710) of FIG. 14) has touched a sensor area (e.g., a sensor area (620) of FIGS. 6 and 8) of a side bezel (e.g., a side bezel (510) of FIGS. 6 and 9).
[0250] For example, a first ultrasonic sensor (481) can receive a first reflected wave (e.g., a first reflected signal). An electronic device (101, 200, 400) can subtract a first background signal (e.g., a first reference signal, a first background signal) of the first ultrasonic sensor (481) from the first reflected wave (e.g., a first reflected signal) received by the first ultrasonic sensor (481). A second ultrasonic sensor (482) can receive a second reflected wave (e.g., a second reflected signal). An electronic device (101, 200, 400) can subtract a second background signal (e.g., a second reference signal, a second background signal) of the second ultrasonic sensor (482) from the second reflected wave (e.g., a second reflected signal) received by the second ultrasonic sensor (482).
[0251] The electronic device (101, 200, 400) can obtain first signal data by subtracting a first background signal (e.g., a first reference signal, a first background signal) from a first reflected wave (e.g., a first reflected signal). The electronic device (101, 200, 400) can obtain second signal data by subtracting a second background signal (e.g., a second reference signal, a second background signal) from a second reflected wave (e.g., a second reflected signal). The electronic device (101, 200, 400) can determine a location where a finger (710) has touched a sensor area (620) of a side bezel (510) based on the first signal data and the second signal data.
[0252] For example, based on the reception times (e.g., arrival times) of the first reflected wave (e.g., first reflected signal) received by the first ultrasonic sensor (481) and the second reflected wave (e.g., second reflected signal) received by the second ultrasonic sensor (482), the position where a finger (e.g., finger (710) of FIG. 14) touches the sensor area (620) of the side bezel (510) can be determined.
[0253] According to one embodiment, an electronic device according to one embodiment of the disclosure (e.g., an electronic device (101) of FIG. 1, an electronic device (200) of FIG. 2, an electronic device (400) of FIG. 4) can control the operation of a first ultrasonic sensor (481) and a second ultrasonic sensor (482) depending on whether a touch is present.
[0254] According to one embodiment, the electronic device (101, 200, 400) can control the first ultrasonic sensor (481) and the second ultrasonic sensor (482) in a pulse repetition frequency (PRF) manner depending on whether there is a touch.
[0255] A high pulse repetition frequency (PRF) may indicate that the time interval between pulses is relatively short (e.g., narrow, short interval). A low pulse repetition frequency (PRF) may indicate that the time interval between pulses is relatively long (e.g., wide, long interval). A higher PRF allows for more frequent transmission and reception of signals, which allows for more precise touch sensing. Relatively, a higher PRF increases memory usage and power consumption, so it is necessary to adjust the PRF depending on the presence or absence of touch. For example, a higher PRF may enable faster response and higher accuracy in touch situation judgment. Sensing based on the time difference between the transmission (Tx) and reception (Rx) of ultrasonic waves may have a slight time error, but the error can be relatively reduced through data averaging by sampling more times during the same period.
[0256] For example, when the electronic device (101, 200, 400) is in a standby state (1610), the first ultrasonic sensor (481) and the second ultrasonic sensor (482) can be controlled to operate at a first pulse repetition frequency (e.g., low PRF, low frequency pulse repetition frequency).
[0257] For example, the electronic device (101, 200, 400) can control the first ultrasonic sensor (481) and the second ultrasonic sensor (482) to operate at a second pulse repetition frequency (e.g., high PRF, high frequency pulse repetition frequency) when a touch signal is detected (1620).
[0258] For example, the electronic device (101, 200, 400) may determine that there is no touch signal if no touch signal is detected for a certain period of time after detecting the touch signal (1630). If there is no touch signal, the electronic device (101, 200, 400) may control the first ultrasonic sensor (481) and the second ultrasonic sensor (482) to operate at a first pulse repetition frequency (e.g., low PRF, low-frequency pulse repetition frequency).
[0259] According to one embodiment, when the electronic device (101, 200, 400) is placed in a pocket, a fine touch may be detected. In this case, an error may occur in which a touch is recognized as a touch even though it is not a touch intended by the user. An operation to prevent a mistouch that may occur due to the electronic device (101, 200, 400) being placed in a pocket may be performed. For example, when the size of a signal received after transmission at a first pulse repetition frequency (e.g., low PRF, low-frequency pulse repetition frequency) is small or the signal does not reach a reference, it may be controlled to operate at a second pulse repetition frequency (e.g., high PRF, high-frequency pulse repetition frequency). At this time, a reference value for determining a touch signal in a standby state (1610) and a reference value for determining a touch signal in a touch signal detection state (1620) may be applied differently. In the standby state (1610), the reference value can be applied relatively loosely, and in the touch signal detection state (1620), the reference value can be applied relatively precisely. For example, the electronic device (101, 200, 400) can transmit and receive a signal (about 30 Hz) once every 33 ms in the standby state (1610), and when a touch signal is recognized, can transmit and receive a signal (about 120 Hz) once every 8.3 ms. Thereafter, when a touch signal is not detected for a certain period of time, the electronic device can transmit and receive a signal again once every 33 ms and operate in the standby state (1610).
[0260] According to one embodiment, the electronic device (101, 200, 400) can calculate the total time for which a touch signal is detected. Based on the total time for which the touch signal is detected, the electronic device (101, 200, 400) can determine whether the current touch is a short touch or a long touch.
[0261] For example, the electronic device (101, 200, 400) can set a reference time and perform a specified action (application execution, termination) when the time at which a touch signal is measured exceeds the reference time.
[0262] For example, the electronic device (101, 200, 400) can determine a normal touch (e.g., a normal touch) and a strong touch (e.g., a force touch), and can perform a specified action (running or terminating an application) depending on whether the currently recognized touch is a normal touch (e.g., a normal touch) or a strong touch (e.g., a force touch).
[0263] For example, the electronic device (101, 200, 400) can distinguish between a short touch with a normal touch (e.g., a regular touch) and a short touch with a strong touch (e.g., a force touch). The electronic device (101, 200, 400) can perform a specified action (application execution, termination) depending on whether the short touch with a normal touch (e.g., a regular touch) or a short touch with a strong touch (e.g., a force touch) is performed.
[0264] For example, the electronic device (101, 200, 400) can distinguish between a long touch with a normal touch (e.g., a regular touch) and a long touch with a strong touch (e.g., a force touch). The electronic device (101, 200, 400) can perform a specified action (application execution, termination) depending on whether the long touch with a normal touch (e.g., a regular touch) or a long touch with a strong touch (e.g., a force touch) is performed.
[0265] FIG. 17 is a drawing (1700) showing registering (e.g., customizing) a plurality of touch keys (e.g., side keys, soft keys, button-less keys) by distinguishing the sensor area of the side bezel according to an embodiment of the present disclosure.
[0266] Referring to FIG. 17, an electronic device according to an embodiment of the disclosure (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2, and the electronic device (400) of FIG. 4) can register (e.g., customize) a plurality of touch keys (e.g., side keys, soft keys, button-less keys) by dividing a sensor area (620) (e.g., the sensor area (620) of FIGS. 6 and 8) of a side bezel (e.g., the side bezel (510) of FIGS. 6 and 9) into a plurality of areas.
[0267] According to one embodiment, the electronic device (101, 200, 400) may divide the sensor area (620) into multiple areas based on a user's request to register (e.g., customize) a touch key (e.g., side key, soft key, buttonless key).
[0268] For example, the electronic device (101, 200, 400) can divide the sensor area (620) into a first sensor area, a second sensor area, and a third sensor area.
[0269] For example, the electronic device (101, 200, 400) can register (e.g., customize) a first touch key (1710) (e.g., a first side key, a first soft key, a first button-less key) so that the first sensor area can be used as a first touch key (1710) (e.g., a first side key, a first soft key, a first button-less key). For example, when a user's finger touches the first touch key (1710) (e.g., a first side key, a first soft key, a first button-less key), a first touch signal (1742) can be generated. The electronic device (101, 200, 400) can determine whether a touch is present by subtracting a background signal (1741) (e.g., a reference signal, a background signal) from the first touch signal (1742). The electronic device (101, 200, 400) can set a first time zone corresponding to the first touch key (1710) (e.g., the first side key, the first soft key, the first button-less key). If the first touch signal (1742) processed by the background signal (1741) (e.g., the reference signal, the background signal) corresponds to the first time zone, the electronic device (101, 200, 400) can determine that a touch has occurred on the first touch key (1710) (e.g., the first side key, the first soft key, the first button-less key). If a touch has occurred on the first touch key (1710) (e.g., the first side key, the first soft key, the first button-less key), the electronic device (101, 200, 400) can perform a designated action (e.g., a home button, application execution, termination) according to the first touch key (1710).
[0270] For example, the electronic device (101, 200, 400) can register (e.g., customize) a second touch key (1720) (e.g., a second side key, a second soft key, a second button-less key) so that the second sensor area can be used as a second touch key (1720) (e.g., a second side key, a second soft key, a second button-less key). For example, when a user's finger touches the second touch key (1720) (e.g., a second side key, a second soft key, a second button-less key), a second touch signal (1743) can be generated. The electronic device (101, 200, 400) can determine whether a touch is present by subtracting a background signal (1741) (e.g., a reference signal, a background signal) from the second touch signal (1743). The electronic device (101, 200, 400) can set a second time zone corresponding to the second touch key (1720) (e.g., second side key, second soft key, second button-less key). If the second touch signal (1743) processed by the background signal (1741) (e.g., reference signal, background signal) corresponds to the second time zone, the electronic device (101, 200, 400) can determine that a touch has occurred on the second touch key (1720) (e.g., second side key, second soft key, second button-less key). If a touch has occurred on the second touch key (1720) (e.g., second side key, second soft key, second button-less key), the electronic device (101, 200, 400) can perform a designated action (e.g., volume down, application execution, termination) according to the second touch key (1720).
[0271] For example, the electronic device (101, 200, 400) can register (e.g., customize) a third touch key (1730) (e.g., a third side key, a third soft key, a third button-less key) so that the third sensor area can be used as a third touch key (1730) (e.g., a third side key, a third soft key, a third button-less key). For example, when a user's finger touches the third touch key (1730) (e.g., a third side key, a third soft key, a third button-less key), a third touch signal (1744) can be generated. The electronic device (101, 200, 400) can determine whether a touch is made by subtracting a background signal (1741) (e.g., a reference signal, a background signal) from the third touch signal (1744). The electronic device (101, 200, 400) can set a third time zone corresponding to the third touch key (1730) (e.g., the third side key, the third soft key, the third button-less key). If the third touch signal (1744) processed by the background signal (1741) (e.g., the reference signal, the background signal) corresponds to the third time zone, the electronic device (101, 200, 400) can determine that a touch has occurred on the third touch key (1730) (e.g., the third side key, the third soft key, the third button-less key). If a touch has occurred on the third touch key (1730) (e.g., the third side key, the third soft key, the third button-less key), the electronic device (101, 200, 400) can perform a designated action (e.g., volume up, application launch, termination) according to the third touch key (1730).
[0272] FIG. 18 is a drawing (1800) showing obtaining a signal (e.g., a multi-touch signal) according to a multi-touch according to an embodiment of the present disclosure.
[0273] Referring to FIG. 18, an electronic device according to an embodiment of the disclosure (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2, electronic device (400) of FIG. 4) can determine a single touch and a multi-touch of a finger (711, 712) in a sensor area (620) (e.g., sensor area (620) of FIGS. 6 and 8) of a side bezel (e.g., side bezel (510) of FIGS. 6 and 9).
[0274] According to one embodiment, the electronic device (101, 200, 400) can determine a single touch and a multi-touch of a finger (711, 712) based on a first reflected wave (e.g., a first reflected signal) received by a first ultrasonic sensor (e.g., a first ultrasonic sensor (481) of FIG. 14, a first ultrasonic sensor (1910) of FIG. 19) and a second reflected wave (e.g., a second reflected signal) received by a second ultrasonic sensor (e.g., a second ultrasonic sensor (482) of FIG. 14, a second ultrasonic sensor (1920) of FIG. 19)).
[0275] For example, when one first reflected wave (e.g., first reflected signal) is received by a first ultrasonic sensor (481, 1910) and one second reflected wave (e.g., second reflected signal) is received by a second ultrasonic sensor (482, 1920), the electronic device (101, 200, 400) may determine a single touch. The electronic device (101, 200, 400) may determine the position of the single touch based on the reception times (e.g., arrival times) of one first reflected wave (e.g., first reflected signal) and one second reflected wave (e.g., second reflected signal).
[0276] For example, when a plurality of first reflected waves (e.g., first reflected signals) are received by a first ultrasonic sensor (481, 1910) and a plurality of second reflected waves (e.g., second reflected signals) are received by a second ultrasonic sensor (482, 1920), the electronic device (101, 200, 400) may determine multi-touch. The reception times (e.g., arrival times) of the reflected signals (1810, 1820) may vary depending on the distance (d1) of the first position touched by the first finger (711) and the distance (d2) of the second position touched by the second finger (712). The electronic device (101, 200, 400) can determine the positions of the multi-touch based on the reception time (e.g., arrival time) of each of the plurality of first reflected waves (e.g., first reflected signals) and the reception time (e.g., arrival time) of each of the plurality of second reflected waves (e.g., second reflected signals).
[0277] According to one embodiment, the electronic device (101, 200, 400) can determine whether the fingers (711, 712) are moving away from or closer to each other based on the positions of each of the fingers (e.g., the fingers (711, 712) of FIG. 18) according to multi-touch. The electronic device (101, 200, 400) can recognize the swipe motion of the fingers or the pinch motion of the fingers based on the moving away from or closer to each other, and perform an operation accordingly.
[0278] FIG. 19 is a diagram showing that interference occurs between signals when the frequencies (e.g., center frequencies) of a plurality of ultrasonic sensors according to an embodiment of the present disclosure are the same.
[0279] Referring to FIG. 19, when the frequencies (e.g., center frequencies) of the first ultrasonic wave (e.g., first Pan wave) generated by the first ultrasonic sensor (1910) (e.g., the first ultrasonic sensor (481) of FIG. 14) and the second ultrasonic wave (e.g., second Pan wave) generated by the second ultrasonic sensor (1920) (e.g., the second Pan wave) of FIG. 14) are substantially the same, interference between the signals may occur. For example, when the frequencies (e.g., center frequencies) of the first ultrasonic wave (e.g., first Pan wave) and the second ultrasonic sensor (482) are substantially the same, when a finger touches the center (1920, center) of the sensor area (e.g., sensor area (620) of FIG. 18), the reception time (e.g., arrival time) of the first reflected wave and the reception time (e.g., arrival time) of the second reflected wave may become substantially the same. Since both the reverberation signal of the first reflected wave and the reverberation signal of the second reflected wave become substantially the same, noise may be generated between each other. If the reception times (e.g., arrival times) of the first reflected wave and the reception times (e.g., arrival times) of the second reflected wave are substantially the same, it may be impossible to determine whether a touch exists or not and the location of the touch.
[0280] FIG. 20 is a diagram illustrating that interference between signals is prevented (e.g., interference is substantially prevented or interference is reduced) when the frequencies (e.g., center frequencies) of a plurality of ultrasonic sensors according to an embodiment of the present disclosure are different.
[0281] Referring to FIG. 20, a first ultrasonic sensor (2010) (e.g., the first ultrasonic sensor (481) of FIG. 14) can generate a first ultrasonic wave (e.g., a first lamb wave) of a first frequency (e.g., a first center frequency, low frequency). A second ultrasonic sensor (2020) (e.g., the second ultrasonic sensor (482) of FIG. 14) can generate a second ultrasonic wave (e.g., a second lamb wave) of a second frequency (e.g., a second center frequency, high frequency) higher than the first frequency (e.g., the first center frequency, low frequency). For example, the first ultrasonic sensor (481) generates a first ultrasonic wave (e.g., a first lamb wave) of a first frequency (e.g., a first center frequency, low frequency), and the second ultrasonic sensor (482) generates a second ultrasonic wave (e.g., a second lamb wave) of a second frequency (e.g., a second center frequency, high frequency). By generating, interference between each other can be eliminated (e.g., substantially eliminated, or interference between each other can be reduced). For example, when the frequencies (e.g., center frequencies) of the first ultrasonic wave (e.g., first plate wave) and the second ultrasonic sensor (482) are different, when a finger touches the center of the sensor area (e.g., sensor area (620) of FIG. 18), the reception time (e.g., arrival time) of the first reflected wave and the reception time (e.g., arrival time) of the second reflected wave may be different. In addition, the influence of the noise of the first reflected wave and the noise of the second reflected wave is reduced. Since the reception times (e.g., arrival time) of the first reflected wave and the reception times (e.g., arrival time) of the second reflected wave are different, the presence or absence of a touch and the touch location can be determined using this.
[0282] FIG. 21 is a drawing (2100) illustrating a method for obtaining background signals (e.g., background signals) of a plurality of ultrasonic sensors according to an embodiment of the present disclosure.
[0283] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.
[0284] Referring to FIG. 21, an electronic device according to an embodiment of the disclosure (e.g., an electronic device (101) of FIG. 1, an electronic device (200) of FIG. 2, an electronic device (400) of FIG. 4) can obtain background signals (e.g., background signals) of a plurality of ultrasonic sensors.
[0285] For example, a processor (e.g., processor (120) of FIG. 1, processor (420) of FIG. 4) of an electronic device (101, 200, 400) can operate a plurality of ultrasonic sensors (e.g., sensor components (480) of FIGS. 6 and 8 (e.g., a plurality of ultrasonic sensors)) (e.g., first ultrasonic sensor (2010) and second ultrasonic sensor (2020) of FIG. 20)) to obtain background signals (e.g., background signals) of the plurality of ultrasonic sensors.
[0286] For example, an operation of acquiring background signals (e.g., background signals) of multiple ultrasonic sensors can be performed without a finger touching a sensor area (e.g., sensor area (620) of FIGS. 6 and 8) of a side bezel (e.g., side bezel (510) of FIGS. 6 and 9).
[0287] In operation 2110, in a state where a finger does not touch a sensor area (e.g., a sensor area (620) of FIGS. 6 and 8) of a side bezel (e.g., a side bezel (510) of FIGS. 6 and 9), according to one embodiment, the electronic device (101, 200, 400) may operate a plurality of ultrasonic sensors (e.g., a first ultrasonic sensor (2010) and a second ultrasonic sensor (2020)).
[0288] For example, when a finger does not touch the sensor area (e.g., the sensor area (620) of FIGS. 6 and 8) of the side bezel (e.g., the side bezel (510) of FIGS. 6 and 9), the processor (120, 420) can operate a plurality of ultrasonic sensors (e.g., the first ultrasonic sensor (2010) and the second ultrasonic sensor (2020)).
[0289] According to one embodiment, in operation 2120, the electronic device (101, 200, 400) may operate a first ultrasonic sensor among the plurality of ultrasonic sensors. For example, the electronic device (101, 200, 400) may generate an ultrasonic wave from the first ultrasonic sensor among the plurality of ultrasonic sensors, and then measure a first reflected wave (e.g., a reflected signal) from the first ultrasonic sensor.
[0290] For example, the processor (120, 420) may operate a first ultrasonic sensor among a plurality of ultrasonic sensors. For example, the processor (120, 420) may generate an ultrasonic wave from a first ultrasonic sensor among a plurality of ultrasonic sensors, and then measure a first reflected wave (e.g., a reflected signal) from the first ultrasonic sensor.
[0291] According to one embodiment, in operation 2130, the electronic device (101, 200, 400) may operate an Nth ultrasonic sensor among the plurality of ultrasonic sensors. For example, the electronic device (101, 200, 400) may generate an ultrasonic wave from the Nth ultrasonic sensor among the plurality of ultrasonic sensors, and then measure an Nth reflected wave (e.g., a reflected signal) from the Nth ultrasonic sensor.
[0292] For example, the processor (120, 420) may operate the Nth ultrasonic sensor among the plurality of ultrasonic sensors. For example, the processor (120, 420) may generate an ultrasonic wave from the Nth ultrasonic sensor among the plurality of ultrasonic sensors, and then measure the Nth reflected wave (e.g., reflected signal) from the Nth ultrasonic sensor.
[0293] For example, actions 2120 and 2130 can be performed simultaneously (or sequentially).
[0294] For example, between actions 2120 and 2130, the operations of the 2nd ultrasonic sensor to the N-1th ultrasonic sensor may be performed simultaneously (or sequentially).
[0295] According to one embodiment, a first ultrasonic sensor (e.g., a first ultrasonic sensor (481) of FIG. 5) can receive a first reflected wave according to a first Plate wave of a first frequency. The first ultrasonic sensor (481) can receive a second transmitted wave according to a second Plate wave of a second frequency. A second ultrasonic sensor (e.g., a second ultrasonic sensor (482) of FIG. 5) can receive a second reflected wave according to a second Plate wave of a second frequency. The second ultrasonic sensor (482) can receive a first transmitted wave according to the first Plate wave of the first frequency.
[0296] For example, when the second Pan wave is output from the second ultrasonic sensor (482), the time (e.g., signal arrival time, signal reception time) at which the second transmission wave according to the second Pan wave is received by the first ultrasonic sensor (481) can be known. The position at which the finger is touched can be sensed using the first reflected wave and the second transmitted wave received by the first ultrasonic sensor (481). For example, when the first Pan wave is output from the first ultrasonic sensor (481), the time (e.g., signal arrival time, signal reception time) at which the first transmission wave according to the first Pan wave is received by the second ultrasonic sensor (482) can be known. The position at which the finger is touched can be sensed using the second reflected wave and the first transmitted wave received by the second ultrasonic sensor (482). For example, the position where a finger is touched can be sensed using the first reflected wave and the second transmitted wave received from the first ultrasonic sensor (481) and the second reflected wave and the first transmitted wave received from the second ultrasonic sensor (482). As the signals received by the first ultrasonic sensor (481) and the signals received by the second ultrasonic sensor (482) increase, the precision of sensing can be increased.
[0297] According to one embodiment, in operation 2140, the electronic device (101, 200, 400) may obtain background signals (e.g., background signals) of a plurality of ultrasonic sensors based on reflected waves (e.g., reflected signals) measured in a state in which a finger does not touch a sensor area (e.g., sensor area (620) of FIGS. 6 and 8) of a side bezel (e.g., side bezel (510) of FIGS. 6 and 9). The electronic device (101, 200, 400) may store the obtained background signals (e.g., background signals) in a memory (e.g., memory (130) of FIG. 1, memory (433) of FIG. 4).
[0298] For example, the processor (120, 420) may obtain background signals (e.g., background signals) of a plurality of ultrasonic sensors based on reflected waves (e.g., reflected signals) measured in a state where a finger does not touch a sensor area (e.g., sensor area (620) of FIGS. 6 and 8) of a side bezel (e.g., side bezel (510) of FIGS. 6 and 9). The processor (120, 420) may store the obtained background signals (e.g., background signals) in a memory (e.g., memory (130) of FIG. 1, memory (433) of FIG. 4).
[0299] The memory (130, 430) of the electronic device (101, 200, 400) according to the embodiment of the disclosure may include instructions for performing the operations of FIG. 21. At least some of the operations of FIG. 21 may be omitted. At least one of the operations of FIG. 21 may be performed simultaneously (e.g., in parallel).
[0300] FIG. 22 is a diagram illustrating a method of obtaining a touch signal using a plurality of ultrasonic sensors according to an embodiment of the present disclosure.
[0301] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.
[0302] Referring to FIG. 22, an electronic device according to an embodiment of the disclosure (e.g., an electronic device (101) of FIG. 1, an electronic device (200) of FIG. 2, an electronic device (400) of FIG. 4) can operate a plurality of ultrasonic sensors to obtain a touch signal and detect a touch based on the obtained touch signal.
[0303] For example, a processor (e.g., processor (120) of FIG. 1, processor (420) of FIG. 4) of an electronic device (101, 200, 400) can operate a plurality of ultrasonic sensors to obtain a touch signal and detect a touch based on the obtained touch signal.
[0304] In operation 2210, according to one embodiment, the electronic device (101, 200, 400) may operate multiple ultrasonic sensors. For example, the processor (120, 420) may operate multiple ultrasonic sensors.
[0305] In operation 2220, according to one embodiment, the electronic device (101, 200, 400) may operate a first ultrasonic sensor among a plurality of ultrasonic sensors. The first ultrasonic sensor may receive a first reflected wave (e.g., a first reflected signal) according to the first ultrasonic sensor. The electronic device (101, 200, 400) may measure the received first reflected wave (e.g., the first reflected signal).
[0306] For example, the processor (120, 420) may operate a first ultrasonic sensor among a plurality of ultrasonic sensors. The first ultrasonic sensor may receive a first reflected wave (e.g., a first reflected signal) according to the first ultrasonic sensor. The processor (120, 420) may measure the received first reflected wave (e.g., a first reflected signal).
[0307] In operation 2230, according to one embodiment, the electronic device (101, 200, 400) may operate an Nth ultrasonic sensor among a plurality of ultrasonic sensors. The Nth ultrasonic sensor may receive an Nth reflected wave (e.g., an Nth reflected signal) according to the Nth ultrasonic sensor. The electronic device (101, 200, 400) may measure the received Nth reflected wave (e.g., an Nth reflected signal).
[0308] For example, the processor (120, 420) may operate an Nth ultrasonic sensor among a plurality of ultrasonic sensors. The Nth ultrasonic sensor may receive an Nth reflected wave (e.g., an Nth reflected signal) according to the Nth ultrasonic sensor. The processor (120, 420) may measure the received Nth reflected wave (e.g., an Nth reflected signal).
[0309] For example, actions 2220 and 2230 can be performed simultaneously (or sequentially).
[0310] For example, between actions 2220 and 2230, the actions of the 2nd ultrasonic sensor to the N-1th ultrasonic sensor may be performed simultaneously (or sequentially).
[0311] In operation 2240, according to one embodiment, the electronic device (101, 200, 400) can perform calibration (e.g., subtracting the background signal from the measured reflected wave) with a background signal (e.g., a background signal) that matches the measured reflected wave (e.g., a reflected signal). The electronic device (101, 200, 400) can obtain signal data (e.g., a measured data value) by performing calibration (e.g., subtracting the background signal from the measured reflected wave) with a background signal (e.g., a background signal) that matches the measured reflected wave (e.g., a reflected signal).
[0312] For example, the processor (120, 420) can perform calibration (e.g., subtracting the background signal from the measured reflected wave) with a background signal (e.g., background signal) that matches the measured reflected wave (e.g., reflection signal). The processor (120, 420) can obtain signal data (e.g., measurement data values) by performing calibration (e.g., subtracting the background signal from the measured reflected wave) with a background signal (e.g., background signal) that matches the measured reflected wave (e.g., reflection signal).
[0313] In operation 2250, according to one embodiment, the electronic device (101, 200, 400) can compare signal data (e.g., measurement data value) with a preset reference value to determine whether a signal greater than a specified size has been detected.
[0314] For example, the processor (120, 420) can compare signal data (e.g., measurement data value) with a preset reference value to determine whether a signal greater than a specified size has been detected.
[0315] In operation 2260, according to one embodiment, when a signal greater than or equal to a specified size is detected as a result of comparing signal data (e.g., a measured data value) with a preset reference value, the electronic device (101, 200, 400) may determine that a touch has occurred in a sensor area (e.g., a sensor area (620) of FIGS. 6 and 8) of a side bezel (e.g., a side bezel (510) of FIGS. 6 and 9). For example, when a signal greater than or equal to a specified size is not detected as a result of comparing signal data (e.g., a measured data value) with a preset reference value, the electronic device (101, 200, 400) may determine that a touch has not occurred.
[0316] For example, if a signal greater than or equal to a specified size is detected as a result of comparing signal data (e.g., a measured data value) with a preset reference value, the processor (120, 420) may determine that a touch has occurred in the sensor area (620) of the side bezel (510). For example, if a signal greater than or equal to a specified size is not detected as a result of comparing signal data (e.g., a measured data value) with a preset reference value, the processor (120, 420) may determine that a touch has not occurred.
[0317] The memory (130, 433) of the electronic device (101, 200, 400) according to the embodiment of the disclosure may include instructions for performing the operations of FIG. 22. At least some of the operations of FIG. 22 may be omitted. At least one of the operations of FIG. 22 may be performed simultaneously (e.g., in parallel).
[0318] FIG. 23 is a diagram illustrating a method of registering (e.g., customizing) a plurality of touch keys (e.g., side keys, soft keys, button-less keys) by distinguishing a sensor area of a side bezel according to an embodiment of the present disclosure.
[0319] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.
[0320] Referring to FIG. 23, an electronic device according to an embodiment of the disclosure (e.g., an electronic device (101) of FIG. 1, an electronic device (200) of FIG. 2, an electronic device (400) of FIG. 4) can operate a plurality of ultrasonic sensors to obtain a touch signal, and register (e.g., customize) a touch key (e.g., a side key, a soft key, a button-less key) based on the obtained touch signal.
[0321] For example, a processor (e.g., processor (120) of FIG. 1, processor (420) of FIG. 4) of an electronic device (101, 200, 400) can operate a plurality of ultrasonic sensors to obtain a touch signal and register (e.g., customize) a touch key (e.g., side key, soft key, button-less key) based on the obtained touch signal.
[0322] In operation 2310, according to one embodiment, the electronic device (101, 200, 400) may operate a plurality of ultrasonic sensors in a standby state. For example, the processor (120, 420) may operate a plurality of ultrasonic sensors in a standby state.
[0323] FIG. 24 is a drawing (2400) showing a user interface (UI) for registering (e.g., customizing) a plurality of touch keys (e.g., side keys, soft keys, button-less keys) by distinguishing the sensor area of the side bezel according to an embodiment of the present disclosure.
[0324] Referring to FIGS. 23 and 24, in operation 2320, according to one embodiment, the electronic device (101, 200, 400) may operate an application for registration (e.g., customization) of a touch key (e.g., a side key, a soft key, a button-less key) to enter a registration menu of the touch key (e.g., a side key, a soft key, a button-less key). For example, the electronic device (101, 200, 400) may display a user interface (2410) for registration of a touch key (e.g., a side key, a soft key, a button-less key) on the display (410).
[0325] For example, the electronic device (101, 200, 400) may display a selection menu (2420, 2430) for registration (e.g., customization) of a touch key (e.g., a side key, a soft key, a button-less key) on the display (410). The electronic device (101, 200, 400) may perform registration (e.g., customization) of a touch key (e.g., a side key, a soft key, a button-less key) based on a user's selection of the selection menu (2420, 2430) for registration (e.g., customization) of a touch key (e.g., a side key, a soft key, a button-less key).
[0326] For example, the processor (120, 420) may operate an application for registration (e.g., customization) of a touch key (e.g., a side key, a soft key, a button-less key) to enter a registration menu of the touch key (e.g., a side key, a soft key, a button-less key). For example, the processor (120, 420) may display a user interface (2410) for registration of a touch key (e.g., a side key, a soft key, a button-less key) on the display (410).
[0327] For example, the processor (120, 420) may display a selection menu (2420, 2430) for registration (e.g., customization) of a touch key (e.g., a side key, a soft key, a button-less key) on the display (410). The processor (120, 420) may perform registration (e.g., customization) of a touch key (e.g., a side key, a soft key, a button-less key) based on a user's selection of the selection menu (2420, 2430) for registration (e.g., customization) of a touch key (e.g., a side key, a soft key, a button-less key). The sensor area (e.g., the sensor area (620) of FIGS. 6 and 8) of the side bezel (e.g., the side bezel (510) of FIGS. 6 and 9) may be divided into a plurality of areas. The electronic device (101, 200, 400) can divide the sensor area (620) of the side bezel (510) into a first sensor area, a second sensor area, and a third sensor area. For example, the processor (120, 420) can divide the sensor area (620) of the side bezel (510) into a plurality of areas. The processor (120, 420) can divide the sensor area (620) of the side bezel (510) into a first sensor area, a second sensor area, and a third sensor area.
[0328] In operation 2330, the electronic device (101, 200, 400) can obtain a normal touch signal according to the location.
[0329] FIG. 25 is a drawing (2500) showing a user interface (UI) for registering (e.g., customizing) a plurality of touch keys (e.g., side keys, soft keys, button-less keys) by distinguishing the sensor area of the side bezel according to an embodiment of the present disclosure.
[0330] Referring to FIGS. 23 and 25, the electronic device (101, 200, 400) may display a user interface (2510) for registering a normal touch (e.g., a general touch) on the display (410). For example, the electronic device (101, 200, 400) may display a selection menu (2520, 2530) on the display (410) for registering (e.g., customizing) a normal touch (e.g., a general touch) of a touch key (e.g., a side key, a soft key, a button-less key). The electronic device (101, 200, 400) can perform registration (e.g., customization) of a normal touch (e.g., a normal touch) of a touch key (e.g., a side key, a soft key, a button-less key) based on a user's selection of a selection menu (2520, 2530) for registering (e.g., customizing) a normal touch (e.g., a normal touch) of a touch key (e.g., a side key, a soft key, a button-less key).
[0331] For example, the processor (120, 420) may display a user interface (2510) for registering a normal touch (e.g., a regular touch) on the display (410). For example, the processor (120, 420) may display a selection menu (2520, 2530) for registering (e.g., customizing) a normal touch (e.g., a regular touch) of a touch key (e.g., a side key, a soft key, a button-less key) on the display (410). The processor (120, 420) may perform registration (e.g., customization) of a normal touch (e.g., a regular touch) of a touch key (e.g., a side key, a soft key, a button-less key) based on a user's selection of the selection menu (2520, 2530) for registering (e.g., customizing) a normal touch (e.g., a regular touch) of a touch key (e.g., a side key, a soft key, a button-less key).
[0332] For example, the electronic device (101, 200, 400) can obtain a touch signal according to a normal touch (e.g., a general touch) for each of the first sensor area, the second sensor area, and the third sensor area of the sensor area (620).
[0333] For example, the processor (120, 420) can obtain a touch signal according to a normal touch (e.g., a general touch) for each of the first sensor area, the second sensor area, and the third sensor area of the sensor area (620).
[0334] FIG. 26 is a drawing (2600) showing a user interface (UI) for registering (e.g., customizing) a plurality of touch keys (e.g., side keys, soft keys, button-less keys) by distinguishing the sensor area of the side bezel according to an embodiment of the present disclosure.
[0335] Referring to FIGS. 23 and 26, the electronic device (101, 200, 400) may display a user interface (2610) for registering a strong touch (e.g., force touch) on the display (410).
[0336] For example, the processor (120, 420) may display a user interface (2610) for registering a strong touch (e.g., force touch) on the display (410). For example, the electronic device (101, 200, 400) may display a selection menu (2620, 2630) for registering (e.g., customizing) a strong touch (e.g., force touch) on a touch key (e.g., side key, soft key, button-less key) on the display (410). The electronic device (101, 200, 400) can perform registration (e.g., customization) of a strong touch (e.g., force touch) of a touch key (e.g., side key, soft key, button-less key) based on a user's selection of a selection menu (2620, 2630) for registering (e.g., customizing) a strong touch (e.g., force touch) of a touch key (e.g., side key, soft key, button-less key).
[0337] In operation 2340, the electronic device (101, 200, 400) can obtain a touch signal according to a strong touch (e.g., force touch) for each of the first sensor area, the second sensor area, and the third sensor area of the sensor area (620).
[0338] For example, the processor (120, 420) can obtain a touch signal according to a strong touch (e.g., a port touch) for each of the first sensor area, the second sensor area, and the third sensor area of the sensor area (620). For example, the processor (120, 420) can display a selection menu (2620, 2630) on the display (410) for registering (e.g., customizing) a strong touch (e.g., a force touch) of a touch key (e.g., a side key, a soft key, a button-less key). The processor (120, 420) can perform registration (e.g., customization) of a strong touch (e.g., force touch) of a touch key (e.g., side key, soft key, button-less key) based on a user's selection of a selection menu (2620, 2630) for registering (e.g., customizing) a strong touch (e.g., force touch) of a touch key (e.g., side key, soft key, button-less key).
[0339] In operation 2350, the electronic device (101, 200, 400) may determine a reference value (e.g., threshold value) of a strong touch (e.g., force touch) to distinguish between a normal touch (e.g., normal touch) and a strong touch (e.g., force touch).
[0340] For example, the processor (120, 420) may determine a reference value (e.g., threshold value) of a strong touch (e.g., force touch) to distinguish between a normal touch (e.g., normal touch) and a strong touch (e.g., force touch).
[0341] In operation 2360, the electronic device (101, 200, 400) may allow the user to designate a desired area among the first sensor area, the second sensor area, and the third sensor area of the sensor area (620).
[0342] For example, the processor (120, 420) may allow the user to designate a desired area among the first sensor area, the second sensor area, and the third sensor area of the sensor area (620).
[0343] In operation 2370, the electronic device (101, 200, 400) may calculate the arrival time (e.g., reception time) of the reflected wave (e.g., reflected signal) of each of the plurality of ultrasonic sensors and designate a time zone for distinguishing the touch key area.
[0344] For example, the processor (120, 420) may calculate the arrival time (e.g., reception time) of each reflected wave (e.g., reflected signal) of a plurality of ultrasonic sensors and designate a time zone for distinguishing a touch key area.
[0345] In operation 2380, the electronic device (101, 200, 400) may designate a first sensor area as a first touch key, a second sensor area as a second touch key, and a third sensor area as a third touch key. The electronic device (101, 200, 400) may store time zones of the first touch key, the second touch key, and the third touch key.
[0346] For example, the processor (120, 420) may designate a first sensor area as a first touch key, a second sensor area as a second touch key, and a third sensor area as a third touch key. The processor (120, 420) may store the time zones of the first touch key, the second touch key, and the third touch key.
[0347] FIG. 27 is a drawing (2700) showing a user interface (UI) for registering (e.g., customizing) a plurality of touch keys (e.g., side keys, soft keys, button-less keys) by distinguishing the sensor area of the side bezel according to an embodiment of the present disclosure.
[0348] Referring to FIGS. 23 and 27, the electronic device (101, 200, 400) can display a user interface (2710) for registering a single touch key (e.g., button 1) on the display (410).
[0349] For example, the electronic device (101, 200, 400) can register a first touch key (e.g., button 1) based on a user selection input through a user interface (2710) for registering a first touch key (e.g., button 1). For example, the electronic device (101, 200, 400) can display a selection menu (2720, 2730) on the display (410) for registering (e.g., customizing) a first touch key (e.g., side key, soft key, button-less key). One of the plurality of areas (2741, 2742, 2743) of the side bezel (510) of the housing (210) can display a user interface for registering (e.g., customizing) a first touch key (e.g., side key, soft key, button-less key). A user can select one of the plurality of areas (2741, 2742, 2743) of the side bezel (510) of the housing (210) as a single touch key (e.g., a side key, a soft key, a button-less key) and register the single touch key (e.g., a side key, a soft key, a button-less key) by touching the selected area. The electronic device (101, 200, 400) can perform registration (e.g., customization) of one of the plurality of areas (2741, 2742, 2743) of the side bezel as a single touch key (e.g., a side key, a soft key, a button-less key) based on the user's selection of a selection menu (2720, 2730) for registering (e.g., customizing) the single touch key (e.g., a side key, a soft key, a button-less key).
[0350] For example, the processor (120, 420) may display a user interface (2710) for registering a 1st touch key (e.g., button 1) on the display (410). The processor (120, 420) may register the 1st touch key (e.g., button 1) based on a user selection input through the user interface (2710) for registering the 1st touch key (e.g., button 1). For example, the processor (120, 420) may display a selection menu (2720, 2730) for registering (e.g., customizing) the 1st touch key (e.g., side key, soft key, buttonless key) on the display (410). A user interface for registering (e.g., customizing) a single touch key (e.g., a side key, a soft key, a button-less key) in one of the plurality of areas (2741, 2742, 2743) of the side bezel (510) of the housing (210) can be displayed. The user can select one of the plurality of areas (2741, 2742, 2743) of the side bezel (510) of the housing (210) as a single touch key (e.g., a side key, a soft key, a button-less key) and touch the selected area to register the single touch key (e.g., a side key, a soft key, a button-less key). The processor (120, 420) may perform registration (e.g., customization) of a single touch key (e.g., a side key, a soft key, a button-less key) in one of the plurality of areas (2741, 2742, 2743) of the side bezel based on a user's selection of a selection menu (2720, 2730) for registering (e.g., customizing) a single touch key (e.g., a side key, a soft key, a button-less key).
[0351] FIG. 28 is a drawing (2800) showing a user interface (UI) for registering (e.g., customizing) a plurality of touch keys (e.g., side keys, soft keys, button-less keys) by distinguishing the sensor area of the side bezel according to an embodiment of the present disclosure.
[0352] Referring to FIGS. 23 and 28, the electronic device (101, 200, 400) may display a user interface (2810) for registering a second touch key (e.g., button 2) on the display (410). The electronic device (101, 200, 400) may register a second touch key (e.g., button 2) based on a user selection input through the user interface (2810) for registering a second touch key (e.g., button 2). For example, the electronic device (101, 200, 400) may display a selection menu (2820, 2830) for registering (e.g., customizing) a second touch key (e.g., side key, soft key, buttonless key) on the display (410). A user interface for registering (e.g., customizing) a double-touch key (e.g., a side key, a soft key, a button-less key) in one of the plurality of areas (2841, 2842, 2843) of the side bezel (510) of the housing (210) can be displayed. The user can select one of the plurality of areas (2841, 2842, 2843) of the side bezel (510) of the housing (210) as a double-touch key (e.g., a side key, a soft key, a button-less key) and touch the selected area to register the double-touch key (e.g., a side key, a soft key, a button-less key). The electronic device (101, 200, 400) can perform registration (e.g., customization) of a double-touch key (e.g., side key, soft key, button-less key) in one of a plurality of areas (2841, 2842, 2843) of the side bezel based on a user's selection of a selection menu (2820, 2830) for registering (e.g., customizing) a double-touch key (e.g., side key, soft key, button-less key).
[0353] For example, the processor (120, 420) may display a user interface (2810) for registering a second touch key (e.g., button 2) on the display (410). The processor (120, 420) may register a second touch key (e.g., button 2) based on a user selection input through the user interface (2810) for registering a second touch key (e.g., button 2). For example, the processor (120, 420) may display a selection menu (2820, 2830) for registering (e.g., customizing) a second touch key (e.g., side key, soft key, buttonless key) on the display (410). A user interface for registering (e.g., customizing) a double-touch key (e.g., a side key, a soft key, a button-less key) in one of the plurality of areas (2841, 2842, 2843) of the side bezel (510) of the housing (210) can be displayed. The user can select one of the plurality of areas (2841, 2842, 2843) of the side bezel (510) of the housing (210) as a double-touch key (e.g., a side key, a soft key, a button-less key) and touch the selected area to register the double-touch key (e.g., a side key, a soft key, a button-less key). The processor (120, 420) may perform registration (e.g., customization) of a double-touch key (e.g., side key, soft key, button-less key) in one of the plurality of areas (2841, 2842, 2843) of the side bezel based on a user's selection of a selection menu (2820, 2830) for registering (e.g., customizing) a double-touch key (e.g., side key, soft key, button-less key).
[0354] FIG. 29 is a drawing (2900) showing a user interface (UI) for registering (e.g., customizing) a plurality of touch keys (e.g., side keys, soft keys, button-less keys) by distinguishing the sensor area of the side bezel according to an embodiment of the present disclosure.
[0355] Referring to FIGS. 23 and 29, the electronic device (101, 200, 400) may display a user interface (2910) for registering a 3-touch key (e.g., button 3) on the display (410). The electronic device (101, 200, 400) may register a 3-touch key (e.g., button 3) based on a user selection input through the user interface (2910) for registering a 3-touch key (e.g., button 3). For example, the electronic device (101, 200, 400) may display a selection menu (2920, 2930) for registering (e.g., customizing) a 3-touch key (e.g., side key, soft key, buttonless key) on the display (410). A user interface for registering (e.g., customizing) a three-touch key (e.g., a side key, a soft key, a button-less key) in one of the plurality of areas (2941, 2942, 2943) of the side bezel (510) of the housing (210) can be displayed. The user can select one of the plurality of areas (2941, 2942, 2943) of the side bezel (510) of the housing (210) as a three-touch key (e.g., a side key, a soft key, a button-less key) and touch the selected area to register the three-touch key (e.g., a side key, a soft key, a button-less key). The electronic device (101, 200, 400) can perform registration (e.g., customization) of a three-touch key (e.g., a side key, a soft key, a button-less key) in one of a plurality of areas (2941, 2942, 2943) of the side bezel based on a user's selection of a selection menu (2920, 2930) for registering (e.g., customizing) a three-touch key (e.g., a side key, a soft key, a button-less key).
[0356] For example, the processor (120, 420) may display a user interface (2910) for registering a 3-touch key (e.g., button 3) on the display (410). The processor (120, 420) may register a 3-touch key (e.g., button 3) based on a user selection input through the user interface (2910) for registering a 3-touch key (e.g., button 3). For example, the processor (120, 420) may display a selection menu (2920, 2930) on the display (410) for registering (e.g., customizing) a 3-touch key (e.g., side key, soft key, buttonless key). A user interface for registering (e.g., customizing) a three-touch key (e.g., a side key, a soft key, a button-less key) in one of the plurality of areas (2941, 2942, 2943) of the side bezel (510) of the housing (210) can be displayed. The user can select one of the plurality of areas (2941, 2942, 2943) of the side bezel (510) of the housing (210) as a three-touch key (e.g., a side key, a soft key, a button-less key) and touch the selected area to register the three-touch key (e.g., a side key, a soft key, a button-less key). The processor (120, 420) may perform registration (e.g., customization) of a three-touch key (e.g., a side key, a soft key, a button-less key) in one of the plurality of areas (2941, 2942, 2943) of the side bezel based on a user's selection of a selection menu (2920, 2930) for registering (e.g., customizing) a three-touch key (e.g., a side key, a soft key, a button-less key).
[0357] In operation 2390, the electronic device (101, 200, 400) can determine whether the user wishes to designate an additional touch key. If, as a result of the determination in operation 2390, the user wishes to designate an additional touch key, the electronic device (101, 200, 400) can return to operation 2360 and perform the operation.
[0358] For example, the processor (120, 420) can check whether the user wants to designate an additional touch key. If the user wants to designate an additional touch key as a result of the check in operation 2390, the processor (120, 420) can return to operation 2360 and perform the operation.
[0359] The memory (130, 433) of the electronic device (101, 200, 400) according to the embodiment of the disclosure may include instructions for performing the operations of FIG. 23. At least some of the operations of FIG. 23 may be omitted. At least one of the operations of FIG. 23 may be performed simultaneously (e.g., in parallel).
[0360] FIG. 30 is a drawing illustrating a method of recognizing a touch using a plurality of touch keys (e.g., side keys, soft keys, button-less keys) according to an embodiment of the present disclosure.
[0361] Referring to FIG. 30, an electronic device according to an embodiment of the disclosure (e.g., an electronic device (101) of FIG. 1, an electronic device (200) of FIG. 2, an electronic device (400) of FIG. 4) can perform touch recognition of a plurality of touch keys (e.g., a side key, a soft key, a button-less key) designated in a sensor area (e.g., a sensor area (620) of FIGS. 6 and 8) of a side bezel (e.g., a side bezel (510) of FIGS. 6 and 9).
[0362] In operation 3005, the electronic device (101, 200, 400) may operate a plurality of ultrasonic sensors to generate ultrasonic waves (e.g., lamb waves). The electronic device (101, 200, 400) may receive a reflection wave (e.g., a reflection signal) of the ultrasonic waves (e.g., lamb waves). The electronic device (101, 200, 400) may periodically or aperiodically perform signal measurement of the received reflection wave (e.g., a reflection signal).
[0363] For example, the processor (120, 420) may operate a plurality of ultrasonic sensors to generate ultrasonic waves (e.g., lamb waves). The processor (120, 420) may receive a reflection wave (e.g., a reflection signal) of the ultrasonic waves (e.g., lamb waves). The processor (120, 420) may periodically perform signal measurement of the received reflection wave (e.g., a reflection signal).
[0364] In operation 3010, the electronic device (101, 200, 400) may acquire a background signal (e.g., a reference signal, a background signal) of an ultrasonic sensor in a standby state and store the background signal (e.g., a reference signal, a background signal) in a memory (e.g., a memory (130) of FIG. 1, a memory (433) of FIG. 4).
[0365] For example, the processor (120, 420) may obtain a background signal (e.g., a reference signal, a background signal) of an ultrasonic sensor in a standby state and store the background signal (e.g., a reference signal, a background signal) in a memory (e.g., a memory (130) of FIG. 1, a memory (433) of FIG. 4).
[0366] In operation 3015, the electronic device (101, 200, 400) may acquire a reflected wave (e.g., a reflected signal) according to a touch of a finger, and perform calibration of the reflected wave (e.g., a reflected signal) by reflecting a background signal (e.g., a reference signal, a background signal).
[0367] For example, the processor (120, 420) can acquire a reflected wave (e.g., a reflected signal) according to a touch of a finger, and perform calibration of the reflected wave (e.g., a reflected signal) by reflecting a background signal (e.g., a reference signal, a background signal).
[0368] In operation 3020, the electronic device (101, 200, 400) can analyze the magnitude (e.g., intensity, strength) of the reflected wave (e.g., reflected signal) for which calibration has been performed.
[0369] For example, the processor (120, 420) can analyze the size (e.g., intensity, strength) of the reflected wave (e.g., reflected signal) on which calibration has been performed.
[0370] In operation 3025, the electronic device (101, 200, 400) can determine whether the magnitude (e.g., intensity, strength) of the reflected wave (e.g., reflected signal) for which calibration has been performed corresponds to a normal touch (e.g., a normal touch).
[0371] For example, the processor (120, 420) can determine whether the size (e.g., intensity, strength) of the reflected wave (e.g., reflected signal) for which calibration has been performed corresponds to a normal touch (e.g., general touch).
[0372] As a result of the judgment of operation 3025, if the size (e.g., intensity, strength) of the reflected wave (e.g., reflected signal) for which calibration was performed does not correspond to a normal touch (e.g., general touch), the operation may be performed by returning to operation 3010.
[0373] As a result of the judgment of operation 3025, if the size (e.g., intensity, strength) of the reflected wave (e.g., reflected signal) for which calibration has been performed corresponds to a normal touch (e.g., general touch), operation 3030 can be performed.
[0374] In operation 3030, the electronic device (101, 200, 400) can determine whether the magnitude (e.g., intensity, strength) of the reflected wave (e.g., reflected signal) for which calibration has been performed corresponds to a strong touch (e.g., force touch).
[0375] For example, the processor (120, 420) can determine whether the size (e.g., intensity, strength) of the reflected wave (e.g., reflected signal) for which calibration has been performed corresponds to a strong touch (e.g., force touch).
[0376] In operation 3035, the electronic device (101, 200, 400) can recognize a strong touch (e.g., force touch) if the size (e.g., intensity, strength) of the reflected wave (e.g., reflection signal) for which calibration has been performed corresponds to a strong touch (e.g., force touch).
[0377] For example, the processor (120, 420) can recognize a strong touch (e.g., force touch) if the size (e.g., intensity, strength) of the reflected wave (e.g., reflection signal) for which calibration has been performed corresponds to a strong touch (e.g., force touch).
[0378] In operation 3040, the electronic device (101, 200, 400) can recognize a normal touch (e.g., a general touch) if the size (e.g., intensity, strength) of the reflected wave (e.g., a reflected signal) for which calibration has been performed does not correspond to a strong touch (e.g., a force touch).
[0379] For example, the processor (120, 420) may recognize a normal touch (e.g., a general touch) if the size (e.g., intensity, strength) of the reflected wave (e.g., a reflected signal) for which calibration has been performed does not correspond to a strong touch (e.g., a force touch).
[0380] In operation 3045, the electronic device (101, 200, 400) can control the first ultrasonic sensor (481) and the second ultrasonic sensor (482) in a pulse repetition frequency (PRF) manner depending on whether there is a touch.
[0381] For example, when the electronic device (101, 200, 400) is in a standby state (e.g., standby state (1610) of FIG. 16), it can control a plurality of ultrasonic sensors to operate at a first pulse repetition frequency (e.g., low PRF, low frequency pulse repetition frequency). For example, when the processor (120, 420) is in a standby state (e.g., standby state (1610) of FIG. 16), it can control a plurality of ultrasonic sensors to operate at a first pulse repetition frequency (e.g., low PRF, low frequency pulse repetition frequency).
[0382] For example, the electronic device (101, 200, 400) may control a plurality of ultrasonic sensors to operate at a second pulse repetition frequency (e.g., high PRF, high frequency pulse repetition frequency) when a touch signal is detected (e.g., '1620' of FIG. 16). For example, the processor (120, 420) may control a plurality of ultrasonic sensors to operate at a second pulse repetition frequency (e.g., high PRF, high frequency pulse repetition frequency) when a touch signal is detected (e.g., '1620' of FIG. 16).
[0383] For example, the electronic device (101, 200, 400) may determine that there is no touch signal if no touch signal is detected for a certain period of time after detecting the touch signal (e.g., '1630' of FIG. 16). If there is no touch signal, the electronic device (101, 200, 400) may control the plurality of ultrasonic sensors to operate at a first pulse repetition frequency (e.g., low PRF, low-frequency pulse repetition frequency). For example, the processor (120, 420) may determine that there is no touch signal if no touch signal is detected for a certain period of time after detecting the touch signal (e.g., '1630' of FIG. 16). If there is no touch signal, the electronic device (101, 200, 400) may control the plurality of ultrasonic sensors to operate at a first pulse repetition frequency (e.g., low PRF, low-frequency pulse repetition frequency).
[0384] In operation 3050, the electronic device (101, 200, 400) can calculate a touch location in a sensor area (e.g., sensor area (620) of FIGS. 6 and 8) of a side bezel (e.g., side bezel (510) of FIGS. 6 and 9) based on the received reflected waves (e.g., reflected signals). The electronic device (101, 200, 400) can calculate at which location among a plurality of touch keys (e.g., side keys, soft keys, buttonless keys) the touch was made.
[0385] For example, the processor (120, 420) can calculate a touch location in a sensor area (e.g., sensor area (620) of FIGS. 6 and 8) of a side bezel (e.g., side bezel (510) of FIGS. 6 and 9) based on received reflected waves (e.g., reflected signals). The processor (120, 420) can calculate at which location among a plurality of touch keys (e.g., side keys, soft keys, buttonless keys) a touch was made.
[0386] At operation 3055, the electronic device (101, 200, 400) can determine whether the recognized touch occurred on a plurality of designated touch keys (e.g., side keys, soft keys, buttonless keys).
[0387] For example, the processor (120, 420) can determine whether a recognized touch occurred on a plurality of designated touch keys (e.g., side keys, soft keys, buttonless keys).
[0388] In operation 3060, the electronic device (101, 200, 400) can recognize a touch of a designated touch key (e.g., a side key, a soft key, a button-less key) if a touch is normally recognized on a plurality of designated touch keys (e.g., a side key, a soft key, a button-less key). The electronic device (101, 200, 400) can perform an operation according to the designated touch key (e.g., a side key, a soft key, a button-less key).
[0389] For example, the processor (120, 420) may recognize a touch of a designated touch key (e.g., a side key, a soft key, a button-less key) when a touch is normally recognized on a plurality of designated touch keys (e.g., a side key, a soft key, a button-less key). The processor (120, 420) may perform an operation according to the designated touch key (e.g., a side key, a soft key, a button-less key).
[0390] An electronic device according to an embodiment of the disclosure (e.g., an electronic device (200) of FIGS. 2 and 3, an electronic device (400) of FIG. 4) may include a housing (e.g., a housing (210) of FIG. 2), a sensor component (e.g., a sensor component (480) of FIGS. 4 and 5), a processor (e.g., a processor (420) of FIG. 4), and a memory (e.g., a memory (433) of FIG. 4) that stores instructions that operate the electronic device (200, 400) when executed by the processor (420). The housing (210) may include a wall (e.g., a side bezel (218) of FIG. 2, a side bezel (510) of FIG. 6) that forms an outer surface of the electronic device (200, 400). The sensor component (480) may include a first sensor (e.g., a first ultrasonic sensor (481) of FIG. 5) and a second ... second ultrasonic sensor (481) of FIG. 5) and a second ultrasonic sensor (481) of FIG. 5). 5 may include a second ultrasonic sensor (482) of the wall (218, 510). The first sensor (481) and the second sensor (482) may be arranged to be in contact with the inner surface of the wall (218, 510). The first sensor (481) may transmit a first wave so that the first wave is propagated toward the second sensor (482) through the wall (218, 510). The second sensor (482) may transmit a second wave so that the second wave is propagated toward the first sensor (481) through the wall (218, 510). The first sensor (481) may receive the second wave transmitted from the second sensor (482). The first sensor (481) may receive a first reflected wave corresponding to the first wave generated by a touch applied to the outer surface of the wall (218, 510). The second sensor (482) can receive the first wave transmitted from the first sensor (481). The second sensor (482) can receive a second reflected wave corresponding to the second wave generated by a touch applied to the outer surface of the wall (218, 510).When the above instructions are executed by the processor (420), the electronic device (200, 400) can identify a touch location based on the first reflected wave and the second reflected wave according to a touch applied to the outer surface of the wall (218, 510).
[0391] According to one embodiment, when the instructions are executed by the processor (420), the electronic device (200, 400) can identify a touch pressure based on the first reflected wave and the second reflected wave according to a touch applied to the outer surface of the wall (218, 510).
[0392] According to one embodiment, when the instructions are executed by the processor (420), the electronic device (200, 400) can identify a touch gesture and a touch input time based on the first reflected wave and the second reflected wave according to a touch applied to the outer surface of the wall (218, 510).
[0393] In one embodiment, the first wave may be transmitted at a first frequency. The second wave may be transmitted at a second frequency different from the first frequency.
[0394] According to one embodiment, the sensor component (480) may include a processor (e.g., processor (491) of FIG. 5) that drives the first sensor (481) and the second sensor (482).
[0395] According to one embodiment, at least a portion of the housing (210) can be used as a sensor area (620) for touch sensing.
[0396] According to one embodiment, when the instructions are executed by the processor (420), the electronic device (200, 400) can obtain a first background signal of the first sensor (481) in a state where at least a portion of the housing (210) is not touched. When the instructions are executed by the processor (420), the electronic device (200, 400) can obtain a second background signal of the second sensor (482) in a state where at least a portion of the housing (210) is not touched. When the instructions are executed by the processor (420), the electronic device (200, 400) can identify a touch location in the housing (210) by reflecting the first background signal in the first reflected wave and reflecting the second background signal in the second reflected wave.
[0397] According to one embodiment, when the instructions are executed by the processor (420), the electronic device (200, 400) may divide at least a portion of the housing (210) into a plurality of touch key portions. When the instructions are executed by the processor (420), the electronic device (200, 400) may register a first touch key based on the first reflected wave and the second reflected wave in a state where the user's finger touches a first touch key portion among the plurality of touch key portions. When the instructions are executed by the processor (420), the electronic device (200, 400) may register a second touch key based on the first reflected wave and the second reflected wave in a state where the user's finger touches a second touch key portion different from the first touch key portion among the plurality of touch key portions.
[0398] According to one embodiment, when the instructions are executed by the processor (420), the electronic device (200, 400) can obtain a first time at which the first reflected wave is received by the first sensor (481) after the first Pan wave is transmitted from the first sensor (481). When the instructions are executed by the processor (420), the electronic device (200, 400) can obtain a second time at which the second reflected wave is received by the second sensor (482) after the second Pan wave is transmitted from the second sensor (482). When the instructions are executed by the processor (420), the electronic device (200, 400) can determine a touch location on at least a portion of the housing (210) by comparing the first time with the second time.
[0399] According to one embodiment, when the instructions are executed by the processor (420), the electronic device (200, 400) can determine a touch length in at least a portion of the housing (210) based on the number of times the first reflected wave is received by the first sensor (481) and the number of times the second reflected wave is received by the second sensor (482).
[0400] According to one embodiment, when the instructions are executed by the processor (420), the electronic device (200, 400) can obtain a first intensity of the first reflected wave and a second intensity of the second reflected wave. When the instructions are executed by the processor (420), the electronic device (200, 400) can determine a touch intensity at least in a portion of the housing (210) based on the first intensity of the first reflected wave and the second intensity of the second reflected wave.
[0401] According to one embodiment, when the instructions are executed by the processor (420), the electronic device (200, 400) can obtain the first intensity of the first reflected wave and the second intensity of the second reflected wave. When the instructions are executed by the processor (420), the electronic device (200, 400) can determine a normal touch if the first intensity of the first reflected wave and the second intensity of the second reflected wave are less than or equal to a reference value. When the instructions are executed by the processor (420), the electronic device (200, 400) can determine a strong touch if the first intensity of the first reflected wave and the second intensity of the second reflected wave exceed a reference value.
[0402] According to one embodiment, when the instructions are executed by the processor (420), the electronic device (200, 400) can determine a single touch or a multi-touch on at least a portion of the housing (210) based on the number of the first reflected waves received from the sensor (481) and the number of the second reflected waves received from the sensor (482).
[0403] According to one embodiment, when the instructions are executed by the processor (420), the electronic device (200, 400) may determine a single touch if one reflection is received for the first plate wave and one reflection is received for the second plate wave. When the instructions are executed by the processor (420), the electronic device (200, 400) may determine a multi-touch if multiple reflections are received for the first plate wave and multiple reflections are received for the second plate wave.
[0404] According to one embodiment, the first sensor (481) and the second sensor (482) may be positioned to contact the inner side (511) of the side surface (218, 510) of the housing (210).
[0405] According to one embodiment, the first sensor (481) and the second sensor (482) may be positioned to contact the inner side of the bottom surface of the housing (210).
[0406] In an operating method of an electronic device (e.g., an electronic device (200) of FIGS. 2 and 3, an electronic device (400) of FIG. 4) according to an embodiment of the disclosure, the electronic device (200, 400) comprises a housing (e.g., a housing (210) of FIG. 2) including a wall (e.g., a side bezel (218) of FIG. 2, a side bezel (510) of FIG. 6) forming an outer surface of the electronic device (200, 400), a sensor component (e.g., a sensor component (480) of FIGS. 4 and 5) including a first sensor (e.g., a first ultrasonic sensor (481) of FIG. 5) and a second sensor (e.g., a second ultrasonic sensor (482) of FIG. 5), a processor (e.g., a processor (420) of FIG. 4), and a memory (e.g., a memory) storing instructions that operate the electronic device (200, 400) when executed by the processor (420). The first sensor (481) and the second sensor (482) may be arranged to be in contact with the inner surface of the wall (218, 510). The method of operation may be such that the first sensor (481) can transmit the first wave so that the first wave is propagated toward the second sensor (482) through the wall (218, 510). The method of operation may be such that the second sensor (482) can transmit the second wave so that the second wave is propagated toward the first sensor (481) through the wall (218, 510). The method of operation may be such that the first sensor (481) can receive the second wave transmitted from the second sensor (482). The first sensor (481) can receive the first wave generated by a touch applied to the outer surface of the wall (218, 510). A first reflected wave corresponding to the wave can be received. In the above operating method, the second sensor (482) can receive the first wave transmitted from the first sensor (481).The second sensor (482) can receive a second reflected wave corresponding to the second wave generated by a touch applied to the outer surface of the wall (218, 510). The operating method can identify a touch location based on the first reflected wave and the second reflected wave according to the touch applied to the outer surface of the wall (218, 510).
[0407] According to one embodiment, the operating method can identify a touch pressure based on the first reflected wave and the second reflected wave according to a touch applied to the outer surface of the wall (218, 510).
[0408] According to one embodiment, the operating method can identify a touch gesture and a touch input time based on the first reflected wave and the second reflected wave according to a touch applied to the outer surface of the wall (218, 510).
[0409] According to one embodiment, the method of operation may be such that the first wave may be transmitted at a first frequency. The second wave may be transmitted at a second frequency different from the first frequency.
[0410] According to one embodiment, the method of operation may utilize at least a portion of the housing (210) as a sensor area (620) for touch sensing.
[0411] According to one embodiment, the operating method can obtain a first background signal of the first sensor (481) in a state where at least a portion of the housing (210) is not touched. The operating method can obtain a second background signal of the second sensor (482) in a state where at least a portion of the housing (210) is not touched. The operating method can identify a touch position in the housing (210) by reflecting the first background signal in the first reflected wave and reflecting the second background signal in the second reflected wave.
[0412] According to one embodiment, the operating method may divide at least a portion of the housing (210) into a plurality of touch key portions. The operating method may register a first touch key based on the first reflected wave and the second reflected wave when the user's finger touches a first touch key portion among the plurality of touch key portions. The operating method may register a second touch key based on the first reflected wave and the second reflected wave when the user's finger touches a second touch key portion different from the first touch key portion among the plurality of touch key portions.
[0413] According to one embodiment, the operating method can obtain a first time at which the first reflected wave is received by the first sensor (481) after the first Pan wave is transmitted from the first sensor (481). The operating method can obtain a second time at which the second reflected wave is received by the second sensor (482) after the second Pan wave is transmitted from the second sensor (482). The operating method can determine a touch position in at least a portion of the housing (210) by comparing the first time with the second time.
[0414] According to one embodiment, the operating method can determine a touch length in at least a portion of the housing (210) based on the number of times the first reflected waves are received by the first sensor (481) and the number of times the second reflected waves are received by the second sensor (482).
[0415] According to one embodiment, the operating method can obtain a first intensity of the first reflected wave and a second intensity of the second reflected wave. The operating method can determine a touch intensity in at least a portion of the housing (210) based on the first intensity of the first reflected wave and the second intensity of the second reflected wave.
[0416] According to one embodiment, the operating method can obtain the first intensity of the first reflected wave and the second intensity of the second reflected wave. The operating method can determine a normal touch if the first intensity of the first reflected wave and the second intensity of the second reflected wave are equal to or greater than a first reference value and less than a second reference value. The operating method can determine a strong touch if the first intensity of the first reflected wave and the second intensity of the second reflected wave are equal to or greater than the second reference value.
[0417] According to one embodiment, the operating method can determine a single touch or multi-touch on at least a portion of the housing (210) based on the number of the first reflected waves received by the first sensor (481) and the number of the second reflected waves received by the second sensor (482).
[0418] According to one embodiment, the operating method may determine a single touch when one reflection wave is received for the first plate wave and one reflection wave is received for the second plate wave. The operating method may determine a multi-touch when multiple first reflections are received for the first plate wave and multiple second reflections are received for the second plate wave.
[0419] In a recording medium storing instructions readable by a processor (e.g., a processor (420) of FIG. 4) of an electronic device (e.g., an electronic device (200) of FIG. 2 and FIG. 3, an electronic device (400) of FIG. 4) according to an embodiment of the disclosure, the electronic device (200, 400) comprises a housing (e.g., a housing (210) of FIG. 2) including a wall (e.g., a side bezel (218) of FIG. 2, a side bezel (510) of FIG. 6) forming an outer surface of the electronic device (200, 400), a sensor component (e.g., a sensor component (480) of FIG. 4 and FIG. 5) including a first sensor (e.g., a first ultrasonic sensor (481) of FIG. 5) and a second sensor (e.g., a second ultrasonic sensor (482) of FIG. 5), and instructions readable by the processor (420) The electronic device (200, 400) may include a memory (memory (433) of FIG. 4) that stores instructions that operate the electronic device (200, 400) when executed. The first sensor (481) and the second sensor (482) may be arranged to contact the inner surface of the wall (218, 510). The instructions, when executed by the processor (420), may cause the electronic device (200, 400) to cause the first sensor (481) to transmit a first wave so that the first wave propagates toward the second sensor (482) through the wall (218, 510). The instructions, when executed by the processor (420), may cause the electronic device (200, 400) to cause the second sensor (482) to transmit a second wave toward the first sensor (481) through the wall (218, 510). The second wave can be transmitted so that the second wave can be propagated.The above instructions, when executed by the processor (420), may cause the electronic device (200, 400) to cause the first sensor (481) to receive the second wave transmitted from the second sensor (482) and to receive a first reflected wave corresponding to the first wave generated by a touch applied to the outer surface of the wall (218, 510). The above instructions, when executed by the processor (420), may cause the electronic device (200, 400) to cause the second sensor (482) to receive the first wave transmitted from the first sensor (481) and to receive a second reflected wave corresponding to the second wave generated by a touch applied to the outer surface of the wall (218, 510). The above instructions, when executed by the processor (420), may cause the electronic device (200, 400) to identify a touch location based on the first reflected wave and the second reflected wave according to a touch applied to the outer surface of the wall (218, 510).
[0420] An electronic device and an operating method thereof according to an embodiment of the disclosure can sense a touch of a user's finger using a plurality of ultrasonic sensors.
[0421] An electronic device and an operating method thereof according to one embodiment of the disclosure can form a plurality of touch keys (e.g., soft keys, button-less keys) by arranging a plurality of ultrasonic sensors inside a side bezel of a housing.
[0422] An electronic device and an operating method thereof according to one embodiment of the disclosure can recognize touch of a plurality of touch keys (e.g., soft keys, button-less keys) by generating ultrasonic waves (e.g., Pan waves) of different frequencies (e.g., center frequencies) from a plurality of ultrasonic sensors and receiving reflected waves (e.g., reflected signals) according to the ultrasonic waves (e.g., Pan waves).
[0423] An electronic device and an operating method thereof according to an embodiment of the disclosure may provide an electronic device and an operating method thereof capable of determining at least one of the presence or absence of a touch, a touch length, a touch intensity, a single touch, and a multi-touch using a plurality of touch keys (e.g., a soft key, a button-less key).
[0424] An electronic device and its operating method according to one embodiment of the disclosure can register (e.g., customize) a plurality of touch keys (e.g., soft keys, button-less keys) at a location desired by a user.
[0425] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.
[0426] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments disclosed in this document are not limited to the aforementioned devices.
[0427] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.
[0428] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0429] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more commands stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one command among the one or more commands stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one command called. The one or more commands may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.
[0430] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
[0431] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and arranged in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
[0432] While the present disclosure has been illustrated and described with reference to various embodiments, it will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present disclosure as defined by the appended claims and their equivalents.
Claims
1. In electronic devices, A housing including a wall (218, 510) forming an outer surface of an electronic device (200, 400); A sensor component (480) including a first sensor (481) and a second sensor (482); A memory (430) storing one or more computer programs; The first sensor (481) and the second sensor (482) are positioned to contact the inner surface of the wall (218, 510), wherein said one or more computer programs, when individually or collectively executed by one or more processors, comprise instructions that operate said electronic device; The first sensor (481) transmits the first wave so that the first wave is propagated toward the second sensor (482) through the wall (218, 510), The second sensor (482) transmits the second wave so that the second wave is propagated toward the first sensor (481) through the wall (218, 510). The first sensor (481) receives the second wave transmitted from the second sensor (482) and receives a first reflected wave corresponding to the first wave generated by a touch applied to the outer surface of the wall (218, 510). The second sensor (482) receives the first wave transmitted from the first sensor (481) and receives a second reflected wave corresponding to the second wave generated by a touch applied to the outer surface of the wall (218, 510). Identifying the touch location based on the first reflected wave and the second reflected wave according to the touch applied to the outer surface of the wall (218, 510). Electronic devices (200, 400).
2. In paragraph 1, When said one or more computer programs are individually or collectively executed by one or more processors, said electronic device, Identifying the touch pressure based on the first reflected wave and the second reflected wave according to the touch applied to the outer surface of the wall (218, 510). Electronic devices (200, 400).
3. In paragraph 1, When said one or more computer programs are individually or collectively executed by one or more processors, said electronic device, Identifying a touch gesture and a touch input time based on the first reflected wave and the second reflected wave according to a touch applied to the outer surface of the wall (218, 510). Electronic devices (200, 400).
4. In paragraph 1, The above first wave is transmitted at a first frequency, The second wave is transmitted at a second frequency different from the first frequency. Electronic devices (200, 400).
5. In paragraph 1, The above sensor component (480) includes a processor (491) that drives the first sensor (481) and the second sensor (482). Electronic devices (200, 400).
6. In paragraph 1, At least a portion of the above housing (210) is used as a sensor area (620) for touch sensing. Electronic devices (200, 400).
7. In paragraph 2, When said one or more computer programs are individually or collectively executed by one or more processors, said electronic device, Acquire the first background signal of the first sensor (481) in a state where there is no touch on at least a part of the housing (210), Acquire a second background signal of the second sensor (482) in a state where there is no touch on at least a part of the housing (210), Identifying a touch location in the housing (210) by reflecting the first background signal in the first reflected wave and reflecting the second background signal in the second reflected wave. Electronic devices (200, 400).
8. In paragraph 7, When said one or more computer programs are individually or collectively executed by one or more processors, said electronic device, Dividing at least a portion of the above housing (210) into a plurality of touch key sections, Among the plurality of touch key portions, when the user's finger touches the first touch key portion, the first touch key is registered based on the first reflected wave and the second reflected wave. Among the plurality of touch key portions, the user's finger touches a second touch key portion different from the first touch key portion, and, based on the first reflected wave and the second reflected wave, registers the second touch key. Electronic devices (200, 400).
9. In paragraph 7, When said one or more computer programs are individually or collectively executed by one or more processors, said electronic device, After transmitting the first wave from the first sensor (481), the first time at which the first reflected wave is received by the first sensor (481) is obtained, After transmitting the second wave from the second sensor (482), the second time at which the second reflected wave is received by the second sensor (482) is obtained, Determining the touch location in at least a part of the housing (210) by comparing the first time and the second time, Electronic devices (200, 400).
10. In paragraph 7, When said one or more computer programs are individually or collectively executed by one or more processors, said electronic device, Based on the number of times the first reflected wave is received by the first sensor (481) and the number of times the second reflected wave is received by the second sensor (482), a touch length in at least a part of the housing (210) is determined. Electronic devices (200, 400).
11. In paragraph 7, When said one or more computer programs are individually or collectively executed by one or more processors, said electronic device, Obtaining the first intensity of the first reflected wave and the second intensity of the second reflected wave, Based on the first intensity of the first reflected wave and the second intensity of the second reflected wave, the touch intensity in at least a part of the housing (210) is determined. Electronic devices (200, 400).
12. In paragraph 7, When said one or more computer programs are individually or collectively executed by one or more processors, said electronic device, Obtaining the first intensity of the first reflected wave and the second intensity of the second reflected wave, If the first intensity of the first reflected wave and the second intensity of the second reflected wave are lower than or equal to the reference value, it is determined as a normal touch, If the first intensity of the first reflected wave and the second intensity of the second reflected wave exceed a reference value, it is determined as a strong touch. Electronic devices (200, 400).
13. In paragraph 7, When said one or more computer programs are individually or collectively executed by one or more processors, said electronic device, Based on the number of the first reflected waves received from the sensor (481) and the number of the second reflected waves received from the sensor (482), determining a single touch or multi-touch in at least a part of the housing (210). Electronic devices (200, 400).
14. In paragraph 13, When said one or more computer programs are individually or collectively executed by one or more processors, said electronic device, If one reflection is received for the first plate wave and one reflection is received for the second plate wave, it is determined as a single touch. When multiple reflections are received for the first plate wave and multiple reflections are received for the second plate wave, it is determined as multi-touch. Electronic devices (200, 400).
15. In paragraph 1, The first sensor (481) and the second sensor (482) are positioned so as to be in contact with the inner side (511) of the side (218, 510) of the housing (210). Electronic devices (200, 400).
Citation Information
Patent Citations
Touch screen apparatus and control methods thereof
KR1020160142208A
Acoustic Touch Apparatus And Methods Using Touch Sensitive Lamb Waves
US20140267175A1
multi-touch ultrasonic touch screen
US20150286341A1
Ultrasound sensing of proximity and touch
US20160246449A1
KR20190014702A