Electronic device including electromagnetic sensor module and control method thereof
By integrating EM sensor modules and antenna modules in electronic devices, identifying and processing effective electromagnetic signals, the resource occupation and current consumption problems caused by noise signals are solved, and the overall system efficiency is improved.
Patent Information
- Application Number
- CN201980058973.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2018-09-10
- Filing Date
- 2019-09-06
- Publication Date
- 2025-01-07
- Estimated Expiration
- 2039-09-06
AI Technical Summary
Electronic devices may be continuously searched by noise signals in an environment without external electronic devices, resulting in unnecessary system resource occupancy and current consumption.
By integrating an electromagnetic (EM) sensor module, antenna module, memory and processor in an electronic device, the EM sensor module is configured to detect surrounding electromagnetic signals, determine whether the signal is an active signal, and only the active signal is processed to filter out the noise signal.
The efficiency of system resources and current consumption is improved, so that the electronic device can only process effective data, and reduce invalid search and power waste.
Smart Images

Figure CN112673264B_ABST
Abstract
Description
Technical Field
[0001] Various embodiments relate to an electronic device including an electromagnetic (EM) sensor module and a control method thereof. Background Art
[0002] Nowadays, a variety of electronic devices are popular, including smartphones, tablet computers (PCs), portable media players (PMPs), personal digital assistants (PDAs), laptops, wearable devices (such as watches), and head-mounted displays (HMDs).
[0003] Such electronic devices are generally equipped with communication circuits and antennas to communicate with external devices located far away, or to establish short-range communication networks (eg, Wi-Fi, Bluetooth, infrared, and ZigBee networks) for communicating with external devices located nearby.
[0004] In order to establish a connection with an external device located closely, the electronic device should perform a complicated process of activating a connection function, searching for nearby external devices, and selecting and connecting one of the found devices.
[0005] In this regard, technology that uses a unique electromagnetic signal (eg, information, waveform, and frequency) emitted from the external device to identify the external device is emerging as an alternative method.
[0006] However, when these methods are used, the electronic device may continue searching even in an environment where no external electronic device is available, which requires processing noise signals caused by environmental noise (or surrounding noise) and unnecessary consumption of resources. Performing such a fruitless device search operation in an environment where no external device is nearby may cause current waste. Summary of the invention
[0007] Technical issues
[0008] Various embodiments disclose a method and apparatus for protecting an electronic device including an electromagnetic (EM) sensor module from unnecessary system resource occupation and current consumption by filtering out invalid electromagnetic detection data caused by noise signals.
[0009] Solution to the problem
[0010] According to an embodiment of the present disclosure, an electronic device includes an electromagnetic (EM) sensor module, an antenna module electrically connected to the EM sensor module, a memory operably connected to the EM sensor module, and a processor operably connected to the EM sensor module. The EM sensor module is configured to detect electromagnetic signals around the electronic device using the antenna module, determine whether the electromagnetic signal is a valid signal from at least one external electronic device, and send electromagnetic detection data related to all or at least a portion of the electromagnetic signal to the processor based on the electromagnetic signal being a valid signal.
[0011] According to an embodiment of the present disclosure, a method for controlling an electronic device including an EM sensor module includes using an antenna module to detect electromagnetic signals around the electronic device, determining whether the electromagnetic signal is a valid signal from at least one external electronic device, and based on the electromagnetic signal being a valid signal, sending electromagnetic detection data related to all or at least a portion of the electromagnetic signal to a processor.
[0012] According to an embodiment of the present disclosure, an electronic device includes an EM sensor module, an antenna module electrically connected to the EM sensor module, a memory operably connected to the EM sensor module, and a processor operably connected to the EM sensor module. The EM sensor module is configured to detect electromagnetic signals around the electronic device using the antenna module, determine whether the electromagnetic signal is a valid signal from at least one external electronic device, and based on the electromagnetic signal being a valid signal, send electromagnetic detection data related to all or at least a portion of the electromagnetic signal to a server, receive an identification result about the electromagnetic signal from the server, and provide the identification result about the electromagnetic signal to the processor.
[0013] Before proceeding to the following detailed description, it may be helpful to set forth definitions of certain words and phrases used throughout this patent document: the terms "include" and "comprising" and their derivatives mean inclusion without limitation; the term "or" is inclusive, meaning and / or; the phrases "associated with" and "associated with" and their derivatives may mean including, included, interconnected with, containing, contained within, connected to or connected with, coupled to or coupled with, communicable with, cooperating with, interleaved with, juxtaposed, proximate, bound to or bound with, having characteristics thereof, etc.; and the term "controller" means any device, system, or portion thereof that controls at least one operation, such a device may be implemented in hardware, firmware, or software, or some combination of at least two of them. It should be noted that the functionality associated with any particular controller may be centralized or distributed, whether locally or remotely.
[0014] In addition, the various functions described below can be implemented or supported by one or more computer programs, each of which is formed by a computer-readable program code and contained in a computer-readable medium. The terms "application" and "program" refer to one or more computer programs, software components, instruction sets, processes, functions, objects, classes, instances, related data or parts thereof suitable for implementation in a suitable computer-readable program code. The phrase "computer-readable program code" includes any type of computer code, including source code, object code and executable code. The phrase "computer-readable medium" includes any type of medium that can be accessed by a computer, such as a read-only memory (ROM), a random access memory (RAM), a hard drive, a compact disc (CD), a digital video disc (DVD) or any other type of memory. "Non-transitory" computer-readable media does not include wired, wireless, optical or other communication links that transmit temporary electrical signals or other signals. Non-transitory computer-readable media include media in which data can be permanently stored and media in which data can be stored and then rewritten, such as rewritable optical discs or erasable storage devices.
[0015] Definitions for certain words and phrases are provided in this patent document, those of ordinary skill in the art should understand that in many, if not most instances, such definitions apply to prior, as well as future uses of such defined words and phrases.
[0016] Beneficial effects of the present invention
[0017] Various embodiments disclose a method and apparatus for improving overall system efficiency associated with system resources and current consumption, such that an electronic device including an EM sensor module performs post-processing (or analysis) only on valid data. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] For a more complete understanding of the present disclosure and its advantages, reference is now made to the following description taken in conjunction with the accompanying drawings, wherein like reference numerals represent like parts:
[0019] Figure 1 is a block diagram illustrating an electronic device in a network environment according to various embodiments;
[0020] FIG. 2A is a block diagram showing a configuration of an electronic device according to various embodiments;
[0021] FIG2B illustrates a block diagram of a configuration of an EM sensor module according to various embodiments;
[0022] Figure 3 A block diagram showing a configuration of an MCU according to various embodiments;
[0023] Figure 4A block diagram showing a configuration of an electromagnetic detection system according to various embodiments;
[0024] Figure 5 A diagram showing a process for identifying external electronic devices around an electronic device according to various embodiments;
[0025] Figure 6 A flow chart illustrating the operation of the EM sensor module 240 of the electronic device 101 according to various embodiments;
[0026] 7A and 7B illustrate a flow chart of the operation of the MCU 245 of the EM sensor module according to various embodiments;
[0027] Figure 8 A flow chart illustrating a method for verifying the validity of an electromagnetic signal according to various embodiments;
[0028] Fig. 9 A flow chart illustrating a method for verifying the validity of an electromagnetic signal according to various embodiments;
[0029] 10A and 10B show diagrams for explaining environment groups according to various embodiments;
[0030] Fig.11 A flowchart showing a method for verifying the validity of an electromagnetic signal according to various embodiments of the present disclosure; and
[0031] 12A , 12B, 12C, and 12D show diagrams for explaining methods for determining a threshold and verifying a valid signal according to various embodiments.
[0032] Best Mode for Carrying Out the Invention
[0033] Discussed below Figure 1 to Figure 1 2D and the various embodiments used to describe the principles of the present disclosure in this patent document are merely exemplary and should not be interpreted in any way to limit the scope of the present disclosure. Those skilled in the art will understand that the principles of the present disclosure can be implemented in any appropriately arranged system or device.
[0034] Figure 1 1 is a block diagram illustrating an electronic device 101 in a network environment 100 according to various embodiments. Figure 1, the electronic device 101 in the network environment 100 may communicate with the electronic device 102 via the first network 198 (e.g., a short-range wireless communication network), or communicate with the electronic device 104 or the server 108 via the second network 199 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 via the server 108. According to an embodiment, the electronic device 101 may include a processor 120, a memory 130, an input device 150, a sound output device 155, a display device 160, an audio module 170, a sensor module 176, an interface 177, a haptic module 179, a camera module 180, a power management module 188, a battery 189, a communication module 190, a user identification module (SIM) 196, or an antenna module 197. In some embodiments, at least one of the components (e.g., the display device 160 or the camera module 180) may be omitted from the electronic device 101, or one or more other components may be added to the electronic device 101. In some embodiments, some of the components may be implemented as a single integrated circuit.For example, the sensor module 176 (eg, a fingerprint sensor, an iris sensor, or an illumination sensor) may be implemented to be embedded in the display device 160 (eg, a display).
[0035] The processor 120 may run, for example, software (e.g., program 140) to control at least one other component (e.g., hardware component or software component) of the electronic device 101 connected to the processor 120, and may perform various data processing or calculations. According to one embodiment, as at least part of the data processing or calculation, the processor 120 may load a command or data received from another component (e.g., sensor module 176 or communication module 190) into the volatile memory 132, process the command or data stored in the volatile memory 132, and store the resultant data in the non-volatile memory 134. According to an embodiment, the processor 120 may include a main processor 121 (e.g., a central processing unit (CPU) or an application processor (AP)) and an auxiliary processor 123 (e.g., a graphics processing unit (GPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is independent of or combined with the main processor 121 in operation. Additionally or alternatively, the auxiliary processor 123 may be adapted to consume less power than the main processor 121, or adapted to be specifically used for a specified function. The auxiliary processor 123 may be implemented separately from the main processor 121 , or as part of the main processor 121 .
[0036] When the main processor 121 is in an inactive (e.g., sleep) state, the auxiliary processor 123 may control at least some of the functions or states related to at least one component (e.g., display device 160, sensor module 176, or communication module 190) among the components of the electronic device 101 (not the main processor 121), or when the main processor 121 is in an active state (e.g., running an application), the auxiliary processor 123 may control at least some of the functions or states related to at least one component (e.g., display device 160, sensor module 176, or communication module 190) among the components of the electronic device 101 together with the main processor 121. According to an embodiment, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., camera module 180 or communication module 190) that is functionally related to the auxiliary processor 123.
[0037] The memory 130 may store various data used by at least one component of the electronic device 101 (e.g., the processor 120 or the sensor module 176). The various data may include, for example, software (e.g., the program 140) and input data or output data for commands related thereto. The memory 130 may include a volatile memory 132 or a nonvolatile memory 134.
[0038] The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system (OS) 142 , middleware 144 , or applications 146 .
[0039] The input device 150 may receive commands or data from outside the electronic device 101 (e.g., a user) to be used by other components of the electronic device 101 (e.g., the processor 120). The input device 150 may include, for example, a microphone, a mouse, a keyboard, or a digital pen (e.g., a stylus).
[0040] The sound output device 155 can output a sound signal to the outside of the electronic device 101. The sound output device 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or playing records, and the receiver can be used for incoming calls. Depending on the embodiment, the receiver can be implemented as a separate part from the speaker, or as a part of the speaker.
[0041] The display device 160 may visually provide information to the outside of the electronic device 101 (e.g., a user). The display device 160 may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling a corresponding one of the display, the holographic device, and the projector. According to an embodiment, the display device 160 may include a touch circuit adapted to detect a touch or a sensor circuit (e.g., a pressure sensor) adapted to measure the strength of a force caused by a touch.
[0042] The audio module 170 may convert sound into an electrical signal, or vice versa. According to an embodiment, the audio module 170 may obtain sound via the input device 150, or output sound via the sound output device 155 or an earphone of an external electronic device (e.g., electronic device 102) directly (e.g., wired) or wirelessly connected to the electronic device 101.
[0043] The sensor module 176 may detect an operating state (e.g., power or temperature) of the electronic device 101 or an environmental state (e.g., a state of a user) outside the electronic device 101, and then generate an electrical signal or data value corresponding to the detected state. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illumination sensor.
[0044] The interface 177 may support one or more specific protocols to be used to connect the electronic device 101 directly (e.g., wired) or wirelessly to an external electronic device (e.g., the electronic device 102). According to an embodiment, the interface 177 may include, for example, a high-definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.
[0045] The connection end 178 may include a connector, wherein the electronic device 101 can be physically connected to an external electronic device (e.g., the electronic device 102) via the connector. According to an embodiment, the connection end 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0046] The haptic module 179 may convert the electrical signal into mechanical stimulation (eg, vibration or motion) or electrical stimulation that can be recognized by the user via his sense of touch or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.
[0047] The camera module 180 may capture still images or moving images. According to an embodiment, the camera module 180 may include one or more lenses, an image sensor, an image signal processor, or a flash.
[0048] The power management module 188 may manage power supply to the electronic device 101. According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).
[0049] The battery 189 may power at least one component of the electronic device 101. According to an embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0050] The communication module 190 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108), and perform communication via the established communication channel. The communication module 190 may include one or more communication processors capable of operating independently from the processor 120 (e.g., an application processor (AP)) and supporting direct (e.g., wired) communication or wireless communication. According to an embodiment, the communication module 190 may include a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules can communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wireless Fidelity (Wi-Fi) Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a cellular network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules can be implemented as a single component (e.g., a single chip), or these various types of communication modules can be implemented as multiple components separated from each other (e.g., multiple chips). The wireless communication module 192 can identify and authenticate the electronic device 101 in a communication network (such as the first network 198 or the second network 199) using user information (e.g., an International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196.
[0051] The antenna module 197 may transmit or receive a signal or power to or from the outside of the electronic device 101 (e.g., an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a radiating element formed of a conductive material or a conductive pattern formed in or on a substrate (e.g., a PCB). According to an embodiment, the antenna module 197 may include a plurality of antennas. In this case, at least one antenna suitable for a communication scheme used in a communication network (such as the first network 198 or the second network 199) may be selected from the plurality of antennas by, for example, the communication module 190 (e.g., the wireless communication module 192). A signal or power may then be transmitted or received between the communication module 190 and the external electronic device via the selected at least one antenna. According to an embodiment, another component (e.g., a radio frequency integrated circuit (RFIC)) other than the radiating element may be additionally formed as a part of the antenna module 197.
[0052] At least some of the above components may be connected to each other via an inter-peripheral communication scheme (e.g., a bus, a general purpose input output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)) and communicatively transmit signals (e.g., commands or data) therebetween.
[0053] According to an embodiment, a command or data may be sent or received between the electronic device 101 and the external electronic device 104 via the server 108 connected to the second network 199. Each of the electronic device 102 and the electronic device 104 may be a device of the same type as the electronic device 101, or a device of a different type from the electronic device 101. According to an embodiment, all or some operations to be executed in the electronic device 101 may be executed in one or more of the external electronic device 102, the external electronic device 104, or the server 108. For example, if the electronic device 101 should automatically execute a function or service or should execute a function or service in response to a request from a user or another device, the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service instead of executing the function or service, or the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service in addition to executing the function or service. The one or more external electronic devices that receive the request may execute the requested at least part of the function or service, or execute another function or another service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may provide the result as at least a partial reply to the request with or without further processing the result. To this end, for example, cloud computing technology, distributed computing technology, or client-server computing technology may be used.
[0054] FIG. 2A is a block diagram showing a configuration of an electronic device 101 according to various embodiments.
[0055] 2A , the electronic device 101 may include a processor 120 , a communication module 190 , an antenna module 197 , an EM sensor module 240 (eg, Figure 1 The electronic device 101 may include a sensor module 176 in the electronic device 101 and a memory 130. According to an embodiment, the electronic device 101 may be configured to omit at least one of the aforementioned components or to add one or more other components.
[0056] According to various embodiments, the communication module 190 may be configured to communicate between the electronic device 101 and an external electronic device (eg, Figure 1 A wired or wireless communication channel is established between the electronic device 102, the electronic device 104 or the server 108), and communication is performed on the established communication channel using the antenna module 197.
[0057] According to various embodiments, the antenna module 197 may be configured to detect electromagnetic signals in a predetermined frequency band. The antenna module 197 may include an antenna dedicated to detecting electromagnetic signals, and it may be installed on at least a portion of the interior and / or exterior (surface) of the electronic device 101. Without being limited thereto, a communication antenna may be used together with electromagnetic signal detection and for electromagnetic signal detection.
[0058] According to various embodiments, the EM sensor module 240 may detect a unique signal (or a unique electromagnetic signal) corresponding to electromagnetic interference generated by an external electronic device. The EM sensor module 240 may detect an external electronic device (e.g., Figure 1 102 in the electronic device 102, and provide the detected unique signal (or information) to the processor 120. According to an embodiment, the EM sensor module 240 may be implemented as a chip separate from the communication module 190, or as at least a part of the communication module 190. According to an embodiment, the EM sensor module 240 may be connected to the processor 120, and configured to receive an electromagnetic signal from an external electronic device and send the received electromagnetic signal to the processor 120. According to various embodiments, the EM sensor module 240 may be configured to analyze the electromagnetic signal received from the external electronic device, generate data related to the electromagnetic signal, and send the generated data to the processor 120.
[0059] According to various embodiments, the EM sensor module 240 may determine whether the electromagnetic signal satisfies a predetermined condition, and if so, transmit a wake-up signal to the processor 120 to wake up the processor 120. For example, when the processor 120 is operating in a deactivation mode (e.g., a sleep mode), the EM sensor module 240 may receive the electromagnetic signal through the antenna module 197, determine whether the electromagnetic signal is stronger than or exceeds a predetermined amount or has a frequency characteristic within a predetermined range, and transmit a wake-up signal to the processor as a result of the determination.
[0060] According to various embodiments, the memory 130 may be configured to perform machine learning on the unique electromagnetic signals of the external electronic device and store the relevant information in the form of a table. According to an embodiment, the memory 130 may reproduce each unique signal value for quick access by a corresponding program (or software or application) and store the values in the form of a lookup table. For example, the memory may store a lookup table that maps device types to waveforms.
[0061] According to various embodiments, the processor 120 may control the EM sensor module 240 to detect a unique electromagnetic signal emitted by an external electronic device. According to an embodiment, the processor 120 may control the electronic device 101 to enter a connectable state or transition to a connected state upon identifying the external electronic device, establish a connection with the external electronic device, and remotely control the external electronic device.
[0062] According to various embodiments, the processor 120 may compare the unique signal information (or unique electromagnetic signal) of the external electronic device received from the EM sensor module 240 with the information stored in the signal table (e.g., a lookup table). According to an embodiment, the processor 120 may display the unique signal information (or unique electromagnetic signal) of the external electronic device received from the EM sensor module 240 on a display (e.g., Figure 1 The information on the external electronic device identified based on the comparison result is displayed on the display device 160 in the display device 160. According to an embodiment, the processor 120 can automatically execute a predetermined function based on the information on the identified external electronic device. According to an embodiment, the processor 120 can activate the connection with the external electronic device through a radio communication module (e.g., a short-range wireless communication module) and convert the external electronic device to a controllable state. According to an embodiment, the processor 120 can execute at least one predetermined application based on the information on the identified external electronic device.
[0063] According to various embodiments, the processor 120 may filter out noise generated inside the electronic device 101. For example, to minimize input errors, the processor 120 may detect in-device noise generated by touch input on a touch screen and apply a compensation algorithm to an acquired signal (e.g., an electromagnetic signal). According to an alternative embodiment, the processor 120 may detect a distorted waveform for each hand-held behavior type and apply a compensation algorithm to the acquired signal according to the hand-held behavior type.
[0064] According to various embodiments, the processor 120 may compare and collect the measured electromagnetic signal values of the external electronic device and the stored unique signal information to continuously update the information. According to an embodiment, the collected information may be analyzed by big data analysis for compensating the electromagnetic signal or the unique signal information. Big data analysis may include regression analysis techniques, cluster analysis techniques, and association analysis techniques.
[0065] FIG. 2B shows a block diagram of a configuration of the EM sensor module 240 of FIG. 2A .
[0066] 2B , the EM sensor module 240 may include a transimpedance amplifier (TIA) 241, a bandpass filter (BPF) 242, a variable gain amplifier (VGA) 243, an analog-to-digital converter (ADC) 244, and a microcontroller unit (MCU) 245. According to an embodiment, the EM sensor module 240 may be configured to omit at least one of the aforementioned components or to add one or more other components.
[0067] According to various embodiments, the TIA 241 may amplify a predetermined frequency band (e.g., about 1 KHz to about 2 MHz) of an electromagnetic signal received by the antenna module 230. According to an embodiment, the BPF 242 may filter the amplified signal to generate a specific desired signal defining a characteristic pattern (e.g., a specific desired signal defining a characteristic). According to an embodiment, the VGA 243 may output a signal covering a predetermined gain range at a predetermined level so as to improve noise characteristics and external interference signal removal characteristics of the filtered signal. According to an embodiment, the ADC 244 may convert an analog signal output from the VGA 243 into a digital signal, which is output to the MCU 245.
[0068] According to various embodiments, the MCU 245 analyzes the digital signal and checks the validity of the electromagnetic signal received from the antenna module 230. The MCU 245 may be configured to send the digital signal to the processor 120 after checking the validity of the electromagnetic signal. The processor 120 may compare the digital signal with a signal stored in a signal table stored in the electronic device 101 to identify the external electronic device. According to an embodiment, the MCU 245 may identify the external electronic device through such signal comparison. In this case, the MCU 245 may send information about the identified external electronic device to the processor 120.
[0069] According to various embodiments, the components of the EM sensor module 240 may be arranged in a different order or in a different configuration. For example, the EM sensor module 240 may not only operate as an independent sensor or module, but may also be implemented in whole or in part as an external module and or system circuit block.
[0070] According to various embodiments of the present disclosure, the electronic device 101 may include an EM sensor module 240, an antenna module 197 electrically connected to the EM sensor module 240, a memory 130 operably connected to the EM sensor module 240, and a processor 120 operably connected to the EM sensor module. The EM sensor module 240 may be configured to detect electromagnetic signals around the electronic device through the antenna module 197, determine whether the electromagnetic signal is a valid signal transmitted by at least one external electronic device, and if the electromagnetic signal is a valid signal, transmit electromagnetic detection data related to all or at least a portion of the electromagnetic signal to the processor 120.
[0071] According to various embodiments of the present disclosure, the electromagnetic detection data of the electronic device 101 may be time domain data generated by processing electromagnetic signals, or frequency domain data acquired by performing a fast Fourier transform (FFT) on the time domain data.
[0072] According to various embodiments of the present disclosure, the EM sensor module 240 of the electronic device 101 may be configured to send a wake-up signal for waking up the processor 120 and electromagnetic detection data if the electromagnetic signal is a valid signal.
[0073] According to various embodiments of the present disclosure, the EM sensor module 240 of the electronic device 101 may be configured to acquire normalized data by applying a predetermined normalization function to electromagnetic detection data, compare the normalized data with a predetermined threshold, and determine whether the electromagnetic signal is a valid signal sent by at least one external electronic device based on a result of the comparison.
[0074] According to various embodiments of the present disclosure, the EM sensor module 240 of the electronic device 101 may be configured to determine that the electromagnetic signal is a valid signal based on normalized data greater than a predetermined threshold.
[0075] According to various embodiments of the present disclosure, the EM sensor module 240 of the electronic device 101 may be configured to acquire at least two normalized data by applying at least two predetermined normalization functions to the electromagnetic detection data, compare the at least two normalized data with corresponding thresholds, and determine whether the electromagnetic signal is a valid signal sent by at least one external electronic device based on a result of the comparison.
[0076] According to various embodiments of the present disclosure, a predetermined threshold may define a boundary line of an environment group.
[0077] According to various embodiments of the present disclosure, the EM sensor module 240 of the electronic device 101 may be configured to segment the electromagnetic detection data in predetermined frequency interval units, compare each segment of the segmented electromagnetic detection data with each corresponding threshold value, and determine whether the electromagnetic signal is a value signal sent by at least one electronic device based on the comparison result.
[0078] According to various embodiments of the present disclosure, the EM sensor module 240 of the electronic device 101 may be configured to determine that the electromagnetic signal is a valid signal based on at least one of the segmented electromagnetic detection data being greater than a corresponding threshold value.
[0079] According to various embodiments of the present disclosure, the electronic device 101 may be configured to activate the EM sensor module 240 based on a state of the electronic device or a predetermined condition related to the electronic device.
[0080] According to various embodiments of the present disclosure, the electronic device 101 may include an EM sensor module 240, an antenna module 197 electrically connected to the EM sensor module, a memory 130 operably connected to the EM sensor module 240, and a processor 120 operably connected to the EM sensor module. The EM sensor module 240 may be configured to detect electromagnetic signals around the electronic device through the antenna module 197, determine whether the electromagnetic signal is a valid signal sent by an external electronic device, send electromagnetic data related to all or at least a portion of the electromagnetic signal to the server 108 based on the electromagnetic signal being a valid signal, receive a recognition result of the electromagnetic signal from the server 108, and send the recognition result of the electromagnetic signal to the processor 120.
[0081] Figure 3 A block diagram showing the configuration of the MCU 245 of FIG. 2B .
[0082] According to various embodiments, the MCU 245 may process the digital signal output from the ADC 244 to generate electromagnetic detection data. For example, the MCU 245 may generate electromagnetic detection data by applying a filtering algorithm 310 (e.g., a digital filter) and / or a signal processing algorithm 320 (e.g., windowing) to the digital signal received from the ADC 244. Without limitation, the MCU 245 may send the digital signal received from the ADC 244 to a high-level system without applying any processing thereto.
[0083] According to an embodiment, MCU 245 converts the time domain electromagnetic detection data into frequency domain electromagnetic detection data for spectrum analysis. Without limitation, MCU 245 may send the time domain electromagnetic data to a higher level system.
[0084] According to an embodiment, MCU 245 may perform fast FFT 330 on the time-domain electromagnetic detection data to generate frequency-domain electromagnetic data. According to an embodiment, FFT for converting the time-domain electromagnetic detection data into frequency-domain electromagnetic data may be represented by Equation 1.
[0085] Equation 1
[0086]
[0087] In this disclosure, for ease of explanation, time domain electromagnetic detection data is referred to as analog-to-digital conversion (ADC) data and frequency domain electromagnetic detection data is referred to as power spectral density (PSD) data. EM sensor module 240 can perform various operations using ADC data and / or PSD data.
[0088] According to various embodiments, MCU 245 may perform various operations in different orders and / or different ways. MCU 245 may also perform operations in whole or in part in cooperation with another processor (e.g., processor 120) or independently. For example, at least one of the GPU, MPU, CPU, or AP of electronic device 101 may perform all or some operations of MCU 245.
[0089] Figure 4 A block diagram illustrating a configuration of an electromagnetic detection system according to various embodiments is shown.
[0090] According to various embodiments, the electromagnetic detection system may include a server 108 and an electronic device 101. According to an embodiment, the electromagnetic detection system may be configured to omit at least one of the aforementioned components or to add one or more other components.
[0091] According to various embodiments, electromagnetic detection data output by various electronic devices can be used by a machine learning engine to create a learning model. For example, electromagnetic detection data output by various electronic devices can be used to classify, determine and or identify electronic devices that emit electromagnetic signals.
[0092] According to various embodiments, the server 108 (eg, a cloud server) may include a sensor data database (DB) (eg, a raw data DB), a preprocessor 412 , a machine learning engine 413 , and a model DB 414 .
[0093] According to an embodiment, the sensor data DB 411 may store a unique electromagnetic signal emitted by an electronic device. According to an embodiment, the preprocessor 412 may perform preprocessing to convert the unique electromagnetic signal stored in the sensor data database into a format suitable for machine learning, and output the preprocessed signal to the machine learning engine 413. According to an embodiment, the machine learning engine 413 may generate learning module data, which includes information about the unique electromagnetic signal received from the preprocessor 412 and or the unique signal of a predetermined external electronic device. According to an embodiment, the model DB 414 may store learning model data. The model DB 414 may regenerate specific values corresponding to the unique signal and store them in the form of a lookup table for quick access to the corresponding program.
[0094] According to various embodiments, the server 108 may cooperate with portable communication devices (eg, smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, and electronic devices to perform the aforementioned operations in whole or in part.
[0095] According to various embodiments, the electronic device 101 may include a memory 130, a processor 120, and an EM sensor module 240. According to an embodiment, the electronic device 101 may be configured to omit at least one of the aforementioned components or to add one or more other components.
[0096] According to various embodiments, the electronic device 101 may download the learning model data stored in the model DB 414 of the server 108 periodically or in an on-demand manner and store the downloaded data in the memory 130 .
[0097] According to various embodiments, the processor 120 may include a preprocessor 421 and a classifier 422. According to an embodiment, the preprocessor 421 may perform preprocessing to convert electromagnetic detection data received from the EM sensor module 240 into a format suitable for machine learning, and output the converted electromagnetic detection data to the classifier 422. The classifier 422 may compare the electromagnetic detection data with model data stored in the memory 130 of the electronic device 101 to retrieve a model with a similar waveform.
[0098] According to an embodiment, the classifier 422 may output a score (Gaussian mixture model (GMM) score) table showing the similarity between the electromagnetic detection data received from the external electronic device and the model stored in the memory 130. For example, assuming that the memory 130 of the electronic device 101 stores model data of a television (TV), a laptop, a phone, and a smart watch, if the user brings the electronic device 101 near the TV, the classifier 422 may display a score table with a TV score of 5.2, a laptop score of 1.5, a phone score of 0.8, and a smart watch score of 0.4. In this case, because the TV has the highest score, the processor 120 may identify the detected external electronic device as a TV. According to an embodiment, the electronic device 101 may execute a function corresponding to the identified external electronic device to provide the user with various convenient functions.
[0099] Figure 5 A diagram illustrating a process for identifying external electronic devices around an electronic device according to various embodiments.
[0100] refer to Figure 5 , there may be a plurality of external electronic devices 510, 520, 530, and 540 (eg, Figure 1102 and 104 in the external electronic devices 510, 520, 530, and 540). For example, the external electronic devices 510, 520, 530, and 540 may include a television, a refrigerator, a printer, and a Bluetooth speaker. According to an embodiment, the external electronic devices 510, 520, 530, and 540 may each include various subcomponents that transmit electromagnetic interference as electromagnetic signals. For example, the external electronic devices 510, 520, 530, and 540 may transmit a unique signal in a predetermined frequency band (e.g., about 1 KHz to about 2 MHz).
[0101] According to various embodiments, if the electronic device 101 approaches one of the external electronic devices 510, 520, 530, and 540, it can detect a unique signal from the main electromagnetic interference through the EM sensor module 240, identify or classify the corresponding external electronic device based on the unique signal, and display information on the identified external electronic device. According to an embodiment, information about the identified external electronic device can be displayed on a display of the electronic device 101 (e.g., Figure 1 Without being limited thereto, the information about the identified external electronic device may be output in an audio format.
[0102] According to various embodiments, the electronic device 101 may include a memory 130 that stores model data (e.g., a lookup table) including unique signals corresponding to the external electronic devices 510, 520, 530, and 540. Without being limited thereto, the model data may be stored in an external server 108 that can communicate with the electronic device 101 through a network. The electronic device 101 may analyze the electromagnetic interference signal of the external electronic device identified through communication with the server 108. For example, the electronic device 101 may send the detected signal information to the server 108, and receive the identity information of the external electronic device from the server 108.
[0103] According to various embodiments, the electronic device 101 may execute a predetermined application based on the identity information of the external electronic device. For example, if the external electronic device is a television, the electronic device 101 may automatically execute a remote control application and simultaneously activate a connection to the television. According to various embodiments, the user may put the external electronic device into a standby mode, in which the user may control the external electronic device via the electronic device 101 simply by bringing the electronic device 101 near the external electronic device, which improves user convenience.
[0104] Figure 6 A flow chart illustrating the operation of the EM sensor module 240 of the electronic device 101 according to various embodiments.
[0105] refer to Figure 6In step 610 , the EM sensor module 240 may detect electromagnetic signals around the electronic device 101 through the antenna module 197 .
[0106] For example, if the user brings the electronic device 101 including the EM sensor module 240 near (or into contact with) at least one external electronic device, the EM sensor module 240 inside the electronic device 101 can detect an electromagnetic signal emitted from the external electronic device through the antenna module 197. According to an embodiment, the EM sensor module 240 can detect an electromagnetic signal (e.g., a noise signal) caused by an environmental noise component even in an environment where there are no external electronic devices around.
[0107] According to an embodiment, the EM sensor module 240 may be activated based on the state of the electronic device 101 or a predetermined condition related to the electronic device. For example, whether the electronic device 101 is in a locked state, a display (eg, Figure 1 Whether the display device 160 in the electronic device 101 is on / off, or whether the data obtained by the sensor module 176 can determine whether to activate the EM sensor module 240. For example, the EM sensor module 240 can be configured to be activated only when the electronic device 101 is unlocked or the display is turned on, thereby reducing unnecessary system load and current consumption.
[0108] In one embodiment, the EM sensor module 240 may be activated based on user input with a button or touch gesture designated for activating the EM sensor module 240 or based on the execution of a designated application.
[0109] In step 620, the EM sensor module 240 may determine whether the electromagnetic signal is a valid signal emitted by at least one external electronic device (or verify the validity of the electromagnetic signal). For example, the EM sensor module 240 may filter out electromagnetic signals (e.g., noise signals) caused by environmental noise components as invalid data. According to an embodiment, the EM sensor module 240 may determine whether the detected electromagnetic signal satisfies a predetermined condition to verify the validity of the electromagnetic signal. For example, the EM sensor module 240 may apply a normalization function to the detected electromagnetic signal to generate normalized data, and verify the validity of the electromagnetic signal with the normalized data. According to an embodiment, the EM sensor module 240 may compare the normalized data with a predetermined threshold value, and verify the validity of the electromagnetic signal based on the result of the comparison.
[0110] If the electromagnetic signal is a valid signal, the EM sensor module 240 may send electromagnetic detection data associated with all or at least a portion of the electromagnetic signal to the processor 120 at step 630 .
[0111] According to various embodiments, the EM sensor module 240 may analyze the electromagnetic signal received from the external electronic device, generate electromagnetic detection data related to the electromagnetic signal, and transmit the electromagnetic detection data to the processor 120. According to an embodiment, the electromagnetic detection sensor module 240 may transmit a wake-up signal for waking up the processor together with the electromagnetic detection data to the processor 120. According to an embodiment, the EM sensor module 240 may transmit the electromagnetic signal received from the external electronic device to the processor without being processed.
[0112] According to various embodiments of the present disclosure, a method for controlling an electronic device 101 including an EM sensor module 240 may include detecting an electromagnetic signal around the electronic device 101 through an antenna module 197, determining in step 620 whether the electromagnetic signal is a valid signal from at least one external electronic device, and if the electromagnetic signal is a valid signal, sending electromagnetic detection data related to all or part of the electromagnetic signal from the EM sensor module 240 to the processor 120.
[0113] According to various embodiments of the present disclosure, a method for controlling an electronic device 101 including an EM sensor module 240 may include sending a wakeup signal for waking up the processor 120 and electromagnetic detection data from the EM sensor module 240 to the processor 120 if the electromagnetic signal is a valid signal.
[0114] 7A and 7B illustrate flow charts of operations of the MCU 245 of the EM sensor module according to various embodiments.
[0115] 7A , the microcontroller of the EM sensor module 240 may use the time domain electromagnetic detection data (eg, ADC data) to verify the validity of the electromagnetic signal.
[0116] At step 710, MCU 245 may process the digital signal received from ADC 244 to generate ADC data. For example, ADC data may be generated and / or obtained by applying filtering algorithm 310 (eg, digital filter) and / or signal processing algorithm 320 (eg, windowing) to the digital signal.
[0117] In step 711, the MCU 245 may determine whether the ADC data satisfies a predetermined condition to verify the validity of the signal from the external electronic device. For example, the validity of the electromagnetic signal may be verified by comparing the valid value of the ADC data with a predetermined threshold.
[0118] If it is determined at step 711 that the ADC data is valid, the process proceeds to step 712. At step 712, the microcontroller may use the ADC data to obtain PSD data. For example, the fast FFT 330 may be applied to the ADC data to generate frequency domain data.
[0119] At step 713, the MCU 245 may simultaneously output the converted PSD data and issue an interrupt to wake up the higher-level system. For example, the MCU 245 may execute the definition (e.g., protocol) agreed in software by operating a designated hardware interrupt pin (e.g., processor 120) instead of the EM sensor module or using a communication line for outputting data.
[0120] If it is determined at step 711 that the ADC data is invalid, the process proceeds to step 714. At step 714, the MCU 245 may control the high-level system to remain in or transition to a pre-configured mode, such as an idle mode and a sleep mode.
[0121] 7B , the MCU 245 of the EM sensor module 240 may use frequency domain electromagnetic detection data (eg, PSD data) to verify the validity of the electromagnetic signal.
[0122] At step 720, MCU 245 may process the digital signal received from ADC 244 to generate ADC data. For example, ADC data may be generated and / or obtained by applying filtering algorithm 310 (eg, digital filter) and / or signal processing algorithm 320 (eg, windowing) to the digital signal.
[0123] At step 721, the MCU 245 may use the ADC data to obtain PSD data. For example, the MCU 245 may perform a fast FFT 330 on the ADC data to generate PSD data.
[0124] In step 722, the MCU 245 may determine whether the converted PSD data satisfies a predetermined condition to verify the validity of the signal from the external electronic device. For example, the validity of the signal may be verified by comparing the dBV (dB) value (e.g., average dBV volts (dBV)) of the PSD data with a predetermined threshold.
[0125] If it is determined in step 722 that the PSD data is valid, the process proceeds to step 723. In step 723, the MCU 245 may simultaneously output the converted PSD data and issue an interrupt to wake up the higher-level system.
[0126] If it is determined in step 722 that the PSD data is invalid, the process proceeds to step 724. In step 724, the MCU 245 may control the high-level system to maintain or transition to a pre-configured mode, such as an idle mode and a sleep mode.
[0127] Figure 8 A flow chart of a method for verifying the validity of an electromagnetic signal according to various embodiments is shown. Figure 8 Can be Figure 6An embodiment of step 620.
[0128] refer to Figure 8 , the EM sensor module 240 of the electronic device 101 may apply a specified normalization function (eg, probability statistical variables and / or physical variables) to the electromagnetic detection data to obtain normalized data.
[0129] The specified normalization function may include at least one of a sum function, an average function, a maximum (max) function, a minimum (min) function, a standard deviation (Std) function, a skewness function, a kurtosis function, or a root mean square (RMS) function. According to various embodiments, the normalization function (e.g., probability statistical variables and / or physical variables) is not limited to the aforementioned functions. For example, the EM sensor module 240 may be configured to obtain an effective value of ADC data or an average value of PSD data.
[0130] At step 820 , EM sensor module 24 may compare the normalized data to a predetermined threshold.
[0131] According to various embodiments, the electronic device 101 may detect the presence of various external electronic devices (eg, Figure 1 The electromagnetic signals output by the electronic devices 102 and 104 in the embodiment of the present invention are detected, and big data analysis is performed on the signals to specify threshold values. Table 1 shows the data obtained as the effective value of ADC data and the average value of PSD data after detecting the electromagnetic signals output by various electronic devices under various conditions.
[0132] [Table 1]
[0133] Distance(cm) 0 0.5 1 2 3 5 Environmental Average value of PSD data (dBV) 52.44 33.88 32.88 31.73 30.83 30.23 27.76 Effective value of ADC data (V) 4.60 0.98 1.10 1.04 1.03 1.10 1.00
[0134] Referring to Table 1, it is shown that when the electronic device 101 is in contact with various external electronic devices (e.g., a distance of about 0 cm), the average value of the PSD data detected by the EM sensor module 240 of the electronic device 101 is about 52.44 dBV. The results show that in an environment without a nearby external electronic device (e.g., a surrounding environment), the average value of the PSD data caused by the environmental noise (or ambient noise) component is about 27.76 dBV. The electronic device 101 can specify a value in the range from about 27.76 dBV to about 52.44 dBV as a threshold value for the average value of the PSD data using the data. For example, the electronic device 101 can set the threshold value to about 30 dBV. In this case, the EM sensor module 240 can detect the electromagnetic signal, obtain the average value of the corresponding PSD data, and determine whether the average value is equal to or greater than the specified value of about 30 dBV to verify the validity of the electromagnetic signal.
[0135] Referring to Table 1, it is shown that when the electronic device 101 is in contact with various external electronic devices (e.g., a distance of about 0 cm), the effective value of the analog-to-digital converter value detected by the EM sensor module 240 is about 4.60 V. The result shows that in an environment (e.g., surrounding environment) where there is no external electronic device nearby, the average value of the ADC data caused by the environmental noise (or ambient noise) component is about 1.00 V. The electronic device 101 can use this data to specify a value in the range of about 1.00 V to about 4.60 V as a threshold value of the effective value of the ADC data and verify the validity of the detected electromagnetic signal.
[0136] According to various embodiments, the specified threshold value may be stored in the memory 130 of the electronic device 101 or in an external server (eg, Figure 1 In the server 108).
[0137] In step 830 , the EM sensor module 230 may determine whether the electromagnetic signal is a valid signal from at least one external electronic device based on the result of the comparison.
[0138] According to an embodiment, the EM sensor module 240 may determine that the detected electromagnetic device is a valid signal based on the normalized data being greater than a predetermined threshold. If the electromagnetic signal is determined to be a valid signal, the EM sensor module 240 may send the electromagnetic signal to an advanced system (e.g., the processor 120). If the normalized data is determined to be equal to or less than the predetermined threshold, the EM sensor module 240 may control the advanced system to maintain or switch to a preconfigured mode, such as an idle mode and a sleep mode.
[0139] According to various embodiments of the present disclosure, a method for controlling an electronic device 101 including an EM sensor module 240 may include determining whether an electromagnetic signal received from an external electronic device is a valid signal at step 620, and the determination at step 620 may include acquiring normalized data by applying a specified normalization function to the electromagnetic detection data at step 810 and comparing the normalized data with a predetermined threshold at step 820.
[0140] According to various embodiments of the present disclosure, a method for controlling an electronic device 101 including an EM sensor module 240 may include verifying, at the EM sensor module 240 , that an electromagnetic signal is valid based on normalized data greater than a specified threshold.
[0141] Fig. 9 A flow chart of a method for verifying the validity of an electromagnetic signal according to various embodiments is shown. Fig. 9 Can be Figure 6 An embodiment of step 620.
[0142] refer to Fig. 9 In step 910 , the EM sensor module 240 may acquire at least two normalized data by applying at least two normalization functions (eg, probability statistical variables and / or physical variables) to the electromagnetic detection data.
[0143] The specified normalization function may include at least one of a sum function, an average function, a maximum (max) function, a minimum (min) function, a standard deviation (Std) function, a skewness function, a kurtosis function, or an RMS function. According to various embodiments, the normalization function (e.g., probability statistical variables and / or physical variables) is not limited to the aforementioned functions.
[0144] In step 920 , the EM sensor module 240 may compare at least two normalized data with corresponding threshold values.
[0145] According to various embodiments, the electronic device 101 may continuously collect electromagnetic signals caused by environmental noise components and perform big data analysis to specify environmental groups. For example, the electronic device 101 may apply at least two specified normalization functions to signals collected in the surrounding environment and specify environmental groups of classified noise signals.
[0146] According to an embodiment, the specified threshold value may define a boundary line of the environment group.For example, the EM sensor module 240 may determine whether an electromagnetic signal received from the outside belongs to an environment group using at least two normalized data.
[0147] In step 930 , the EM sensor module 240 may determine whether the electromagnetic signal is a valid signal from at least one external electronic device based on the result of the comparison.
[0148] For example, if the detected electromagnetic signal does not belong to the specified environment group, the EM sensor module 240 may send electromagnetic detection data related to all or at least a portion of the electromagnetic signal to the advanced system (e.g., the processor 120). Meanwhile, if the detected electromagnetic signal belongs to the specified environment group, the EM sensor module 240 may control the advanced system to maintain or switch to a predetermined mode, such as an idle mode and a sleep mode.
[0149] According to various embodiments of the present disclosure, a method for controlling an electronic device 101 including an EM sensor module 240 may include determining whether an electromagnetic signal received from an external electronic device is a valid signal at step 620, and the determination at step 620 may include acquiring at least two normalized data by applying at least two corresponding specified normalization functions to the electromagnetic detection data at step 920, and comparing the at least two normalized data with a predetermined threshold at step 930.
[0150] According to various embodiments, the method for controlling the electronic device 101 including the EM sensor module 240 is characterized in that a designated threshold value defines a boundary line of an environment group.
[0151] 10A and 10B show diagrams for explaining environment groups according to various embodiments.
[0152] According to various embodiments, the environment group may be specified based on normalized data acquired using a normalization function (eg, probability statistical variables and or physical variables of a noise signal).
[0153] In the embodiment of Figure 10A, the specified environment group 1010 is represented in a two-dimensional graph, wherein the axis represents the standard deviation (e.g., Std axis) and the axis represents the average value (e.g., average power axis). According to an embodiment, Figure 10A is a diagram for classifying the execution results of the validity verification method based on two variables (e.g., average power (Avg) and standard deviation (Std)).
[0154] The electronic device 101 may apply at least two normalization functions to two noise signals collected in the surrounding environment and specify an environment group 1010 of dense noise signals.
[0155] According to various embodiments, the EM sensor module 240 may determine whether an electromagnetic signal detected using at least two normalized data belongs to a designated environment group 1010 .
[0156] For example, if the detected electromagnetic signal 1030 does not belong to the specified environment group 1010, the EM sensor module 240 may send electromagnetic detection data related to all or at least a portion of the electromagnetic signal 1030 to the high-level system (e.g., the processor 120). Meanwhile, if it is determined that the detected electromagnetic signal 1020 belongs to the specified environment group 1010, the EM sensor module 240 may control the high-level system to maintain or switch to a predetermined mode, such as an idle mode and a sleep mode.
[0157] 10B , the electronic device 101 may specify an environment group 1010 ′ using at least three variables. FIG10B is a diagram for classifying the execution results of the validity verification method based on three variables (eg, standard deviation (Std) value, skewness, and kurtosis).
[0158] For example, a three-dimensional graph may be used to specify the environment group 1010', the three-dimensional graph having an axis representing the standard deviation (e.g., Std axis), an axis representing the skewness (e.g., skewness axis), and an axis representing the kurtosis (e.g., kurtosis axis). In this case, the environment group 1010' may be represented by a three-dimensional or higher dimensional graph. For example, if it is determined that the detected electromagnetic signal 1030' does not belong to the environment group 1010', the EM sensor module 240 may determine that the electromagnetic signal 1030' is a valid signal. At the same time, if it is determined that the detected electromagnetic signal 1020' belongs to the environment group 1010', the EM sensor module 240 may determine that the electromagnetic signal 1020' is an invalid signal.
[0159] Fig.11 A flow chart of a method for verifying the validity of an electromagnetic signal according to various embodiments of the present disclosure is shown. Fig.11 Can be Figure 6 An embodiment of step 620.
[0160] Reference Fig.11 , the EM sensor module 240 may segment all or at least a portion of the electromagnetic detection data (e.g., PSD data) in predetermined frequency interval units. For example, in the electromagnetic detection data, the EM sensor module 240 may segment the data ranging from about 2 KHz to about 1 MHz at intervals of about 2 KHz to obtain a total of 499 data segments.
[0161] At step 1120 , the EM sensor module 240 may compare each electromagnetic detection data segment to a corresponding threshold value.
[0162] According to various embodiments, the electronic device 101 may download the threshold value from the server 108 periodically or on demand and store the downloaded threshold value in the memory 130. According to an embodiment, the processor 120 of the electronic device 101 may set the threshold value and store it in the memory 130.
[0163] According to various embodiments, the memory 130 may store thresholds corresponding to data segments obtained by segmenting in predetermined frequency interval units. For example, the memory 130 may store a first threshold corresponding to a range from about 2 KHz to about 4 KHz, a second threshold corresponding to a range from about 4 KHz to about 6 KHz, and an nth threshold (e.g., n=499) corresponding to a range from about 998 KHz to about 1 MHz.
[0164] According to various embodiments, the threshold value of each frequency interval can be determined based on the noise signal. For example, the electronic device 101 can collect noise signals in the surrounding environment and obtain electromagnetic detection data related to all or at least part of the noise signals. Next, the electronic device 101 can divide the electromagnetic detection data of the noise signal into data segments in predetermined frequency interval units and accumulate the noise signal. The electronic device 101 can use the electromagnetic detection data of the accumulated noise signal to determine the threshold value. For example, the electronic device 101 can obtain normalized data of the noise signal per frequency interval and determine the threshold value based on the normalized data. For example, the electronic device 101 can determine the maximum value, minimum value or average value of the noise signal in the corresponding frequency interval as the corresponding threshold value.
[0165] In step 1130 , the EM sensor module may determine whether the electromagnetic signal is a valid signal from at least one external electronic device based on the result of the comparison.
[0166] According to various embodiments, if the number of data whose normalized data value is greater than the threshold is determined to be greater than a predetermined number, the EM sensor module 240 may determine that the electromagnetic signal is a valid signal. For example, if at least one electromagnetic detection data segment has a normalized data value greater than the corresponding threshold, the EM sensor module 240 may determine that the electromagnetic signal is a valid signal and send electromagnetic detection data related to all or at least a portion of the electromagnetic signal to the high-level system (e.g., the processor 120). Meanwhile, if there is no electromagnetic detection data segment whose normalized data value is greater than the corresponding threshold, the EM sensor module may control the high-level system to maintain or switch to a predetermined mode, such as an idle mode and a sleep mode.
[0167] According to various embodiments, the electronic device may adjust the determined threshold value according to a predetermined rule or based on user input. For example, the electronic device may tune the threshold value by multiplying the threshold value by a tuning variable. For example, the threshold value may be multiplied by a value less than 1 to decrease, or multiplied by a value greater than 1 to increase.
[0168] According to various embodiments, a method for controlling an electronic device 101 including an EM sensor module 240 may include determining whether an electromagnetic signal received from an external electronic device is a valid signal at step 620, and the determination at step 620 may include segmenting electromagnetic detection data in predetermined frequency interval units at step 1110, and comparing the electromagnetic detection data segments with corresponding thresholds at step 1120.
[0169] According to various embodiments of the present disclosure, a method for controlling an electronic device 101 including an EM sensor module 240 may include determining that an electromagnetic signal is a valid signal based on at least one of the electromagnetic detection data segments being greater than a corresponding threshold.
[0170] According to various embodiments of the present disclosure, a method for controlling the electronic device 101 including the EM sensor module 240 is characterized by activating the EM sensor module 240 based on a state of the electronic device 101 or a predetermined condition related to the electronic device 101 .
[0171] 12A to 12D show diagrams for explaining a method of verifying a valid signal based on a threshold determined using a noise signal according to various embodiments.
[0172] 12A, the electronic device 101 may collect noise signals and obtain electromagnetic detection data (e.g., PSD data) related to all or at least part of the noise signals. Referring to FIG12A, the electronic device 101 may collect approximately 238 noise signals, convert the noise signals into electromagnetic detection data, and store the noise signals in a memory in an accumulated manner. According to an embodiment, the electronic device 101 may divide all or at least part of the electromagnetic detection data into predetermined frequency interval units, and store the electromagnetic detection data in a memory in an accumulated manner.
[0173] Referring to FIG12B , the electronic device may determine the threshold value using electromagnetic detection data of the cumulative noise signal. FIG12B shows an example of determining (calculating) the threshold value using a maximum value (e.g., a Max function) that can be obtained from the noise signal per frequency interval. Referring to FIG12B , since the noise signal in the frequency interval of about 500 KHz to about 502 KHz has a maximum level of about 78 dBV, a threshold value of 78 dBV is determined in the frequency interval of about 500 KHz to about 502 KHz.
[0174] FIG12C shows a threshold value obtained using a noise signal. The electronic device 101 can use the obtained threshold value to determine whether the detected electromagnetic signal is a valid signal from at least one external electronic device. For example, if at least one electromagnetic detection data segment of the detected electromagnetic signal is greater than the corresponding threshold value, the electromagnetic signal is verified as a valid signal. For example, given a threshold value of 78dBV in a frequency interval of about 500KHz to about 502KHz, if the electromagnetic detection data segment corresponding to the frequency interval from about 500KHz to about 502KHz is greater than the threshold value of 78dBV, the electromagnetic signal can be verified as a valid signal regardless of other frequency intervals.
[0175] FIG. 12D shows a situation where an electromagnetic signal emitted from a television is received together with a noise signal in the surrounding environment. According to an embodiment, one or more data segments of the electromagnetic detection data of the electromagnetic signal emitted from the television are greater than a corresponding threshold value. Based on this, the EM sensor module 240 can determine that the received electromagnetic signal is a valid signal. If the electromagnetic signal is verified as a valid signal, the EM sensor module 240 can send electromagnetic detection data related to all or at least a portion of the electromagnetic signal emitted from the television to the processor 120. At the same time, all electromagnetic detection data segments of the ambient noise signal cannot be greater than the corresponding threshold value. Therefore, the EM sensor module 240 can determine that the corresponding electromagnetic signal is an invalid signal, i.e., an ambient noise signal.
[0176] The electronic device according to various embodiments may be one of various types of electronic devices. The electronic device may include, for example, a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a household appliance. According to an embodiment of the present disclosure, the electronic device is not limited to those electronic devices described above.
[0177] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, but rather include various changes, equivalents, or alternative forms for the corresponding embodiments. For the description of the drawings, similar reference numerals may be used to refer to similar or related elements. It will be understood that a noun in the singular form corresponding to a term may include one or more things, unless the relevant context clearly indicates otherwise.
[0178] As used herein, each of phrases such as “A or B,” “at least one of A and B,” “at least one of A or B,” “A, B or C,” “at least one of A, B and C,” and “at least one of A, B or C” may include any one or all possible combinations of items listed together with a corresponding one of the plurality of phrases. As used herein, terms such as “first” and “second” or “first” and “second” may be used to simply distinguish a corresponding component from another component and do not limit the components in other aspects (e.g., importance or order). It will be understood that if an element (e.g., a first element) is referred to as being “combined with another element (e.g., the second element)”, “combined to another element (e.g., the second element)”, “connected with another element (e.g., the second element)”, or “connected to another element (e.g., the second element)” when the terms “operably” or “communicatively” are used or when the terms “operably” or “communicatively” are not used, it means that the element may be directly (e.g., wired) connected to the other element, wirelessly connected to the other element, or connected to the other element via a third element.
[0179] As used herein, the term "module" may include units implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "portion," or "circuit"). A module may be a single integrated component adapted to perform one or more functions or a minimum unit or portion of the single integrated component. For example, according to an embodiment, a module may be implemented in the form of an application specific integrated circuit (ASIC).
[0180] The various embodiments described herein may be implemented as software (e.g., program 140) including one or more instructions stored in a storage medium (e.g., internal memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). For example, under the control of a processor, a processor (e.g., processor 120) of the machine (e.g., electronic device 101) may call at least one of the one or more instructions stored in the storage medium and execute the at least one instruction with or without the use of one or more other components. This enables the machine to operate to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be run by an interpreter. A machine-readable storage medium may be provided in the form of a non-transitory storage medium. Among them, the term "non-transitory" only means that the storage medium is a tangible device and does not include a signal (e.g., an electromagnetic wave), but the term does not distinguish between data being semi-permanently stored in a storage medium and data being temporarily stored in a storage medium.
[0181] According to an embodiment, the method according to various embodiments of the present disclosure may be included and provided in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be released in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)), or may be downloaded via an application store (e.g., Play Store TM ) The computer program product may be published (e.g., downloaded or uploaded) online, or the computer program product may be distributed (e.g., downloaded or uploaded) directly between two user devices (e.g., smart phones). If published online, at least part of the computer program product may be temporarily generated, or at least part of the computer program product may be at least temporarily stored in a machine-readable storage medium (such as a memory of a manufacturer's server, an application store's server, or a forwarding server).
[0182] According to various embodiments, each component (e.g., module or program) in the above-mentioned components may include a single entity or multiple entities. According to various embodiments, one or more components in the above-mentioned components may be omitted, or one or more other components may be added. Alternatively or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform the one or more functions of each component in the multiple components in the same or similar manner as a corresponding component in the multiple components before integration. According to various embodiments, the operations performed by a module, program or another component may be performed sequentially, in parallel, repeatedly or in a heuristic manner, or one or more operations in the operations may be run or omitted in different orders, or one or more other operations may be added.
[0183] Although the present disclosure has been described with various embodiments, various changes and modifications may be suggested to one skilled in the art. The present disclosure is intended to encompass such changes and modifications as fall within the scope of the appended claims.
Claims
1. An electronic device, comprising: Electromagnetic EM sensor module; an antenna module electrically connected to the EM sensor module; a memory operably connected to the EM sensor module; as well as a processor operatively connected to the EM sensor module, Wherein, the EM sensor module is configured as follows: Using the antenna module to detect electromagnetic signals around the electronic device, acquiring at least two normalized data by applying at least two corresponding normalization functions to electromagnetic detection data generated based on the electromagnetic signal, comparing the at least two normalized data with predetermined thresholds respectively corresponding to the at least two normalized data, determining whether the electromagnetic signal is a valid signal from at least one external electronic device based on a result of the comparison, and Based on the fact that the electromagnetic signal is a valid signal, electromagnetic detection data related to all or at least a part of the electromagnetic signal and a wake-up signal for waking up the processor in the sleep mode are sent to the processor.
2. The electronic device according to claim 1, wherein: The electromagnetic detection data is time domain data generated by processing the electromagnetic signal or frequency domain data generated by performing a fast Fourier transform (FFT) on the time domain data.
3. The electronic device according to claim 1, wherein: The EM sensor module is configured to: acquiring normalized data by applying a specified normalization function to the electromagnetic detection data generated based on the electromagnetic signal; comparing the normalized data to a predetermined threshold; as well as Based on the normalized data being greater than the predetermined threshold, it is determined that the electromagnetic signal is a valid signal from the at least one external electronic device.
4. The electronic device according to claim 1, wherein: The predetermined threshold defines a boundary line of an environment group of classified noise signals, the environment group being analyzed by big data analysis of electromagnetic signals caused by environmental noise components, and If the electromagnetic signal does not belong to the environment group, the electromagnetic signal is determined to be a valid signal.
5. The electronic device according to claim 1, wherein: The EM sensor module is activated based on a state of the electronic device or a predetermined condition related to the electronic device.
6. The electronic device according to claim 1, wherein: The EM sensor module is configured to: Based on the electromagnetic signal being an effective signal: sending electromagnetic detection data related to all or at least part of the electromagnetic signal to a server, receiving an identification result of the electromagnetic signal from the server, and The identification result about the electromagnetic signal is provided to the processor.
7. A method for controlling an electronic device including an electromagnetic (EM) sensor module, the method comprising: detecting electromagnetic signals around the electronic device using an antenna module in the electronic device electrically connected to the EM sensor module; acquiring at least two normalized data by applying at least two corresponding normalization functions to electromagnetic detection data generated based on the electromagnetic signal; comparing the at least two normalized data with predetermined thresholds respectively corresponding to the at least two normalized data; determining whether the electromagnetic signal is a valid signal from at least one external electronic device based on a result of the comparing; as well as Based on the electromagnetic signal being a valid signal, electromagnetic detection data related to all or at least part of the electromagnetic signal and a wake-up signal for waking up the processor in a sleep mode are sent to a processor in the electronic device that is electrically connected to the EM sensor module.
8. The method according to claim 7, wherein: Determining whether the electromagnetic signal is a valid signal includes: acquiring normalized data by applying a specified normalization function to the electromagnetic detection data generated based on the electromagnetic signal; comparing the normalized data to a predetermined threshold; and Based on the normalized data being greater than the predetermined threshold, it is determined that the electromagnetic signal is a valid signal from the at least one external electronic device.
9. The method according to claim 7, wherein: The predetermined threshold defines a boundary line of an environmental group of classified noise signals, wherein the environmental group is analyzed by big data analysis of electromagnetic signals caused by environmental noise components, and wherein, if an electromagnetic signal does not belong to the environmental group, the electromagnetic signal is determined to be a valid signal.
10. The method according to claim 7, wherein: The EM sensor module is activated based on a state of the electronic device or a predetermined condition related to the electronic device.
Citation Information
Patent Citations
Abnormal state sensing system of cable
KR101026080B1
Apparatus for detecting target signal by using statistical model and its method
KR1020110038447A
Method and apparatus for identifying wireless power receiver
US20180219428A1