Electronic device and method for controlling electronic device
By integrating sensors and processors into electronic devices, identifying the user's carrying status and selecting appropriate location detection methods, and combining them with artificial intelligence models, the accuracy problem of indoor user location determination is solved, achieving more accurate location determination.
Patent Information
- Application Number
- CN202511328943.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2020-07-24
- Filing Date
- 2020-11-24
- Publication Date
- 2025-11-18
AI Technical Summary
Existing technologies struggle to accurately determine user location in indoor environments, especially when users are not carrying user terminal devices, resulting in low location accuracy.
By integrating sensors and processors into electronic devices, it is possible to identify whether a user is carrying a device and select different location detection methods based on the identification results, including using the device's movement information or external signal characteristics, combined with artificial intelligence models to determine the location.
It enables accurate location determination of users in indoor environments, improving the accuracy and reliability of location determination.
Smart Images

Figure CN120973246A_ABST
Abstract
Description
[0001] This application is a divisional application of the patent application with the application date of November 24, 2020, the application number of 202080104776.1, and the invention name of "Electronic device and method for controlling electronic device". TECHNICAL FIELD
[0002] The present disclosure relates to an electronic device and a method for controlling the electronic device. More particularly, the present disclosure relates to an electronic device that determines a user detection method based on whether a user carries the electronic device and a method for controlling the electronic device. BACKGROUND
[0003] A user can identify a location of a user terminal device carried by the user by using a location-based service. The location-based service can refer to a system that provides various services to a user based on location information obtained via a mobile communication network or a global positioning system.
[0004] However, in the case of a location-based service employing a global positioning system, it is difficult to use indoors. Accordingly, in the related art, a location determination technology has been developed and used, which identifies a location of a user terminal device using a network system such as a communication module included in the user terminal device or a wireless fidelity (Wi-Fi) system installed in a surrounding environment.
[0005] Meanwhile, a user does not always carry a user terminal device, and can act while the user terminal device is placed in a certain location. When a user acts without carrying a user terminal device, a location of the user is different from a location of the user terminal device. In the case of a location determination technology designed assuming that a user carries a terminal device, there is a limitation that a user location estimation (or positioning) information is output with deteriorated accuracy.
[0006] The above information is presented as background information only to assist with an understanding of the present disclosure. No determination has been made, and no assertion is made, as to whether any of the above might be applicable as prior art with regard to the present disclosure. SUMMARY
[0007] TECHNICAL PROBLEM
[0008] Aspects of the present disclosure provide an electronic device that identifies whether a user carries the electronic device, and determines a method for detecting a location of the user based on a result of the identification, and a method for controlling the electronic device.
[0009] TECHNICAL SOLUTION
[0010] Additional aspects will be set forth in part in the description which follows, and in part will become apparent to those skilled in the art upon examination of the following and the attached drawings.
[0011] According to aspects of the disclosure, an electronic device is provided. The electronic device includes a communicator including circuitry, a first sensor configured to detect movement information of the electronic device, a memory including a first determination module configured to determine whether a user carries the electronic device and a second determination module configured to determine a detection method for detecting location information of the user, and a processor configured to identify whether the user of the electronic device carries the electronic device based on the movement information of the electronic device obtained by the first sensor by using the first determination module, and determine the detection method for detecting the location information of the user according to whether the user carries the electronic device by using the second determination module, wherein the processor is configured to determine a first detection method for obtaining the location information of the user using at least one of movement information of the electronic device or feature information of a first signal received from an access point (AP) via the communicator based on the user being identified as carrying the electronic device, and determine a second detection method for obtaining the location information of the user using feature information of a second signal received from at least one external device via the communicator based on the user being identified as not carrying the electronic device.
[0012] The processor can be further configured to identify that the user does not carry the electronic device by using the first determination module based on the movement information not changing for a threshold time, and identify that the user carries the electronic device by using the first determination module based on the movement information changing for the threshold time.
[0013] The electronic device can further include a second sensor configured to detect a biological signal of the user by contact with the user of the electronic device, and wherein the processor can be further configured to identify whether the user of the electronic device carries the electronic device based on whether the biological signal of the user can be detected via the second sensor by using the first determination module.
[0014] The processor can be further configured to control the communicator to transmit, to the at least one external device, a signal requesting transmission of the second signal for obtaining the location information of the user by using the second detection method module based on the second detection method being determined, and obtain the location information of the user by inputting the feature information of the second signal to the location detection model based on the feature information of the second signal being obtained by receiving the second signal from the at least one external device via the communicator.
[0015] The processor can be further configured to control the communicator to transmit, to the at least one external device, a request signal requesting performance of an operation of obtaining the location information of the user based on the second detection method being determined, and wherein the at least one external device that has received the request signal is configured to obtain the location information of the user based on feature information of a third signal received from another external device.
[0016] The processor can be further configured to, based on the user being identified as not existing within the threshold distance from the electronic device based on the characteristic information of the second signal, control the communicator to transmit a request signal requesting performance of an operation of obtaining location information of the user to at least one external device, and wherein the at least one external device having received the request signal can be configured to obtain the location information of the user based on characteristic information of a third signal received from another external device.
[0017] The processor can be further configured to identify whether a battery of the electronic device is being charged, determine a detection method for detecting the location information of the user according to whether the battery of the electronic device is being charged by using a second determination module, determine the second detection method based on the battery of the electronic device being identified as being charged, and determine the first detection method based on the battery of the electronic device being identified as not being charged.
[0018] The processor can be further configured to, based on the battery of the electronic device being identified as being charged, identify the location of the electronic device by using a second signal received from at least one external device, and identify whether the location of the electronic device is a location for obtaining the location information of the user via the location detection model.
[0019] The processor can be further configured to, based on the location of the electronic device being identified as the location for obtaining the location information of the user via the location detection model, obtain the location information of the user by the second detection method, and based on the location of the electronic device not being identified as the location for obtaining the location information of the user via the location detection model, obtain the location information of the user by using the first detection method.
[0020] The processor can be further configured to, based on the user being identified as carrying the electronic device after the location of the electronic device is identified as the location for obtaining the location information of the user via the location detection model, obtain movement information of the electronic device via a first sensor based on the location of the electronic device, and train the location detection model based on the movement information of the electronic device and characteristic information of a third signal received from an AP via the communicator.
[0021] According to another aspect of the disclosure, a method for controlling an electronic device including a first sensor configured to detect movement information of the electronic device, a first determination module configured to determine whether a user carries the electronic device, and a second determination module configured to determine a detection method for detecting a user location is provided. The method includes identifying whether the user of the electronic device carries the electronic device based on the movement information of the electronic device obtained by the first sensor by using the first determination module; and determining a detection method for detecting location information of the user according to whether the user carries the electronic device by using the second determination module, wherein the determining includes determining a first detection method for obtaining the location information of the user using at least one of movement information of the electronic device or feature information of a first signal received from an AP based on the user being identified as carrying the electronic device; and determining a second detection method for obtaining the location information of the user using feature information of a second signal received from at least one external device based on the user being identified as not carrying the electronic device.
[0022] The identifying can include identifying that the user does not carry the electronic device by using the first determination module based on the movement information not changing for a threshold time, and identifying that the user carries the electronic device by using the first determination module based on the movement information changing for the threshold time.
[0023] The identifying can include identifying whether the user of the electronic device carries the electronic device by using the first determination module based on whether a biological signal of the user is detectable via a second sensor configured to detect a biological signal of the user.
[0024] The method can further include transmitting a signal requesting transmission of a second signal for obtaining location information of the user to at least one external device by using the second detection method module based on the second detection method being determined, and obtaining the location information of the user by inputting feature information of the second signal to a location detection model based on the feature information of the second signal being obtained by receiving the second signal from the at least one external device based on the second detection method being determined.
[0025] The method can further include transmitting a request signal requesting performance of an operation of obtaining location information of the user to at least one external device based on the second detection method being determined, wherein the at least one external device having received the request signal can be configured to obtain the location information of the user based on feature information of a third signal received from another external device.
[0026] The method may further include: based on the characteristic information of the second signal that the user is identified as not existing within a threshold distance from the electronic device, transmitting a request signal to at least one external device requesting to perform an operation to obtain the user's location information, wherein the at least one external device that has received the request signal may be configured to obtain the user's location information based on the characteristic information of the third signal received from another external device.
[0027] The identification may include: identifying whether the battery of the electronic device is being charged; determining a detection method for detecting user location information based on whether the battery of the electronic device is being charged by using a second determining module; determining a second detection method based on the identification that the battery of the electronic device is being charged; and determining a first detection method based on the identification that the battery of the electronic device is not being charged.
[0028] The method may further include identifying the location of the electronic device based on the battery of the electronic device being identified as being charged, identifying the location of the electronic device by using a second signal received from at least one external device, and identifying whether the location of the electronic device is a location used to obtain the user's location information via a location detection model.
[0029] Identifying whether the location of an electronic device is a location used to obtain the user's location information via a location detection model may include: obtaining the user's location information by a second detection method based on the electronic device's location being identified as a location used to obtain the user's location information via a location detection model, and obtaining the user's location information by using a first detection method based on the electronic device's location not being identified as a location used to obtain the user's location information via a location detection model.
[0030] The method may further include: identifying the user as carrying the electronic device after the location of the electronic device is identified as the location for obtaining the user's location information via a location detection model; obtaining the movement information of the electronic device via a first sensor based on the location of the electronic device; and training the location detection model based on the movement information of the electronic device and feature information of a third signal received from the AP.
[0031] Other aspects, advantages, and distinctive features of this disclosure will become apparent to those skilled in the art from the following detailed description of various embodiments disclosed in conjunction with the accompanying drawings.
[0032] Beneficial effects
[0033] According to various embodiments of this disclosure, an electronic device can detect a user's location using optimized methods, based on whether the user is carrying the device. Therefore, the user can receive accurate location determination information indoors. Attached Figure Description
[0034] The above and other aspects, features and advantages of certain embodiments of the disclosure will be more apparent from the following description taken in conjunction with the accompanying drawings, in which:
[0035] Figure 1 is a block diagram for illustrating a configuration and operation of an electronic device according to an embodiment of the disclosure;
[0036] Figure 2 is a flowchart for illustrating a method for controlling an electronic device according to an embodiment of the disclosure;
[0037] Figure 3 is a flowchart for illustrating an operation between an electronic device and an external device according to an embodiment of the disclosure;
[0038] Figure 4 is a flowchart for illustrating an operation between an electronic device and a plurality of external devices according to an embodiment of the disclosure;
[0039] Figure 5 is a flowchart for illustrating an operation between an electronic device and an external device according to an embodiment of the disclosure;
[0040] Figure 6 is a flowchart for illustrating a process of determining a detection method based on whether a battery of an electronic device is being charged according to an embodiment of the disclosure;
[0041] Figure 7 is a flowchart for illustrating a process of determining a detection method based on whether a battery of an electronic device is being charged and a location of the electronic device according to an embodiment of the disclosure;
[0042] Figure 8 is a flowchart for illustrating a process in which an electronic device obtains final location information of a user according to an embodiment of the disclosure; and
[0043] Figure 9 is a block diagram for specifically illustrating a configuration of an electronic device according to an embodiment of the disclosure.
[0044] Throughout the drawings, the same drawing reference numerals will be understood to refer to the same parts, components and structures. DETAILED DESCRIPTION
[0045] The following description with reference to the accompanying drawings is provided to assist in a comprehensive understanding of various embodiments of the disclosure as defined by the claims and their equivalents. It includes various specific details to assist in that understanding but these are to be taken as illustrations only. Accordingly, one of ordinary skill in the art will recognize that various changes and modifications of the various embodiments described herein can be made without departing from the scope and spirit of the disclosure. In addition, descriptions of well-known functions and constructions can be omitted for clarity and conciseness.
[0046] The terms and words used in the following description and claims are not limited to the bibliographical meanings, but are merely used to enable a clear and consistent understanding of the present disclosure. Accordingly, it should be apparent to those skilled in the art that the following description of various embodiments of the present disclosure is provided for illustration purpose only and not for limiting the present disclosure as defined by the appended claims and their equivalents.
[0047] It is to be understood that the singular forms "a," "an," and "the" include plural referents unless the context clearly dictates otherwise. Thus, for example, reference to "a component surface" includes reference to one or more of such surfaces.
[0048] Hereinafter, various embodiments of the present disclosure will be described with reference to the accompanying drawings.
[0049] Figure 1 is a block diagram for illustrating a configuration and an operation of an electronic device according to an embodiment of the present disclosure.
[0050] Referring to Figure 1 The electronic device 100 can include a sensor 110, a memory 120, a communicator 130, and a processor 140.
[0051] Figure 1 The illustrated configuration is a diagram for implementing an embodiment of the present disclosure, and it will be apparent to those skilled in the art that an appropriate hardware and software configuration can be additionally included in the electronic device 100.
[0052] In describing the present disclosure, the electronic device 100 can be implemented as a user terminal device such as a smart phone, a tablet personal computer (PC), a laptop PC, a notebook computer, a medical device, and a wearable device, but is not limited thereto.
[0053] The sensor 110 can detect various state information of the electronic device 100 or state information of a user carrying (or wearing) the electronic device 100. The sensor 110 can include a first sensor 110-1 for detecting movement information of the electronic device 100 and a second sensor 110-2 for detecting information about a user carrying or wearing the electronic device 100.
[0054] The first sensor 110-1 can include at least one of a gyro sensor, an acceleration sensor, and a geomagnetic sensor. The gyro sensor can detect information about an angular velocity of the electronic device 100.
[0055] Information about an angular velocity obtained via the gyro sensor can be used to identify a tilt angle of the electronic device 100 or a rotation angle of the electronic device 100. The geomagnetic sensor is a sensor for detecting a magnetic force, and information obtained via the geomagnetic sensor can be used to obtain information about a direction angle of the electronic device 100.
[0056] The acceleration sensor can detect information about a power of the electronic device 100, such as acceleration, vibration, impact, etc. Information about the power obtained via the acceleration sensor can be used to identify information about a force applied to the electronic device 100 or a user's steps who carries the electronic device 100. Herein, the operation information can include information about whether the user is walking with the electronic device 100 and the number of steps.
[0057] The second sensor 110-2 can include a sensor for detecting a user's biological signal (e.g., a blood pressure sensor, a blood sugar sensor, a heart rate sensor, etc.). The sensor for detecting a user's biological signal can detect various biological signals, such as blood pressure, heart rate, etc., by being in contact with or spaced apart from a user's body within a preset distance who carries or wears the electronic device 100.
[0058] For example, if the electronic device 100 is implemented as a wearable device, the second sensor 110-2 can detect various biological signals, such as blood pressure, heart rate, etc., of a user who wears the electronic device 100. If the user takes off the electronic device 100, the second sensor 110-2 can not be in contact with the user's body or can not be spaced apart from the user's body within a preset distance. At this time, the second sensor 110-2 can not detect a user's biological signal of the electronic device 100.
[0059] In addition to the first sensor 110-1 and the second sensor 110-2, the sensor 110 can include a sensor for detecting location information (e.g., a global positioning system (GPS) sensor), a sensor for detecting environmental information around the electronic device 100 (e.g., a temperature sensor, a humidity sensor, a pressure sensor, etc.), a sensor for detecting a user's presence (e.g., a camera, a UWB sensor, an IR sensor, a proximity sensor, an optical sensor, etc.), etc.
[0060] The memory 120 can store instructions or data related to at least another element of the electronic device 100. The processor 140 can access the memory 120 and can perform reading, recording, editing, deleting, or updating of data by the processor 140.
[0061] The term "memory" in the present disclosure can include the memory 120, a ROM (not shown) and a RAM (not shown) in the processor 140, or a memory card (not shown) (for example, a micro SD card or a memory stick) mounted on the electronic device 100. In addition, the memory 120 can store programs and data for configuring various screens to be displayed in a display area of a display.
[0062] The memory 120 can store an instruction set corresponding to at least one program executable by the processor 140. The instruction can refer to one action statement in a programming language directly executable by the processor 140, and is a minimum execution unit or action of a program.
[0063] The memory 120 can store a first determination module for determining whether a user carries the electronic device 100 and a second determination module for determining a user position detection method. The first determination module and the second determination module can be implemented as software modules and controlled by the processor 140. However, this is only an embodiment of the present disclosure, and each determination module can be implemented as a separate hardware module controlled by the processor 140.
[0064] The first determination module 10 can be a module for determining whether a user carries the electronic device 100 by using movement information of the electronic device 100 or a biological signal of a user of the electronic device 100. The user carrying the electronic device 100 can imply that the user carries, wears, or uses the electronic device 100.
[0065] The second determination module 20 can be a module for determining a detection method for detecting a user position based on whether the user carries the electronic device 100 or whether a battery of the electronic device 100 is being charged.
[0066] The memory 120 can store a plurality of detection method modules (for example, a first detection method module 30 and a second detection method module 40). When the second determination module 20 determines a method for detecting a user position, a detection method module corresponding to the determined detection method among the plurality of detection method modules can perform an operation to obtain position information of the user. The operation and function of each detection method module can be controlled by the processor 140. The operation in which the processor 140 controls each module to obtain position information of the user will be described later.
[0067] Meanwhile, in describing the present disclosure, the position information of the user can not only include information about an area in which the user is located, but also information about whether the user exists within a threshold distance from the electronic device or an external device.
[0068] The memory 120 can store a plurality of position detection models (for example, a first position detection model, a second position detection model, and a third position detection model).
[0069] The first location detection model can be an artificial intelligence model trained using a fingerprint database as learning data. The first location detection model can be trained to, when inputting feature information of the first signal, identify a fingerprint matching the feature information of the first signal from the fingerprint database, and output location information of a user corresponding to the identified fingerprint.
[0070] The first signal can refer to a Wi-Fi signal received via a Wi-Fi network. The feature information of the first signal can include at least one of channel state information (CSI), time of arrival (TOA), angle of arrival (AOA), and received signal strength (RSS) of the first signal.
[0071] The fingerprint can refer to data including feature information of a signal (e.g., a Wi-Fi signal) receivable from an access point (AP) when the electronic device 100 is located at a specific location. The feature information of the signal receivable from the AP varies depending on the location, and the fingerprint can be classified according to the location. The AP can refer to a device that enables a wireless device to connect to a wired network using a Wi-Fi related standard.
[0072] The fingerprint database can be a database in which a plurality of fingerprints classified for each location are stored and constructed. The fingerprint database can also be expressed as radio map information.
[0073] The second location detection model can be an artificial intelligence model trained to output current location information of a user based on a plurality of predefined locations of the electronic device according to feature information of a second signal. In this context, the second signal can refer to a Wi-Fi signal received via a Wi-Fi network, and the type of the feature information of the second signal can be the same as that of the feature information of the first signal. The predefined location of the electronic device can refer to a location learned by the second location detection model.
[0074] The second location detection model can be trained using feature information of the second signal received from an external device at a predefined location of the electronic device 100 and the current location information of the user as learning data.
[0075] As the location of the electronic device 100 changes, the feature information of the second signal receivable by the electronic device 100 from other external devices can change. The second location detection model can be trained using the above-described learning data at a plurality of predefined locations determined from the user.
[0076] The third location detection model can be an artificial intelligence model trained to output location information of the electronic device based on feature information of a signal. The third location detection model can be trained using feature information of a signal received from at least one external device and current location information of the electronic device matching each feature information as learning data.
[0077] The memory 120 can include a non-volatile memory that saves stored information even if power is interrupted, and a volatile memory that requires a continuous power supply to save stored information. Referring to Figure 1 , the volatile memory can be implemented as an element of the processor 140 in the form of being included in the processor 140, but this is only an embodiment of the disclosure, and the volatile memory can be implemented as an element separate from the processor 140.
[0078] The communicator 130 can include a circuit and communicate with an AP or an external device. The communicator 130 can include various wireless communication modules, and the wireless communication modules can include a Wi-Fi module 130-1.
[0079] The Wi-Fi module 130-1 can receive a Wi-Fi signal from an AP or various external devices. The Wi-Fi module 130-1 can measure feature information of the Wi-Fi signal while receiving the Wi-Fi signal. For example, the Wi-Fi module 130-1 can obtain channel state information, a time of arrival, an angle of arrival, phase information, signal strength, etc. of the received Wi-Fi signal.
[0080] In describing the disclosure, the external device can include at least one of a smart phone, a tablet PC, a desktop PC, a laptop PC, a netbook PC, a server, a PDA, a medical device, or a wearable device. In some embodiments of the disclosure, the external device can include at least one of, for example, a television, a refrigerator, an air conditioner, an air purifier, a set-top box, a media box (e.g., SAMSUNG HOMESYNC TM ), etc. However, there is no limitation on the above examples, and the external device can be implemented as various types of devices.
[0081] The processor 140 can be electrically connected to the memory 120 to control general functions and operations of the electronic device 100. The processor 140 can load the plurality of determination modules 10 and 20 and the detection method modules 30 and 40 from the non-volatile memory to the volatile memory. The loading can refer to an operation of calling data stored in the non-volatile memory to the volatile memory to store the data so that it is accessible by the processor 140.
[0082] In an embodiment of the disclosure, when power of the electronic device 100 is turned on, the processor 140 can load each determination module and detection method module to the volatile memory. In another embodiment of the disclosure, when a command for activating a user location detection function is input from a user, the processor 140 can load each determination module and detection method module to the volatile memory.
[0083] The processor 140 can identify whether a user carries the electronic device based on movement information of the electronic device 100 obtained via the first sensor 110-1 using the first determination module 10.
[0084] In an embodiment of the disclosure, when movement information (e.g., a tilt value, a rotation angle, etc. of the electronic device 100) obtained via the first sensor 110-1 is changed within a first threshold time, the processor 140 can identify that the user carries the electronic device via the first determination module 10.
[0085] In another embodiment of the disclosure, when the movement information is changed by a preset value or more within the first threshold time, the processor 140 can identify that the user carries the electronic device via the first determination module 10. Herein, the preset value can be changed by a user.
[0086] For example, when the user rotates the electronic device 100 from a vertical direction (portrait direction) to a horizontal direction (landscape direction), the processor 140 can identify that a rotation angle of the electronic device 100 is changed via the first sensor 110-1. The change in the rotation angle of the electronic device 100 can imply that the user carries and uses the electronic device 100. Since the rotation angle of the electronic device 100 is changed within the first threshold time, the processor 140 can identify that the user carries the electronic device using the first determination module.
[0087] When the movement information obtained via the first sensor 110-1 is not changed within the first threshold time, the processor 140 can identify that the user does not carry the electronic device via the first determination module 10. The first threshold time can be a preset time, but can be changed by a user.
[0088] The processor 140 can identify whether the user carries the electronic device 100 based on whether a biological signal of the user can be detected via the second sensor 110-2 by using the first determination module 10. The processor 140 can obtain the biological signal of the user via the second sensor 110-2 which is in contact with the user of the electronic device 100 or spaced apart within a preset distance therefrom.
[0089] If the user's biometric signal is not obtained via the second sensor 110-2 within the second threshold time, the processor 140 can identify that the user does not carry the electronic device 100 via the first determination module 10. When the user's biometric signal is obtained via the second sensor 110-2 within the second threshold time, the processor 140 can identify that the user carries the electronic device 100 via the first determination module 10.
[0090] When identifying whether the user carries the electronic device via the first determination module 10, the processor 140 can determine a detection method for detecting the location information of the user based on the identified result by using the second determination module 20.
[0091] When it is identified that the user carries the electronic device 100, the processor 140 can determine a first detection method (or a device-carrying detection method) for obtaining the location information of the user by using at least one of the movement information of the electronic device and the characteristic information of the first signal received from the AP via the communicator 13.
[0092] When the first detection method is determined, the processor 140 can obtain the location information of the user using a first detection method module 30 corresponding to the determined first detection method among a plurality of detection method modules.
[0093] In an embodiment of the disclosure, the processor 140 can obtain the location information of the user by using dead reckoning based on the movement information of the electronic device 100 from the first detection method via the first detection method module 30. Dead reckoning can be a method of estimating the current location of the electronic device based on the direction and distance in which the electronic device is moved by the user from a reference location.
[0094] Specifically, the processor 140 can obtain operation information via an acceleration sensor, and can obtain information about the direction in which the user moves the electronic device via a gyro sensor or a geomagnetic sensor. The processor 140 can estimate the direction and distance in which the electronic device is moved from the reference location by using the movement information of the electronic device 100 via the first detection method module 30. Herein, the reference location can be a fixed location in which the user does not move the electronic device for a preset time, or a location set as the reference location by the user.
[0095] Accordingly, the processor 140 can obtain the current location information of the electronic device 100 moved from the reference location by using the first detection method module 30. Since it is identified that the user carries the electronic device 100, the location information of the electronic device 100 can refer to the location information of the user.
[0096] In another embodiment of the disclosure, the processor 140 can obtain the location information of the user from the first detection method using a fingerprint comparison method via the first detection method module 30. The fingerprint comparison method is a method for identifying a fingerprint matching the characteristic information of the signal received from the AP among the fingerprints included in the pre-stored fingerprint database, and estimating the current location information of the electronic device using the location information included in the identified fingerprint.
[0097] The processor 140 can obtain the location information of the user using the fingerprint comparison method based on the characteristic information of the first signal obtained via the communicator 130 using the first detection method module 30. Specifically, the processor 140 can identify a fingerprint matching the characteristic information of the first signal by inputting the characteristic information of the first signal to the first location detection model, and obtain the location information of the user corresponding to the identified fingerprint via the first detection method module 30.
[0098] When it is identified that the user does not carry the electronic device 100, the processor 140 can determine a second detection method (or a device-free detection method) for obtaining the location information of the user using the characteristic information of the second signal received from at least one external device via the second determination module 20. The processor 140 can obtain the location information of the user by using the second detection method module 40 corresponding to the determined second detection method among the plurality of detection method modules.
[0099] The processor 140 can control the communicator 130 to transmit a signal requesting transmission of the second signal for obtaining the location information of the user to the external device via the second detection method module 40. When the request signal is received, the external device can emit the second signal via various paths. The processor 140 can receive all or part of the second signal emitted from the external device via the communicator 130.
[0100] Meanwhile, part or all of the second signal emitted from the external device can be reflected or transmitted through the user to be transmitted to the electronic device 100 by the user. The characteristic information of the second signal received by being reflected or transmitted through the user can be different from the characteristic information of the signal transmitted directly from the external device to the electronic device 100.
[0101] The processor 140 can receive part or all of the second signal emitted from the external device via the communicator 130, and obtain the characteristic information of the part or all of the second signal. For example, the processor 140 can receive all or part of the Wi-Fi signal emitted from the external device, and obtain the CSI, RSS, AOA, or TOA of each of all or part of the received Wi-Fi signal. Part or all of the Wi-Fi signal received via the communicator 130 can be a signal reflected or transmitted through the user by the user.
[0102] The processor 140 can obtain the user's location information of the user via the second detection method module 40 by inputting the characteristic information of the second signal to the second location detection model. The second location detection model has been trained to output the user's location information based on a learned predefined location. Accordingly, when the processor 140 inputs the characteristic information of the second signal to the second location detection model, the location of the electronic device 100 can be the predefined location learned by the second location detection model.
[0103] For example, when the CSI amplitude change amount of the Wi-Fi signal received from the external device via the first path and the second path is input to the second location detection model, the processor 140 can obtain the user's location information for measuring the location of the user based on the current location of the electronic device 100 via the second detection method module 40.
[0104] The processor 140 can identify whether the user is present within the threshold distance of the electronic device 100 based on the obtained user's location information. The user's location information can include information about whether the user is present within the threshold distance of the electronic device 100.
[0105] When it is identified that the user is present within the threshold distance of the electronic device based on the obtained user's location information, the processor 140 can perform a predefined operation corresponding to the user's location information. For example, when it is identified that the user is present in a region set as a dangerous region based on the user's location information, the processor 140 can output a message that the user is present in the region set as the dangerous region as a voice. However, this is only an embodiment of the disclosure, and the predefined operation corresponding to the user's location information can be differently set by the user.
[0106] When it is identified that the user is not present within the threshold distance of the electronic device 100, the processor 140 can control the communicator 130 to transmit a request signal requesting to perform an operation of obtaining the user's location information to at least one external device. In other words, when the user is not present within the threshold distance of the electronic device 100 or it is difficult to determine whether the user is present within the threshold distance of the electronic device 100, the processor 140 can control the communicator 130 to transmit a request signal requesting to perform an operation of obtaining the user's location information with another external device to at least one external device.
[0107] The at least one external device that has received the request signal can obtain the user's location information by using characteristic information of a third signal (e.g., a Wi-Fi signal) received from the other external device. The at least one external device that has obtained the user's location information can perform a predefined operation corresponding to the user's location information.
[0108] Meanwhile, when it is identified that the user does not carry the electronic device 100, the processor 140 can control the communicator 130 to transmit a request signal requesting to perform an operation of obtaining location information of the user to at least one external device by using the second detection method module 40. In other words, the processor 140 can not only obtain the location information of the user based on a signal received from the external device, but also control the communicator 130 to transmit a request signal for controlling to perform an operation of obtaining the location information of the user to the external device.
[0109] After a preset period of time after transmitting the request signal to the at least one external device, the processor 140 can control the communicator 130 to emit a fourth signal to the vicinity of the at least one external device via various paths. The fourth signal can be a Wi-Fi signal that can be transmitted / received via a Wi-Fi network.
[0110] Part or all of the fourth signal emitted via the communicator 130 can be reflected or transmitted through the user to be transmitted to the at least one external device. For example, the communicator 130 can emit a Wi-Fi signal via multiple paths under the control of the processor 140, and part or all of the emitted Wi-Fi signal can be reflected or transmitted through the user located in the vicinity of the electronic device 100 to be transmitted to the at least one external device.
[0111] The at least one external device can obtain the location information of the user based on feature information of all or part of the received fourth signal. The at least one external device can perform an operation corresponding to the obtained location information of the user. For example, if the external device is implemented as a smart light, when it is identified that the user exists within a threshold distance from the external device based on the obtained location information of the user, the external device can turn on the power of the light to illuminate the area around the user.
[0112] Meanwhile, the processor 140 can determine a detection method for detecting the location of the user based on whether the battery of the electronic device 100 is being charged. The processor 140 can identify whether the battery is being charged through a wired charging cable or a wireless charger. The processor 140 can determine the detection method using the second determination module 20 based on the charging state of the battery.
[0113] When it is identified that the battery of the electronic device 100 is being charged, the processor 140 can determine the second detection method by using the second determination module 20. In general, the state of the battery of the electronic device 100 being charged can imply that the user does not carry the electronic device. Accordingly, when the battery of the electronic device 100 is not being charged, the processor 140 can determine the first detection method using the second determination module 20 and obtain the location information of the user using the first detection method module 30 corresponding to the determined first detection method.
[0114] When it is identified that the battery of the electronic device is being charged, the processor 140 can determine a second detection method using the second determination module 20. The processor 140 can obtain the location information of the user using the second detection method module 40 corresponding to the determined second detection method.
[0115] In yet another embodiment of the disclosure, when it is identified that the battery of the electronic device 100 is being charged, the processor 140 can obtain the location information of the electronic device using feature information of a second signal received from at least one external device. The processor 140 can obtain the location information of the electronic device by inputting the feature information of the second signal received via the communicator 130 to a third location detection model. For example, the processor 140 can obtain the location information of the electronic device 100 by inputting the RSS information of the Wi-Fi signal received from the external device to the third location detection model.
[0116] The processor 140 can identify whether the location of the electronic device 100 is a location in which the location information of the user can be obtained using the second location detection model, based on the obtained location information of the electronic device 100.
[0117] The location in which the location information of the user can be obtained using the second location detection model can refer to a predefined location learned by the second location detection model outputting the location information of the user matching the feature of the input signal. The predefined location learned by the second location detection model can be variously determined by the user. The second location detection model pre-trained can output the location information of the user matching the input feature information of the second signal based on the learned predefined location.
[0118] The processor 140 can identify whether the current location of the electronic device is a location learned by the second location detection model, based on the obtained location information of the electronic device 100.
[0119] When it is identified that the location of the electronic device 100 is not a location learned by the second location detection model, the processor 140 can determine a second detection method among a plurality of detection methods using the second determination module 20. When it is identified that the location of the electronic device is a location learned by the second location detection model, the processor 140 can determine a first detection method among a plurality of detection methods using the second determination module 20. The processor 140 can obtain the location information of the user using a detection method module corresponding to the determined detection method.
[0120] In yet another embodiment of the disclosure, the processor 140 can obtain first user location information using the first detection method module 30 and obtain second user location information using the second detection method module 40. In other words, the processor 140 can obtain the first user location information and the second user location information using the first detection method and the second detection method, respectively.
[0121] The processor 140 can identify whether a difference between the first user location information and the second user location information exceeds a threshold. When it is identified that the difference between the first user location information and the second user location information exceeds the threshold, the processor 140 can identify whether the user carries the electronic device.
[0122] When the difference between the user location information obtained by using the first detection method and the second detection method, respectively, is large, the processor 140 can identify whether the user carries the electronic device 100 to identify accurate information among the first user location information and the second user location information. The process of identifying whether the user carries the electronic device 100 has been described above, and thus, a repetitive description will not be repeated.
[0123] When it is identified that the user carries the electronic device 100, the processor 140 can determine the first user location information obtained using the first detection method as final location information of the user. When the user carries the electronic device 100, the user location information obtained using the first detection method can be relatively accurate.
[0124] When it is identified that the user carries the electronic device 100, the processor 140 can determine the second user location information obtained using the second detection method as final location information of the user. When it is identified that the user does not carry the electronic device 100, the user location information obtained using the second detection method can be relatively accurate.
[0125] When it is identified that the difference between the first user location information and the second user location information does not exceed the threshold, the processor 140 can determine the first user location information as final location information of the user. When the user does not carry the electronic device 100, the difference between the first user location information and the second user location information is likely to exceed the threshold. Thus, when the difference between the first user location information and the second user location information is the threshold or less, the processor 140 can identify that the user currently carries the electronic device and identify the first user location information as the final location information of the user.
[0126] The processor 140 can train the first location detection model based on learning data obtained from the first detection method using dead reckoning. Specifically, when it is identified that the battery of the electronic device 100 is being charged, the processor 140 can identify whether the location of the electronic device 100 is a location in which location information of the user can be obtained via the second location detection model.
[0127] When it is identified that the location of the electronic device 100 is a location in which the location information of the user can be obtained via the second location detection model, and it is identified that the user carries the electronic device 100 that was being charged again, the processor 140 can obtain the movement information of the electronic device via the first sensor 110-1 based on the current location of the electronic device 100. For example, the processor 140 can obtain the operation information of the user carrying the electronic device 100 or the moving direction by using the first sensor 110-1.
[0128] The processor 140 can identify a path through which the user walked with the electronic device 100 based on the operation information of the user or the moving direction. The processor 140 can match the specific locations of the identified path with the feature information of the Wi-Fi signal received from the AP. The processor 140 can generate a fingerprint for each of the specific locations by using the matched feature information of the Wi-Fi signal for each of the specific locations of the path. The processor 140 can add the generated fingerprint for each of the specific locations to the fingerprint database. The processor 140 can train the first location detection model using the updated fingerprint database as learning data.
[0129] The functions related to artificial intelligence applied to an artificial neural network according to the present disclosure are operated by the processor 140 and the memory 120. The one or more processors 140 can perform control to process input data according to a pre-defined action rule or an artificial intelligence model stored in the memory 120. In addition, if the one or more processors are artificial intelligence dedicated processors, the artificial intelligence dedicated processors can be designed to have a hardware structure dedicated to processing a specific artificial intelligence model.
[0130] The pre-defined action rule or the artificial intelligence model is formed by training. The formation by training herein can refer to, for example, forming a pre-defined action rule or an artificial intelligence model set to perform a desired feature (or object) by training a basic artificial intelligence model through a learning algorithm by using a plurality of learning data. Such training can be performed in a device demonstrating artificial intelligence according to the present disclosure, or by a separate server and / or system.
[0131] Examples of the learning algorithm include supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but are not limited to these examples.
[0132] The artificial intelligence model can include a plurality of artificial neural networks, and the artificial neural network can include a plurality of layers. The plurality of neural network layers respectively have a plurality of weight values, and perform neural network processing through processing between the processing result of the previous layer and the plurality of weights. The plurality of weights of the plurality of neural network layers can be optimized through the training result of the artificial intelligence model. For example, the plurality of weights can be updated to reduce or minimize a loss value or a cost value obtained by the artificial intelligence model during training processing.
[0133] The artificial neural network can include a convolutional neural network (CNN), a deep neural network (DNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, etc., but the artificial neural network of the present disclosure is not limited to the above examples, unless otherwise specified.
[0134] Figure 2 FIG. 1 is a flowchart illustrating a method for controlling an electronic device according to an embodiment of the present disclosure.
[0135] Referring to FIG. 1, Figure 2 In operation S210, the electronic device 100 can obtain movement information of the electronic device 100. The electronic device 100 can obtain the movement information of the electronic device 100 via a first sensor (e.g., a gyro sensor, an acceleration sensor, a geomagnetic sensor, etc.).
[0136] In operation S220, the electronic device 100 can identify whether the user carries the electronic device 100 using the first determination module. The electronic device 100 can identify whether the user carries the electronic device 100 based on whether the movement information is changed within a threshold time.
[0137] For example, if the movement information is not changed within the threshold time, the electronic device 100 can identify that the user does not carry the electronic device 100 using the first determination module. If the movement information is changed within the threshold time, the electronic device 100 can identify that the user carries the electronic device 100 using the first determination module.
[0138] In another embodiment of the present disclosure, the electronic device 100 can identify whether the user carries the electronic device 100 based on a biological signal of the user obtained via the second sensor 110-2. Embodiments related thereto have been described above, and thus repeated descriptions will not be repeated.
[0139] In operation S230, the electronic device 100 can determine a detection method for detecting location information of the user according to whether the user carries the electronic device using the second determination module.
[0140] For example, when it is identified that the user carries the electronic device 100, the electronic device 100 can determine a first detection method for obtaining the movement information of the electronic device 100 and the location information of the user using at least one of the feature information of the first signal received from the AP. The first detection method has been described above, and thus repeated descriptions will not be repeated.
[0141] In yet another embodiment of the disclosure, when it is identified that the user does not carry the electronic device 100, the electronic device 100 can determine a second determination method for obtaining the location information of the user using feature information of a second signal received from at least one external device.
[0142] In operation S240, the electronic device 100 can obtain the user location information based on the determined detection method. The electronic device 100 can obtain the location information of the user using a detection method module corresponding to the determined detection method.
[0143] An embodiment in which the electronic device 100 obtains the location information of the user based on the second detection method will be described with reference to Figure 3 An embodiment in which the electronic device 100 obtains the location information of the user based on the second detection method will be described with reference to Figure 4 and Figure 5 An embodiment in which, when the second determination method is determined, the electronic device 100 transmits a command for obtaining the location information of the user to at least one external device will be described.
[0144] Meanwhile, in yet another embodiment of the disclosure, the electronic device 100 can determine the detection method based on whether the battery is being charged. Embodiments related thereto will be described with reference to Figure 6 and Figure 7 Embodiments related thereto will be described with reference to
[0145] Figure 3 is a flowchart illustrating operations between the electronic device and the external device according to an embodiment of the disclosure.
[0146] Specifically, Figure 3 is a flowchart for explaining a process in which the electronic device 100 obtains the location information of the user using the second detection method according to an embodiment of the disclosure. In other words, Figure 3 is a flowchart for illustrating operations after the electronic device 100 determines the second detection method in operation S230 of Figure 2
[0147] Referring to Figure 3 In operation S310, the electronic device 100 can determine the second detection method among a plurality of detection methods. In operation S320, the electronic device 100 can transmit a signal requesting transmission of a second signal for obtaining the location information of the user to the first external device 50 via a second detection method module corresponding to the second detection method.
[0148] When the request signal is received, the first external device 50 can change the normal mode to a user position detection mode in operation S330. The normal mode can refer to an operation mode in which operations corresponding to various commands input from a user can be performed. The user position detection mode can refer to an operation mode for performing an operation of emitting various signals (e.g., a Wi-Fi signal, etc.) in a direction of another device so that the other device obtains user position information, or obtaining position information of a user based on characteristic information of a signal received from the other device.
[0149] When operating in the user position detection mode, the first external device 50 can emit a second signal to various paths to deliver part or all of the second signal to the electronic device 100 in operation S340. The second signal can be a Wi-Fi signal, but this is only an embodiment, and the second signal can include a Bluetooth signal, etc.
[0150] The electronic device 100 can receive part or all of the second signal emitted from the first external device 50 to obtain characteristic information of the second signal in operation S350. The electronic device 100 can obtain position information of a user by inputting the characteristic information of the second signal to a second position detection model in operation S360. The position of the electronic device 100 can be one of a plurality of predefined positions learned by the second position detection model.
[0151] For example, the electronic device 100 can obtain position information of a user by inputting a CSI amplitude change amount of a Wi-Fi signal received from the first external device 50 via the first and second paths to the second position detection model via the second detection method module 40, for estimating a position of a user based on a predefined position of the electronic device 100.
[0152] The electronic device 100 can identify whether a user exists within a threshold distance of the electronic device 100 based on the obtained position information of the user in operation S370. When it is identified that the user exists within the threshold distance, the electronic device 100 can store the obtained position information of the user in operation S380.
[0153] The electronic device 100 can perform a predefined operation corresponding to the position information of the user. For example, when it is identified that the user exists in an area set as a dangerous area based on the position information of the user, the electronic device 100 can output a message that the user exists in the area set as the dangerous area as a voice. However, this is only an embodiment of the disclosure, and the predefined operation corresponding to the position information of the user can be differently set by a user.
[0154] Reference will be made to Figure 4An operation performed by the electronic device 100 when it is identified that the user is not within a threshold distance of the electronic device 100 is described.
[0155] Figure 4 is a flowchart illustrating an operation between an electronic device and a plurality of external devices according to an embodiment of the disclosure.
[0156] Specifically, Figure 4 is a flowchart illustrating an operation performed by the electronic device 100 when it is identified that the user is not within a threshold distance according to an embodiment of the disclosure.
[0157] When it is identified that the user is not within a threshold distance of the electronic device 100 based on the user's location information, the electronic device 100 can transmit a request signal for requesting an operation of obtaining the user's location information to at least one external device.
[0158] Referring to Figure 4 , the electronic device 100 can transmit a request signal for requesting an operation of obtaining the user's location information to the second external device 60 in operation S410. In an embodiment of the disclosure, the second external device 60 can be the same as or different from the first external device 50.
[0159] When the request signal is received, the second external device 60 can transmit a signal for requesting the third external device 70 to transmit a third signal for obtaining the user's location information to the third external device 70 in operation S420. When the signal for requesting the transmission of the third signal is received, the third external device 70 can change a normal mode to a user location detection mode in operation S430.
[0160] When operating in the user location detection mode, the third external device 70 can emit the third signal in various paths so that part or all of the third signal is transmitted to the second external device 60 in operation S440. The third signal can be a Wi-Fi signal, but this is only an embodiment of the disclosure, and the third signal can include a Bluetooth signal or the like.
[0161] The second external device 60 can receive part or all of the third signal emitted from the third external device 70 to obtain characteristic information of the third signal in operation S450. The second external device 60 can obtain the user's location information by inputting the characteristic information of the third signal to a fourth location detection model in operation S460. The fourth location detection model can be an artificial intelligence model for performing the same operation as the second location detection model.
[0162] For example, the second external device 60 can obtain the user's location information by inputting the CSI amplitude change of the Wi-Fi signal received from the third external device 70 via the third and fourth paths into the fifth location detection model, and use it to estimate the user's location based on the predefined location of the second external device 60.
[0163] Figure 5 This is a flowchart illustrating the operation between an electronic device and an external device according to an embodiment.
[0164] Specifically, Figure 5 This is a flowchart illustrating the operation of a first external device 50 obtaining a user's location information via an electronic device 100 according to an embodiment of the present disclosure. (See also...) Figure 5 , Figure 5 It is used to show in Figure 2 The flowchart shows the operation of electronic device 100 after determining the second detection method in S230.
[0165] In operation S510, the electronic device 100 can determine a second detection method from among multiple detection methods. In operation S520, the electronic device 100 can transmit a request signal to the first external device 50, using a second detection method module corresponding to the second detection method, to request the execution of an operation to obtain the user's location information.
[0166] When a request signal is received to request the execution of an operation to obtain the user's location information, in operation S530, the first external device 50 can change from normal mode to user location detection mode.
[0167] After a preset time period following the transmission of the request signal, during operation S540, the electronic device 100 may transmit a fourth signal via various paths, such that part or all of the fourth signal is transmitted to the second external device 60. In this document, the fourth signal may be a Wi-Fi signal, but this is merely an example, and the fourth signal may include Bluetooth signals, etc.
[0168] However, this is only an embodiment of this disclosure, and when the normal mode changes to the user location detection mode, the first external device 50 can transmit a signal to the electronic device 100 indicating that the operating mode has changed. Upon receiving the signal indicating that the operating mode has changed, the electronic device 100 can transmit a fourth signal, such that part or all of the fourth signal is transmitted to the second external device 60.
[0169] The first external device 50 can receive a part or all of the fourth signal transmitted from the electronic device 100 to obtain characteristic information of the fourth signal, in operation S550. The second external device 60 can obtain the location information of the user by inputting the characteristic information of the third signal to the fourth location detection model, in operation S560. The fourth location detection model can be an artificial intelligence model for performing the same operation as the second location detection model or the third location detection model.
[0170] For example, the first external device 50 can obtain the location information of the user by inputting the CSI amplitude change amount of the Wi-Fi signal received from the fourth external device 80 via the fifth path and the sixth path to the fifth location detection model, for estimating the location of the user based on a predefined location of the first external device 50.
[0171] The first external device 50 can identify whether the user is present within a threshold distance of the first external device based on the location information of the user, in operation S570. When it is identified that the user is present within the threshold distance of the first external device 10, the first external device 50 can store the obtained location information of the user, in operation S580.
[0172] The first external device 50 can perform a predefined operation corresponding to the location information of the user. For example, when the first external device 50 is implemented as a refrigerator and it is identified based on the location information of the user that the user is within a preset distance of the refrigerator, the first external device 50 can display a UI showing information about items in the refrigerator. However, this is only an embodiment of the disclosure, and the predefined operation corresponding to the location information of the user can be differently set by the user.
[0173] When it is identified that the user is not present within the threshold distance of the first external device 50, the first external device 50 can transmit a signal for requesting a change to a user location detection mode to another external device, in operation S590. In other words, when the location of the user is not detected, the first external device 50 can transmit a request signal for requesting to detect the location of the user to another device. The other device that has received the request signal can perform an operation for obtaining the location information of the user by changing the mode to the user location detection mode.
[0174] Figure 6 is a flowchart illustrating a process of determining a detection method based on whether a battery of an electronic device is being charged according to an embodiment of the disclosure.
[0175] Specifically, Figure 6 is a flowchart for illustrating a process of an electronic device 100 determining a detection method based on whether a battery is being charged according to an embodiment of the disclosure.
[0176] Referring toFigure 6 The electronic device 100 can identify whether the battery is being charged at operation S610. The electronic device 100 can identify whether the battery is currently being charged through a wired cable connected to a power supply device or through a wireless charging method.
[0177] The electronic device 100 can determine a user detection method based on whether the battery is being charged at operation S620. The battery being charged can imply that the user is likely not carrying the electronic device. When it is identified that the battery of the electronic device 100 is being charged, the electronic device 100 can determine the second detection method.
[0178] The battery not being charged can imply that the user is likely carrying and using the electronic device 100. When it is identified that the battery of the electronic device 100 is not being charged, the electronic device 100 can determine the first detection method.
[0179] The electronic device 100 can obtain user location information using a detection method module corresponding to the determined detection method at operation S630. The process of obtaining the location information of the user using each detection method module has been described above, and thus repeated descriptions will not be repeated.
[0180] Figure 7 is a flowchart for illustrating a process of determining a detection method based on whether a battery of an electronic device is being charged and a location of the electronic device according to an embodiment of the disclosure.
[0181] Specifically, Figure 7 is a flowchart according to an embodiment of the disclosure for illustrating a method of obtaining user location information by an electronic device 100 based on whether a battery is being charged.
[0182] Referring to Figure 7 The electronic device 100 can identify whether the battery of the electronic device 100 is being charged at operation S710. When it is identified that the battery is being charged, the electronic device 100 can obtain current location information of the electronic device 100 using feature information of a second signal received from at least one external device at operation S720-Y.
[0183] The electronic device 100 can obtain the location information of the electronic device by inputting the feature information of the second signal received from the at least one external device to a third location detection model. For example, the electronic device 100 can obtain the location information of the electronic device 100 by inputting RSS information of a Wi-Fi signal received from at least one external device to the third location detection model.
[0184] The electronic device 100 can identify whether the current location of the electronic device 100 is a location for obtaining user location information using the second location detection model based on the location information of the electronic device 100 in operation S730.
[0185] The second location detection model can be trained using feature information of a second signal received from an external device at a plurality of predefined locations determined by a user and location information of the user matching the feature information of the second signal. The location for obtaining user location information using the second location detection model can refer to a predefined location learned by the second location detection model.
[0186] When it is identified that the current location of the electronic device is the location for obtaining user location information using the second location detection model, the electronic device 100 can obtain location information of the user by inputting the feature information of the second signal to the second location model in operation S740.
[0187] When it is not identified that the current location of the electronic device is the location for obtaining user location information using the second location detection model, the electronic device 100 can obtain user location information based on the first detection method in operation S720-N.
[0188] Meanwhile, when it is identified that the battery is not charged, the electronic device 100 can obtain user location information based on the first detection method in operation S720-N
[0189] Figure 8 FIG. 8 is a flowchart illustrating a process in which an electronic device according to an embodiment of the disclosure obtains final location information of a user.
[0190] Referring to Figure 8 The electronic device 100 can obtain first user location information using a first detection method and second user location information using a second detection method in operation S810.
[0191] The electronic device 100 can obtain first user location information from the first detection method using a fingerprint comparison method or dead reckoning. Simultaneously or regardless of the order, the electronic device 100 can obtain location information of the user based on feature information of a second signal received from at least one external device.
[0192] The electronic device 100 can identify whether a difference between the first user location information and the second user location information exceeds a threshold in operation S820. If the difference between the first user location information and the second user location information obtained using the first detection method and the second detection method, respectively, is large, the electronic device 100 can identify whether the user currently carries the electronic device 100 to identify accurate information among the first user location information and the second user location information.
[0193] Accordingly, the electronic device 100 can obtain movement information of the electronic device 100 at operation S830. The electronic device 100 can identify whether the user carries (has) the electronic device 100 based on the obtained movement information at operation S840. However, this is only an embodiment of the disclosure, and the electronic device 100 can identify whether the user carries the electronic device 100 based on the user's biological signal obtained via the second sensor.
[0194] When it is identified that the user carries the electronic device 100, the electronic device 100 can determine the first user location information as the final location information of the user at operation S850. The first detection method is a method of detecting the user's location assuming that the user carries the electronic device 100. Accordingly, when the user carries the electronic device 100, the first user location information obtained using the first detection method can be relatively accurate.
[0195] When it is identified that the user does not carry the electronic device 100, the electronic device 100 can determine the second user location information as the final location information of the user at operation S860. The second detection method is a method of detecting the user's location assuming that the user does not carry the electronic device 100. Accordingly, when the user does not carry the electronic device 100, the second user location information obtained using the second detection method can be relatively accurate.
[0196] Meanwhile, when it is identified that the difference between the first user location information and the second user location information does not exceed the threshold value, the electronic device 100 can determine the first user location information as the final location information of the user at operation S850.
[0197] When the user does not carry the electronic device 100, the difference between the first user location information and the second user location information is likely to exceed the threshold value. Accordingly, when the difference between the first user location information and the second user location information is the threshold value or less, the electronic device 100 can identify that the user currently carries the electronic device, and identify the first user location information as the final location information of the user.
[0198] Figure 9 is a block diagram for specifically illustrating a configuration of an electronic device according to an embodiment of the disclosure.
[0199] Referring to Figure 9 , the electronic device 100 can include a sensor 110, a memory 120, a communicator 130, a processor 140, an input unit 150, a display 160, and a speaker 170. The sensor 110, the memory 120, the communicator 130, and the processor 140 have been described above with reference to Figure 1 , and thus, a repeated description will not be repeated.
[0200] The input unit 150 can receive a user input for controlling the electronic device 100. More specifically, the input unit 150 can include a touch panel for receiving a user touch using a user's finger or a stylus, a button for receiving a user manipulation, or the like. In addition, the input unit 150 can be implemented as other input devices (e.g., a keyboard, a mouse, a motion input unit, etc.). More specifically, the input unit 150 can receive a user command for changing the above-described threshold. Figure 8
[0201] In addition, the input unit 150 can receive a user command for setting an operation corresponding to the location information of the user. When the user command for setting the operation corresponding to the location information of the user is received via the input unit 150, the processor 140 can store the operation corresponding to the location of the user in the storage 120 based on the received user command.
[0202] The display 160 can display various information according to the control of the processor 140. The display 160 can be implemented as a touch screen having a touch panel, or can be implemented as a flexible display, etc.
[0203] The display 160 can display a UI screen including the location information of the user under the control of the processor 140. The UI screen can include information on a method of obtaining the location information of the user by the processor 140. In addition, the UI screen can include information on an operation to be performed corresponding to the current location of the user, and a UI for changing or adding the operation to be performed.
[0204] When the user is not present within the threshold distance of the electronic device 100, the display 160 can display a message or an indicator indicating that the user is not present within the threshold distance of the electronic device 100 under the control of the processor 140.
[0205] Meanwhile, it should be noted that the drawings in the present disclosure are not to limit the technology disclosed in the present disclosure to specific embodiments of the present disclosure, but they should be interpreted to include all modifications, equivalents, and / or alternatives of the embodiments of the present disclosure. In explanation of the drawings, like reference numerals can be used for like elements.
[0206] In the present disclosure, terms such as "include," "may include," "consist of," or "may consist of" are used herein to designate the presence of corresponding features (e.g., constituent elements such as numbers, functions, operations, or parts) and do not exclude the presence of additional features.
[0207] In this disclosure, expressions such as “A or B”, “at least one of A and / or B” or “one or more of A and / or B” include all possible combinations of the listed items. For example, “A or B”, “at least one of A and B” or “at least one of A or B” includes any of the following: (1) at least one A, (2) at least one B, or (3) at least one A and at least one B.
[0208] The terms “first,” “second,” etc., used in this disclosure may indicate various elements regardless of order and / or importance, and may be used to distinguish one element from another without limiting the elements.
[0209] If an element (e.g., a first element) is described as being "operably or communicatively coupled to / connected to" another element (e.g., a second element) or "connected to" another element, it should be understood that the first element may be connected to the second element directly or through another element (e.g., a third element). On the other hand, if an element (e.g., a first element) is described as being "directly coupled to" or "directly connected to" another element (e.g., a second element), it can be understood that there is no element (e.g., a third element) between the first element and the second element.
[0210] Furthermore, depending on the context, the expression "configured as" as used in this disclosure may be used interchangeably with other expressions such as "suitable for," "capable of," "designed for," "suitable for," "made of," and "capable of." At the same time, the expression "configured as" does not necessarily refer to a device that is "specifically designed" in terms of hardware. Rather, in some cases, the expression "configured as" may refer to the device being "capable" of performing operations with another device or component. For example, the phrase "a unit or processor configured (or set up) to perform A, B, and C" may refer to, for example, but not limited to, a dedicated processor (e.g., an embedded processor), a general-purpose processor (e.g., a central processing unit (CPU), or an application processor), which can perform the corresponding operations by executing one or more software programs stored in a memory device.
[0211] Electronic devices according to various embodiments of this disclosure may include at least one of, for example, a smartphone, a tablet PC, a desktop PC, a laptop PC, a netbook PC, a server, a PDA, a medical device, or a wearable device. Additionally, in some embodiments of this disclosure, external devices may include, for example, a television, a refrigerator, an air conditioner, an air purifier, a set-top box, and a media box (e.g., a SAMSUNG HOMESYNC). TM Apple TV TM or Google TV TM At least one of the following.
[0212] Various embodiments of the present disclosure can be implemented as software including instructions stored in a machine (e.g., computer)-readable storage medium. The machine is a device that calls the instructions stored in the storage medium and operates according to the called instructions, and can include a server cloud according to the above-described embodiments. In the case where the instructions are executed by a processor, the processor can directly or under the control of the processor use other elements to perform functions corresponding to the instructions. The instructions can include a code generated by a compiler or a code that can be executed by an interpreter. The machine-readable storage medium can be provided in the form of a non-transitory storage medium. Here, the "non-transitory storage medium" is tangible and can not include a signal, and it does not distinguish whether data is stored semi-permanently or temporarily in the storage medium. For example, the "non-transitory storage medium" can include a buffer that temporarily stores data.
[0213] According to an embodiment of the present disclosure, a method according to various embodiments disclosed in the present disclosure can be provided as included in a computer program product. The computer program product can be exchanged between a seller and a buyer as a commercial product. The computer program product can be distributed in the form of a machine-readable storage medium (e.g., a compact disc read only memory (CD-ROM)) or online through an application store (e.g., Play Store TM ) by an installer. In the case of online distribution, at least a portion of the computer program product can be temporarily stored or temporarily generated in a storage medium such as a memory of a manufacturer's server, a server of an application store, or a relay server.
[0214] Each element (e.g., a module or a program) according to various embodiments described above can include a single entity or a plurality of entities, and some of the above-described sub-elements can be omitted in various embodiments, or other sub-elements can be further included. Alternatively or additionally, some elements (e.g., a module or a program) can be integrated into one entity to perform the same or similar functions performed by each corresponding element prior to integration. The operations performed by the modules, programs, or other elements according to various embodiments of the present disclosure can be executed in a sequential, parallel, repetitive, or heuristic manner, or at least some operations can be executed in different sequences, omitted, or different operations can be added.
[0215] While the present disclosure has been shown and described with reference to various embodiments thereof, it will be understood by those skilled in the art that various changes in form and details can be made therein without departing from the spirit and scope of the present disclosure as defined by the appended claims and their equivalents.
Claims
1. An electronic device, comprising: A communicator that includes circuitry; First sensor; The processor is configured as follows: Based on the movement information of the electronic device obtained by the first sensor, it can be determined whether the user of the electronic device is carrying the electronic device. The detection method for detecting a user's location information is determined based on whether the user is carrying electronic devices.
2. The electronic device according to claim 1, wherein, The processor is also configured as follows: A first detection method for obtaining a user's location information based on the user being identified as carrying an electronic device, determining at least one of the movement information for using the electronic device or the characteristic information of a first signal received from an access point (AP) via a communicator; as well as Based on the user being identified as not carrying an electronic device, a second detection method is determined for obtaining the user's location information using feature information of a second signal received from at least one external device via a communicator.
3. The electronic device according to claim 2, wherein, The processor is also configured as follows: Based on the fact that mobile information did not change within a threshold time, it was determined that the user was not carrying an electronic device. Based on changes in mobile information within a threshold time period, the system identifies electronic devices carried by the user.
4. The electronic device according to claim 2, further comprising: The second sensor is configured to detect the user's biosignals by contacting the electronic device. The processor is also configured to identify whether a user of an electronic device is carrying an electronic device based on whether the user's biosignals can be detected by a second sensor.
5. The electronic device according to claim 2, wherein, The processor is also configured as follows: Based on the determination of the second detection method, the control communicator sends a signal to at least one external device, the signal requesting the transmission of a second signal for obtaining the user's location information; and The user's location information is obtained by inputting the feature information of the second signal, which is obtained by receiving the second signal from at least one external device via a communicator, into a location detection model.
6. The electronic device according to claim 2, in, The processor is also configured to, based on the determination of the second detection method, control the communicator to send a request signal to at least one external device, the request signal requesting the execution of an operation to obtain the user's location information, and In this configuration, at least one external device that has received the request signal is configured to obtain the user's location information based on the characteristic information of a third signal received from another external device.
7. The electronic device according to claim 5, in, The processor is also configured to, based on feature information from a second signal indicating that the user is not within a threshold distance of the electronic device, control the communicator to send a request signal to at least one external device, the request signal requesting the execution of an operation to obtain the user's location information. In this configuration, at least one external device that has received the request signal is configured to obtain the user's location information based on the characteristic information of a third signal received from another external device.
8. The electronic device according to claim 2, wherein, The processor is also configured as follows: To identify whether the battery of an electronic device is charging. The detection method for detecting the user's location information is determined based on whether the electronic device's battery is charging. The battery of the electronic device is identified as being charged, and a second detection method is determined. The first detection method is determined based on the fact that the battery of an electronic device is identified as not being charged.
9. The electronic device according to claim 2, wherein, The processor is also configured as follows: The battery of an electronic device is identified as being charged by using a second signal received from at least one external device to identify the location of the electronic device, and Identify whether the location of the electronic device is the location used to obtain the user's location information via a location detection model.
10. The electronic device according to claim 9, wherein, The processor is also configured as follows: The location of the electronic device is identified as the location used to obtain the user's location information via a location detection model, and the user's location information is obtained through a second detection method. Since the location of the electronic device is not identified as a location for obtaining the user's location information via the location detection model, the user's location information is obtained by using a first detection method.
11. The electronic device according to claim 9, wherein, The processor is also configured as follows: Based on the location of the electronic device being identified as the location used to obtain the user's location information via a location detection model, the user is identified as carrying the electronic device. Based on the location of the electronic device, movement information of the electronic device is obtained via a first sensor. The location detection model is trained based on the mobile information of electronic devices and the feature information of third signals received from the AP via the communicator.
12. A method for controlling an electronic device, the electronic device including a first sensor, the method comprising: Based on the movement information of the electronic device obtained by the first sensor, it is determined whether the user of the electronic device is carrying the electronic device; as well as The detection method for detecting a user's location information is determined based on whether the user is carrying electronic devices.
13. The method according to claim 12, wherein, The detection methods include: A first detection method for obtaining user location information based on the user being identified as carrying an electronic device, determining at least one of the following: movement information for using the electronic device or feature information of a first signal received from an access point (AP). Based on the user being identified as not carrying any electronic devices, a second detection method is determined for obtaining the user's location information using feature information of a second signal received from at least one external device.
14. The method according to claim 13, wherein, Identification includes: Based on the fact that the mobile information did not change within a threshold time, it was determined that the user was not carrying an electronic device. and Based on changes in mobile information within a threshold time period, the system identifies electronic devices carried by the user.
15. The method according to claim 13, wherein, Identification includes determining whether a user of an electronic device is carrying an electronic device based on whether the user's biosignals can be detected via a second sensor configured to detect the user's biosignals.