Electronic device and control method thereof

Abstract

An electronic device is disclosed. The electronic device includes a communication interface and a processor, the processor being configured to: control the communication interface to transmit a signal at a first carrier frequency; determine the first carrier frequency as a search carrier frequency based on the absence of a signal generated when the signal at the first carrier frequency is reflected by a space in which the electronic device is located, received through the communication interface within a first threshold time after the signal at the first carrier frequency is transmitted; control the communication interface to transmit a signal at a second carrier frequency different from the first carrier frequency, based on the receipt of a reflected signal through the communication interface within a first threshold time after the signal at the first carrier frequency is transmitted; control the communication interface to transmit a signal at the determined search carrier frequency; and identify the presence of an object based on whether a signal is received through the communication interface within a second threshold time after the signal at the search carrier frequency is transmitted.

Description

[0001] This application is based upon and claims the benefit of priority from Korean Patent Application No. 10-2020-0118297 filed on September 15, 2020, in the Korean Intellectual Property Office, the disclosure of which is incorporated herein in its entirety by reference. Technical Field

[0002] The present disclosure relates to an electronic device and a control method thereof, and more particularly, to an electronic device that recognizes a user or the user's movement and a control method thereof. Background Art

[0003] With the development of electronic technology, various types of electronic devices are being developed and distributed. In particular, recent electronic devices detect users around the electronic devices and provide various functions based on whether the user is detected.

[0004] Here, the electronic device can detect the user in various ways. For example, the electronic device can use a sensor (such as a passive infrared (PIR) sensor) to detect the user. However, since the operating radius and angle are preset, there is a problem that the sensor cannot reflect the characteristics of the surrounding space. For example, if the distance between the electronic device and the user is within the operating radius of the sensor, the electronic device can detect the user, but if the user is 5 meters or more away from the electronic device or in a space with one side open to the ceiling and wall, the electronic device may not detect the user.

[0005] In addition, the electronic device may detect the user using a camera. However, in this case, there may be a problem regarding power consumption depending on the operation of the camera and the use of resources for recognizing the user from an image captured by the camera.

[0006] Therefore, there is a need to develop a method for improving the accuracy of user detection while solving power consumption or resource issues. Summary of the Invention

[0007] Technical tasks

[0008] The present disclosure aims to provide an electronic device and a control method thereof that are easy to implement and can improve the accuracy of user detection without power and resource issues.

[0009] Technical Solution

[0010] According to an embodiment, an electronic device includes a communication interface and a processor, the processor being configured to: control the communication interface to send a signal of a first carrier frequency, and determine the first carrier frequency as a search carrier frequency based on the fact that a signal generated when the signal of the first carrier frequency is reflected by a space in which the electronic device is set is not received through the communication interface within a first threshold time after the signal of the first carrier frequency is sent; control the communication interface to send a signal of a second carrier frequency different from the first carrier frequency based on the fact that a reflected signal is received through the communication interface within a first threshold time after the signal of the first carrier frequency is sent; control the communication interface to send a signal of the determined search carrier frequency; and identify whether an object exists based on whether a signal is received through the communication interface within a second threshold time after the signal of the search carrier frequency is sent.

[0011] The processor may be configured to recognize the presence of the object based on a signal received within a second threshold time after the signal searching for the carrier frequency is transmitted, and the received signal may be a signal generated when the signal searching for the carrier frequency is reflected by the object.

[0012] The processor may be configured to recognize the presence of the object based on a difference between a carrier frequency of the reflected signal and a search carrier frequency being equal to or smaller than a threshold.

[0013] The device may further include a microphone, and the processor may be configured to: turn on the microphone based on recognizing the presence of the object; and recognize that the object is a user based on a sound received from the turned-on microphone.

[0014] The device may further include a display, and the processor may be configured to, based on recognizing the user when the electronic device operates in the first mode, change the first mode to a second mode and control the display to display a UI corresponding to the second mode.

[0015] The first mode may be a power off mode or a standby mode, and the second mode may be an ambient mode.

[0016] The processor may be configured to control the communication interface to transmit a signal at a second carrier frequency based on a difference between a carrier frequency of the reflected signal and a first carrier frequency being equal to or smaller than a threshold.

[0017] The processor may be configured to control the communication interface to transmit a signal for searching for a carrier frequency at predetermined time intervals based on the recognition that the object exists.

[0018] The processor may be configured to: identify that the object does not exist based on not receiving a signal through the communication interface within a second threshold time after sending a signal to search for a carrier frequency at a predetermined time interval, and re-execute the operation of determining the search for a carrier frequency based on identifying that the object does not exist.

[0019] The communication interface may include an infrared (IR) transmitter and an IR receiver, and the processor may be configured to: control the IR transmitter to transmit a signal of a first carrier frequency, and determine the first carrier frequency as a search carrier frequency based on no reflected signal being received through the IR receiver within a first threshold time after the signal of the first carrier frequency is transmitted; control the IR transmitter to transmit a signal of a second carrier frequency different from the first carrier frequency based on a reflected signal being received through the IR receiver within a first threshold time after the signal of the first carrier frequency is transmitted; control the IR transmitter to transmit a signal of the determined search carrier frequency; and identify whether the object exists based on whether a signal is received through the IR receiver within a second threshold time after the signal of the search carrier frequency is transmitted.

[0020] According to an embodiment, a control method of an electronic device includes: sending a signal of a first carrier frequency, determining the first carrier frequency as a search carrier frequency based on not receiving a signal generated when the signal of the first carrier frequency is reflected by a space in which the electronic device is set within a first threshold time after the signal of the first carrier frequency is sent, sending a signal of a second carrier frequency different from the first carrier frequency based on receiving a reflected signal within a first threshold time after the signal of the first carrier frequency is sent, sending the signal of the determined search carrier frequency, and identifying whether an object exists based on whether a signal is received within a second threshold time after the signal of the search carrier frequency is sent.

[0021] The identifying may include identifying that the object exists based on a signal received within a second threshold time after the signal searching for the carrier frequency is transmitted, and the received signal may be a signal generated when the signal searching for the carrier frequency is reflected by the object.

[0022] The identifying may include identifying that the object exists based on a difference between a carrier frequency of the reflected signal and a search carrier frequency being equal to or less than a threshold.

[0023] The method may further include turning on a microphone based on recognizing that the object exists, and recognizing that the object is a user based on a sound received from the turned-on microphone.

[0024] The method may further include, based on recognizing the user while the electronic device operates in the first mode, changing the first mode to a second mode and displaying a UI corresponding to the second mode.

[0025] The first mode may be a power off mode or a standby mode, and the second mode may be an ambient mode.

[0026] Transmitting the signal at the second carrier frequency may include transmitting the signal at the second carrier frequency based on a difference between the carrier frequency of the reflected signal and the first carrier frequency being equal to or less than a threshold.

[0027] The method may further include transmitting a signal for searching for a carrier frequency at predetermined time intervals based on recognizing the presence of the object.

[0028] The method may further include identifying that the object does not exist based on not receiving a signal through the communication interface within a second threshold time after sending a signal to search for the carrier frequency at a predetermined time interval, and re-performing the operation of determining the search for the carrier frequency based on identifying that the object does not exist.

[0029] Sending a signal of a first carrier frequency may include sending a first IR signal of the first carrier frequency, determining may include determining the first carrier frequency as the search carrier frequency based on not receiving a second IR signal generated when the first IR signal is reflected by a space where an electronic device is provided within a first threshold time after the first IR signal is sent, sending a signal of a second carrier frequency may include sending a third IR signal of a second carrier frequency different from the first carrier frequency based on the second IR signal received within the first threshold time after the first IR signal is sent, sending a signal of the search carrier frequency may include sending a fourth IR signal of the search carrier frequency, and identifying may include identifying whether the object exists based on whether a fifth IR signal is received within a second threshold time after the fourth IR signal of the search carrier frequency is sent.

[0030] Effects of the Invention

[0031] According to the various embodiments described above, the electronic device can adaptively detect a user with respect to the surrounding space of the electronic device by changing the carrier frequency of the sensor.

[0032] In addition, when the sensor detects the user, the electronic device may improve the accuracy of user detection by detecting the user through auxiliary means, such as a microphone.

[0033] In addition, by using a carrier frequency that can pass through the injection-molded object of the electronic device, the sensor can be provided inside the electronic device, and therefore, it can be implemented regardless of the design of the electronic device. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 is a view provided for explaining a space in which an electronic device is provided according to an embodiment;

[0035] Figure 2a is a block diagram showing a configuration of an electronic device according to an embodiment;

[0036] Figure 2b is a block diagram showing a detailed configuration of an electronic device according to an embodiment;

[0037] Figure 3 is a diagram provided for explaining searching for a carrier frequency according to an embodiment;

[0038] Figure 4a and Figure 4b is a diagram provided for explaining a complex sensing operation according to an embodiment;

[0039] Figure 5 is a diagram provided for explaining whether transmitted / received signals are identical according to an embodiment;

[0040] Figure 6a and Figure 6b is a flowchart provided for explaining a change in an operation mode according to an embodiment;

[0041] Figure 7 is a sequence diagram provided for explaining the operation of the security mode according to the embodiment;

[0042] Figure 8 is a sequence diagram provided for explaining a seamless playback operation according to an embodiment; and

[0043] Figure 9 is a flowchart provided for explaining a control method of an electronic device according to an embodiment. DETAILED DESCRIPTION

[0044] Hereinafter, the present disclosure will be described in detail with reference to the accompanying drawings.

[0045] The terms used in the exemplary embodiments of the present disclosure are general terms that are now widely used and are selected in consideration of the functions of the present disclosure. However, these terms may vary according to the intentions of those skilled in the art, precedents, or the emergence of new technologies. In addition, in specific cases, the terms may be arbitrarily selected. In such cases, the meaning of the terms will be explained in the corresponding description. Therefore, the terms used in the present disclosure may be defined based on the meaning of the terms and the content described in the present disclosure, rather than simply based on the names of the terms.

[0046] As used herein, the expressions “have”, “may have”, “include” or “may include” refer to the presence of corresponding features (e.g., numbers, functions, operations or constituent elements (such as components)) and do not exclude one or more additional features.

[0047] The expression “at least one of A and / or B” should be understood to mean either “A” or “B” or “A and B”.

[0048] The expressions “first,” “second,” “the first,” or “the second” used in various exemplary embodiments of the present disclosure may modify various components regardless of their order and / or importance, but do not limit the corresponding components.

[0049] Singular expressions include plural expressions as long as they are clearly distinguished in the context. In the present application, it should be understood that terms such as "comprises" and "includes" are intended to indicate the presence of features, numbers, steps, operations, constituent elements, parts, or combinations thereof described in the specification, and do not exclude the presence or addition of one or more other features, numbers, steps, operations, constituent elements, parts, or combinations thereof.

[0050] In the present disclosure, the term "user" may indicate a person who uses an electronic device or a device (eg, an artificial intelligence electronic device) that uses an electronic device.

[0051] Embodiments of the present disclosure will be described in detail with reference to the accompanying drawings.

[0052] Figure 1 1 is a view provided to explain a space in which the electronic device 100 is provided according to an embodiment.

[0053] The electronic device 100 may be a device that is set in a specific space to detect the presence of an object. Figure 1 As shown, the electronic device 100 may be implemented as a TV to detect the presence of a user. However, the electronic device 100 is not limited thereto, and the electronic device 100 may be any device capable of detecting the presence of an object.

[0054] The electronic device 100 can adaptively detect the presence of an object according to the characteristics of the space where the electronic device 100 is set. For example, when the electronic device 100 is set in a Figure 1 The electronic device 100 may operate differently when in a living room as shown and when it is set up in a room to detect the presence of an object.

[0055] Figure 2a 1 is a block diagram showing the configuration of the electronic device 100 according to the embodiment. Figure 2a As shown, the electronic device 100 includes a communication interface 110 and a processor 120 .

[0056] The communication interface 110 is configured to transmit / receive signals according to various types of communication methods. For example, the communication interface 110 may include an infrared (IR) transmitter and an IR receiver, and may transmit / receive infrared signals.

[0057] In addition, the communication interface 110 can perform communication with various types of external devices according to various types of communication methods. For example, the electronic device 100 can perform communication with the user terminal 200, the server 300, etc. through the communication interface 110.

[0058] The communication interface 110 may include a Wi-Fi module, a Bluetooth module, an infrared communication module, and a wireless communication module. Here, each communication module may be implemented in the form of at least one hardware chip.

[0059] The Wi-Fi module and the Bluetooth module perform communication using the WiFi method and the Bluetooth method, respectively. When the Wi-Fi module or the Bluetooth module is used, various connection information (such as a service set identifier (SSID) and a session key) can be sent and received, communication can be established using the various connection information, and various types of information can be sent or received thereafter. The infrared communication module performs communication according to the Infrared Data Association (IrDA) to wirelessly transmit data over a short distance using infrared rays between visible light and millimeter waves.

[0060] In addition to the above-mentioned communication methods, the wireless communication module may also include at least one communication chip for performing communication according to various wireless communication standards (such as ZigBee, 3rd Generation (3G), 3rd Generation Partnership Project (3GPP), Long Term Evolution (LTE), Advanced LTE (LTE-A), 4th Generation (4G) and 5th Generation (5G)).

[0061] Optionally, the communication interface 110 may include a wired communication interface, such as HDMI, DP, Thunderbolt, USB, RGB, D-SUB, DVI, etc.

[0062] In addition, the communication interface 110 may include at least one of a local area network (LAN) module, an Ethernet module, or a wired communication module for performing communication using a paired cable, a coaxial cable, an optical fiber cable, or the like.

[0063] The processor 120 controls the overall operation of the electronic device 100. Specifically, the processor 120 may be connected to each component of the electronic device 100 to control the overall operation of the electronic device 100. For example, the processor 120 may be connected to a component such as the communication interface 110 and control the operation of the electronic device 100.

[0064] According to an embodiment, the processor 120 may be implemented as a digital signal processor (DSP), a microprocessor, or a time controller (TCON). However, the processor 120 is not limited thereto and may include or be referred to as at least one of a central processing unit (CPU), a microcontroller unit (MCU), a microprocessing unit (MPU), a controller, an application processor (AP), a communication processor (CP), or an ARM processor. Alternatively, the processor 120 may be implemented as a system on chip (SoC) storing a processing algorithm, a large-scale integration (LSI) circuit, or a field programmable gate array (FPGA).

[0065] The processor 120 may control the communication interface 110 to transmit a signal of a specific carrier frequency, and may determine a search carrier frequency based on the specific carrier frequency if no signal is received through the communication interface 110 within a first threshold time after the signal is transmitted.

[0066] For example, the processor 120 may control the communication interface 110 to transmit a signal at a first carrier frequency, and when a signal is received through the communication interface 110 within a first threshold time after the signal at the first carrier frequency is transmitted, the processor 120 may control the communication interface 110 to transmit a signal at a second carrier frequency different from the first carrier frequency. Specifically, when a signal generated when the signal at the first carrier frequency is reflected by a space where an electronic device is located is received through the communication interface 110 within the first threshold time, the processor 120 may control the communication interface 110 to transmit a signal at the second carrier frequency. In other words, the processor 120 may identify whether a signal is received through the communication interface 110 within the first threshold time after the signal is transmitted by gradually changing the carrier frequency.

[0067] Optionally, the processor 120 may control the communication interface 110 to transmit a signal at a first carrier frequency, and when no signal is received via the communication interface 110 within a first threshold time after the signal at the first carrier frequency is transmitted, the first carrier frequency may be determined as the search carrier frequency. Specifically, when no reflected signal is received via the communication interface 110 within the first threshold time, the processor 120 may determine the first carrier frequency as the search carrier frequency. In other words, the processor 120 may gradually change the carrier frequency until no signal is received via the communication interface 110 within the first threshold time after the signal is transmitted.

[0068] Alternatively, when a signal is received through the communication interface 110 within a first threshold time after a signal of a first carrier frequency is transmitted, the processor 120 may control the communication interface 110 to transmit a signal of a second carrier frequency different from the first carrier frequency. In this case, the processor 120 may repeat the above operation until no signal is received through the communication interface 110 within the first threshold time, and when it is recognized that the transmitted signal is not being received, the carrier frequency corresponding to the time point when no signal is received may be determined as the search carrier frequency.

[0069] Alternatively, when no signal is received through the communication interface 110 within a first threshold time after a signal of a first carrier frequency is transmitted, the processor 120 may control the communication interface 100 to transmit a signal of a second carrier frequency different from the first carrier frequency. In this case, the processor 120 may repeatedly perform the above-described operations until a signal is received through the communication interface 110 within the first threshold time, and when it is recognized that a signal has not been received and then a signal is being received, the carrier frequency corresponding to the time point when no signal was last received may be determined as the search carrier frequency.

[0070] In other words, the processor 120 may determine the search carrier frequency based on whether the reception of the signal changes within the first threshold time after the signal of the specific carrier frequency is transmitted. Here, the processor 120 may gradually increase the carrier frequency when a signal is received within the first threshold time, and may gradually decrease the carrier frequency when no signal is received within the first threshold time. However, the present disclosure is not limited thereto, and the processor 120 may gradually decrease the carrier frequency when a signal is received within the first threshold time, and may gradually increase the carrier frequency when no signal is received within the first threshold time.

[0071] Through the above operation, the processor 120 can reflect the characteristics of the space where the electronic device 100 is installed. Specifically, the signal transmitted from the electronic device 100 is reflected toward the surrounding space, and the processor 120 can receive the reflected signal through the communication interface 110. In this case, the reception rate varies according to the magnitude of the carrier frequency, and the processor 120 identifies the carrier frequency at which no signal is received, and then recognizes the presence of an object to be described later based on the identified carrier frequency.

[0072] Here, the identified carrier frequency is determined by the current space, and when the space is changed, the carrier frequency can also be changed. In other words, by using a method of gradually changing the carrier frequency, operation adapted to the space is possible.

[0073] Meanwhile, in the above description, there is no particular limitation on the signal received after the signal is transmitted, but the present disclosure is not limited thereto. For example, when the difference between the carrier frequency of the reflected signal and the first carrier frequency is equal to or less than a threshold, the processor 120 may control the communication interface 110 to transmit the signal at the second carrier frequency. In other words, the processor 120 may identify whether the transmitted signal and the received signal are the same, and only when they are identified as being the same, may control the communication interface 110 to transmit the signal at the second carrier frequency, and when they are identified as being different, may determine the corresponding carrier frequency as the search carrier frequency.

[0074] When the search carrier frequency is determined in the above method, the processor 120 can control the communication interface 110 to send a signal to search the carrier frequency, and can identify the presence of the object based on whether a signal is received through the communication interface within a second threshold time after the signal to search the carrier frequency is sent.

[0075] For example, when a signal is received through the communication interface 110 within a second threshold time after the signal for searching the carrier frequency is transmitted, the processor 120 may recognize that an object exists. Here, the received signal may be a signal generated when the signal for searching the carrier frequency is reflected by the object.

[0076] Meanwhile, in the above description, there is no particular limitation on the signal received after the signal at the search carrier frequency is transmitted, but the present disclosure is not limited thereto. For example, when the difference between the carrier frequency of the signal reflected by the object and the search carrier frequency is equal to or less than a threshold, the processor 120 may recognize the presence of an object. In other words, the processor 120 may recognize whether the signal transmitted at the search carrier frequency and the received signal are identical, and only when they are identified as identical, recognize the presence of an object. If the signals are identified as different, the processor 120 may recognize the absence of an object.

[0077] At the same time, the electronic device 100 also includes a microphone, and when the presence of an object is recognized, the processor 120 can turn on the microphone and identify whether the object is a user based on the sound received from the turned-on microphone. In other words, while reducing power consumption, the processor 120 can recognize whether the object is present through the communication interface 110, and then, by turning on the microphone, can identify whether the object is a user.

[0078] In addition, the electronic device 100 may include a stereo microphone, and the processor 120 may recognize the direction of the user through the stereo microphone. In this case, the stereo microphones may be respectively provided on opposite sides of the center of the electronic device 100.

[0079] However, the electronic device 100 is not limited thereto and may further include any component for enhancing the accuracy of identifying an object. For example, the electronic device 100 may further include a camera, and when the presence of an object is recognized, the processor 120 may turn on the camera and identify whether the object is a user based on an image received from the turned-on camera.

[0080] When the presence of the object is recognized, the processor 120 may control the communication interface 110 to transmit a signal for searching for a carrier frequency at predetermined time intervals. In other words, the processor 120 may periodically recognize whether the presence of the object is maintained after recognizing the object.

[0081] However, the present invention is not limited thereto, and the processor 120 may control the communication interface 110 to transmit a signal for searching for a carrier frequency at a predetermined first time interval, and when the presence of an object is detected, the processor 120 may control the communication interface 110 to transmit a signal for searching for a carrier frequency at a predetermined second time interval. In other words, the processor 120 may periodically detect the presence of an object, and then, when the presence of an object is detected, the processor 120 may change the period. For example, when the presence of an object is detected, the processor 120 may control the communication interface 110 to transmit a signal for searching for a carrier frequency at a further reduced time interval.

[0082] When no signal is received through the communication interface 110 within a second threshold time after the signal for searching the carrier frequency is transmitted at a predetermined time interval, the processor 120 may recognize that the object does not exist and control the communication interface 110 to retransmit the signal of the specific carrier frequency. When no signal is received through the communication interface 110 within a first threshold time after the signal is retransmitted, the processor 120 may update the search carrier frequency based on the specific carrier frequency.

[0083] In other words, when the presence of an object is recognized and then the object is not recognized again, the processor 120 can adaptively change to the search carrier frequency of the space where the electronic device 100 is located by performing an operation of updating the search carrier frequency. This operation may be common when the user changes the arrangement of home appliances, furniture, etc. in the space.

[0084] At the same time, the communication interface 110 may include an IR transmitter and an IR receiver, and the processor 120 may control the IR transmitter to send a signal of a specific carrier frequency, and after the signal is sent, when no signal is received through the IR receiver within a first threshold time, the search carrier frequency may be determined based on the specific carrier frequency, and by controlling the IR transmitter to send the signal of the search carrier frequency, it may be possible to identify whether an object exists based on whether a signal is received through the IR receiver within a second threshold time after the signal of the search carrier frequency is sent.

[0085] In other words, the processor 120 may use infrared signals to identify whether an object exists. However, the present invention is not limited thereto, and any standard may be used as long as it is a communication standard capable of identifying the presence of an object by gradually changing a carrier frequency.

[0086] Figure 2b 1 is a block diagram showing a detailed configuration of an electronic device according to an embodiment. The electronic device 100 may include a communication interface 110 and a processor 120. Figure 2b , the electronic device 100 may further include a memory 130, a microphone 140, a display 150 and a user interface 160. Figure 2b The components shown are Figure 2a The components shown overlap with detailed descriptions of the components.

[0087] The memory 130 may refer to hardware that stores information (such as data) in an electrical or magnetic form so that it can be accessed by the processor 120, etc. To this end, the memory 130 may be implemented as hardware of at least one of a non-volatile memory, a volatile memory, a flash memory, a hard disk drive (HDD) or a solid-state drive (SSD), a RAM, a ROM, etc.

[0088] At least one instruction or module required for the operation of the electronic device 100 or the processor 120 may be stored in the memory 130. Here, an instruction is a code unit for instructing the operation of the electronic device 100 or the processor 120 and may be written in a machine language that is a computer-understandable language. A module may be a set of instructions that performs a specific task of a work unit.

[0089] The memory 130 may store data, which is information in units of bits or bytes that may represent characters, numbers, images, etc. For example, a module for identifying a search carrier frequency may be stored in the memory 130 .

[0090] The memory 130 is accessed by the processor 120 , and the processor 120 may perform reading / recording / modification / deletion / update, etc. of instructions, modules, or data.

[0091] The microphone 140 is configured to receive a user's voice or other sounds and convert them into audio data.

[0092] The display 150 may be implemented as various forms of displays, such as a liquid crystal display (LCD), an organic light emitting diode (OLED) display, a plasma display panel (PDP), etc. The display 150 may further include a driving circuit, a backlight circuit, etc., which may be implemented in the form of a-Si TFT, low temperature polycrystalline silicon (LTPS) TFT, an organic TFT (OTFT), etc. At the same time, the display 150 may be implemented as a touch screen combined with a touch sensor, a flexible display, a 3D display, etc.

[0093] The user interface 160 may be implemented as a button, a touchpad, a mouse, or a keyboard, or may be implemented as a touch screen that can also perform the above-mentioned display function and manipulation / input function. Here, the button may be various types of buttons (such as mechanical buttons, touchpads, scroll wheels, etc.) formed in any area (such as the front, side, or rear of the exterior of the main body of the electronic device 100).

[0094] In this way, the electronic device 100 may recognize the search carrier frequency and recognize the presence of the object by transmitting a signal of the search carrier frequency.

[0095] Hereinafter, the operation of the electronic device 100 will be explained in more detail with reference to the accompanying drawings.

[0096] Figure 3 FIG. 1 is a diagram provided to explain searching for a carrier frequency according to an embodiment. Figure 3 In the figure, the x-axis represents the amplitude of the carrier frequency, and the y-axis represents the reception rate.

[0097] The processor 120 may control the communication interface 110 to transmit a signal having a carrier frequency of approximately 38 kHz, which has the best reception rate. When a signal is received through the communication interface 110 within a first threshold time after the signal was transmitted, the processor 120 may receive the signal by changing the carrier frequency. For example, the processor 120 may control the communication interface 110 to transmit a signal having a carrier frequency of 40 kHz. The processor 120 may repeat this operation until no signal is received through the communication interface 110 within the first threshold time after the signal was transmitted.

[0098] For example, the processor 120 may control the communication interface 110 to transmit a signal of a carrier frequency of 48 kHz, and when no signal is received through the communication interface 110 within a first threshold time after the signal is transmitted, the search carrier frequency may be determined based on the carrier frequency of 48 kHz.

[0099] For example, the processor 120 may determine a carrier frequency of 48 kHz as the search carrier frequency. Alternatively, the processor 120 may determine a carrier frequency of 50 kHz as the search carrier frequency by rounding the carrier frequency. However, the present invention is not limited thereto, and the search carrier frequency may be determined in any manner as long as it is 48 kHz or higher.

[0100] Meanwhile, in the above description, the processor 120 initially transmits a signal of a carrier frequency having the best reception rate, but the search operation may also be performed in other frequencies. For example, the processor 120 may control the communication interface 110 to first transmit a signal of a previously set search carrier frequency. In this case, the amplitude of the search carrier frequency may be gradually reduced according to changes in the position of the electronic device 100 and changes in the arrangement of household appliances and furniture in the space. For example, when an object is no longer recognized, the processor 120 may control the communication interface 110 to first transmit a signal of a search carrier frequency, and when no signal is received through the communication interface 110 within the first threshold time, the communication interface 110 may be controlled to transmit a signal of a carrier frequency less than the search carrier frequency.

[0101] Figure 4a and Figure 4b 2 is a diagram provided to explain a complex sensing operation according to an embodiment.

[0102] Figure 4a 1 is a diagram showing that the IR transmitter 110 - 1 , the IR receiver 110 - 2 , and the microphones 140 - 1 and 140 - 2 are implemented as one module.

[0103] like Figure 4a As shown, the IR transmitter 110-1 and the IR receiver 110-2 may be provided in one module, and when the IR transmitter 110-1 uses a carrier frequency that can pass through the injection molding of the electronic device 100, the module may be provided inside the electronic device 100. The IR receiver 110-2 may also receive a signal of the corresponding carrier frequency.

[0104] like Figure 4b As shown, microphones 140-1 and 140-2 are respectively provided on each side of the module, and when a signal is received by the IR receiver 110-2 within a second threshold time after the signal of the target carrier frequency is transmitted by the IR transmitter 110-1 (410), the module can be turned on and receive ambient sound.

[0105] When the presence of a user is detected by microphones 140-1 and 140-2, the mode of electronic device 100 can be changed to ambient mode. In addition, processor 120 can identify the direction of sound through two microphones 140-1 and 140-2 and perform various interactions with the user based on the direction of the sound. For example, processor 120 can provide a UI effect in the direction of the sound or display a UI in a touch-operable area in the direction of the sound.

[0106] Here, ambient mode can be a mode for displaying additional information when the user is not viewing content. For example, electronic device 100 can display additional information in response to a shutdown command or a command to enter ambient mode. The additional information can be at least one of weather, time, or real-time news. Alternatively, the additional information can be an image identical to the surface of the wall behind electronic device 100. In this case, the user can only recognize the edges of electronic device 100 and identify the display area of ​​electronic device 100 as a wall, thereby minimizing the sense of heterogeneity caused by electronic device 100.

[0107] However, the present disclosure is not limited thereto, and the electronic device 100 may operate in ambient mode under various conditions. For example, when the presence of a user is recognized, the electronic device 100 may operate in ambient mode. Alternatively, when it is recognized that the user has been viewing content and the presence of the user is no longer recognized or the user's attention is not recognized, the electronic device 100 may operate in ambient mode.

[0108] at the same time, Figure 4a The module of may be only an example, and the module may be implemented in other forms, such as a module including an IR transmitter / receiver and a microphone. For example, Figure 4a Each of the IR transmitter 110 - 1 , the IR receiver 110 - 2 , and the microphones 140 - 1 , 140 - 2 in FIG. 1 may be implemented as a separate module.

[0109] Figure 5 is a view provided to explain determination of whether transmitted / received signals are identical according to an embodiment.

[0110] like Figure 5 As shown, the IR transmitter signal and the IR receiver signal may have different periods and phases. Specifically, since the IR transmitter signal may have a period t1 and the IR receiver signal may have a period t2, the IR transmitter signal and the IR receiver signal may differ from each other. This is because there is a possibility that the frequency may change due to reflection.

[0111] The processor 120 may identify whether the signals are the same based on the periods of the IR transmitter signal and the IR receiver signal. For example, when the period difference between the IR transmitter signal and the IR receiver signal is within a first threshold, the processor 120 may identify that the two signals are the same.

[0112] Alternatively, the processor 120 may determine whether the two signals are identical based on a phase difference (t3) between the IR transmitter signal and the IR receiver signal. For example, when the phase difference between the IR transmitter signal and the IR receiver signal is within a second threshold, the processor 120 may determine that the two signals are identical.

[0113] As described above, the processor 120 may determine to search for a carrier frequency or identify the presence of an object based on whether two signals are identical.

[0114] Figure 6a and Figure 6b 1 is a flowchart provided for explaining a change in an operation mode according to an embodiment. Figure 6a and Figure 6b In , it is assumed that the search carrier frequency is determined.

[0115] First, if Figure 6a As shown, the electronic device 100 may be turned on and operated in a power-on mode (S610). The electronic device 100 may display a screen and output sound in the power-on mode.

[0116] Subsequently, the processor 120 can recognize the presence of the object by controlling the IR transmitter (LED) and the IR receiver (S615, S620). Specifically, when a signal is suddenly received in a state where no signal is received by the IR receiver, the processor 120 can recognize that the object exists (S620-Yes).

[0117] When the presence of an object is detected, the processor 120 may turn on the microphone and identify whether the object is a user based on the sound received from the turned-on microphone (S625). When the absence of a user is detected (S630), the operating mode of the processor 120 and the electronic device 100 may be changed to a screen-off mode (S635). In the screen-off mode, the electronic device 100 may only output sound without providing a screen.

[0118] When the electronic device 100 enters the screen off mode, the processor 120 may identify the presence of an object by controlling the IR transmitter (LED) and the IR receiver (S640). When a predetermined time has passed after the screen off mode operation (S645-Yes), the processor 120 may identify the presence of a user by camera shooting or the like (S650). When the presence of a user is not identified (S655-No), the processor 120 may change the operating mode of the electronic device 100 to the standby mode, and when the presence of a user is identified (S655-Yes), the processor 120 may change the operating mode of the electronic device 100 to the power on mode (S680). The electronic device 100 does not provide a screen nor output sound in the standby mode.

[0119] Alternatively, within a predetermined time after the screen off mode starts (S645-No), the processor 120 may recognize the presence of an object by controlling the IR transmitter (LED), the IR receiver, and the microphone (S665, S670). Subsequently, when it is recognized that a user is present (S675), the processor 120 may change the operating mode of the electronic device 100 to the power on mode (S680).

[0120] At the same time, Figure 6a and Figure 6b In the description, the presence of the user is recognized by a microphone or a camera, but the present disclosure is not limited thereto. For example, any sensor capable of recognizing the presence of the user may be used instead of a microphone or a camera. Figure 6a and Figure 6b In the embodiment, the processor 120 may omit the step of recognizing the presence of the user through the microphone or the camera, and recognize the presence of the user based only on the received IR signal.

[0121] As described above, the processor 120 may change the operation mode of the electronic device 100 based on at least one of whether an object exists or when a specific mode is entered.

[0122] Figure 7 is a sequence diagram provided for explaining the operation of the security mode according to the embodiment.

[0123] First, the user terminal 200 may receive an outgoing mode request input (S710). In this case, the user terminal 200 may send an outgoing mode request message to the server 300 (S720), the server 300 may enter the outgoing mode (S730), and outgoing mode determination information may be sent to the electronic device 100 and the user terminal 200 (S740-1, S740-2).

[0124] According to the user's outing, the electronic device 100 can recognize the presence of an outsider through the IR transmitter / receiver and the microphone (S750), and when an outsider is detected, corresponding information can be sent to the server 300 (S760). The server 300 can provide the detection information of the outsider to the user terminal 200 (S770), and the user terminal 200 can provide the user with an outsider intrusion notification (S780).

[0125] Figure 7 The electronic device 100 and the server 300 are shown as separate devices, but the present disclosure is not limited thereto. The electronic device 100 may function as the server 300.

[0126] Figure 8 1 is a sequence diagram for illustrating a seamless playback operation according to an embodiment. Figure 8 It is shown that each of the electronic device 100 and the another electronic device 400 is a TV.

[0127] The electronic device 100 (TV1) and the other electronic device 400 (TV2) may operate in a power-on mode and a standby mode (S810), and recognize the presence of a user through an IR transmitter / receiver and a microphone, respectively (S820, S850).

[0128] When the user is no longer recognized while the presence of the user is recognized (S830), the electronic device 100 may transmit information indicating that the user is not recognized, current playback channel, content, and playback time information to the server 300 (S840).

[0129] Subsequently, when the other electronic device 400 recognizes the presence of the user using the IR transmitter / receiver and the microphone (S850, S860), the corresponding information may be sent to the server 300 (S870). The server 300 may send the current playback channel, content, and playback time information received from the electronic device 100 to the other electronic device 400 (S880), and the other electronic device 400 may operate in the power-on mode (S890) and provide content to the user based on the information received from the server. In this case, the electronic device 100 may change the operating mode to the standby mode. Through the above operations, the user can seamlessly use the content provision service.

[0130] Meanwhile, in the above description, the electronic device 100 and the other electronic device 400 directly identify the presence of the user, but the present disclosure is not limited thereto. For example, when the electronic device 100 operates as an IoT hub, the electronic device 100 may identify the presence of the user through an IR transmitter / receiver, and when the presence of the user is identified, the IoT device (thing) connected to the electronic device 100 may be identified and sensing data may be requested from the identified IoT device. Alternatively, when the presence of the user is identified, the electronic device 100 may identify the IoT device connected to the electronic device 100, and request sensing data from the IoT device having a sensor capable of identifying the presence of the user among the identified IoT devices. The electronic device 100 may secondary identify the presence of the user based on the sensing data received from the IoT device, thereby improving accuracy. Here, the IoT device may include a household appliance equipped with a sensor for identifying the presence of the user and the sensor itself for identifying the presence of the user.

[0131] Alternatively, even before recognizing the presence of a user, the electronic device 100 may recognize an IoT device connected to the electronic device 100 and request sensing data from the recognized IoT device. In this case, the electronic device 100 may recognize the presence of a user who is beyond the range recognizable by the electronic device 100. For example, Figure 8In an embodiment, the electronic device 100 may receive sensing data indicating the presence of a user around another electronic device 400. Subsequently, when the presence of a user is detected around the electronic device 100, the electronic device 100 may request and receive information about the current playback channel, content, and playback time of the other electronic device 400. The electronic device 100 may seamlessly provide content provision services based on the received information. In addition, the electronic device 100 may send a control signal to the other electronic device 400 for changing the mode of the other electronic device 400.

[0132] Alternatively, the electronic device 100 may be indirectly connected to the IoT device via an access point (AP) rather than being directly connected to the IoT device. In this case, the electronic device 100 may request sensing data from the AP, and the AP may request sensing data from the IoT device. The AP may transmit the sensing data received from the IoT device to the electronic device 100.

[0133] However, the present disclosure is not limited thereto, and the collection of sensing data by the AP may be independent of the request of the electronic device 100. For example, the AP may request and store sensing data from the IoT device at predetermined time intervals. In this case, the AP may transmit the sensing data within a predetermined time range before and after the time point of the request of the electronic device 100 according to the request of the electronic device.

[0134] Figure 9 is a flowchart provided for explaining a control method of an electronic device according to an embodiment.

[0135] First, a signal of a first carrier frequency is transmitted (S910). Subsequently, if a signal generated when the signal of the first carrier frequency is reflected by a space in which an electronic device is provided is not received within a first threshold time after the signal of the first carrier frequency is transmitted, the first carrier frequency is determined as a search carrier frequency (S920). If a reflected signal is received within the first threshold time after the signal of the first carrier frequency is transmitted, a signal of a second carrier frequency different from the first carrier frequency is transmitted (S930).

[0136] Subsequently, the determined signal for searching the carrier frequency is transmitted (S940). The presence of the object is recognized based on whether a signal is received within a second threshold time after the signal for searching the carrier frequency is transmitted (S950).

[0137] Here, the identifying step (S950) may include identifying that an object exists when a signal is received within a second threshold time after the signal searching for the carrier frequency is transmitted, and the received signal may be a signal generated when the signal searching for the carrier frequency is reflected by the object.

[0138] In addition, the identifying step (S950) may include identifying that the object exists when a difference between the carrier frequency of the reflected signal and the search carrier frequency is equal to or less than a threshold value.

[0139] Meanwhile, this step may further include: when it is recognized that the object exists, turning on a microphone provided in the electronic device, and recognizing whether the object is a user based on a sound received from the turned-on microphone.

[0140] Here, the step may further include, when the user is recognized while the electronic device operates in the first mode, changing the first mode to the second mode and displaying a UI corresponding to the second mode.

[0141] The first mode may be a power off mode or a standby mode, and the second mode may be an ambient mode.

[0142] The step of transmitting the signal of the second carrier frequency ( S930 ) may include transmitting the signal at the second carrier frequency when a difference between the carrier frequency of the reflected signal and the first carrier frequency is equal to or less than a threshold value.

[0143] Meanwhile, this step may further include: when the presence of the object is recognized, transmitting a signal for searching the carrier frequency at predetermined time intervals.

[0144] Here, the step may further include: when no signal is received within a second threshold time after sending a signal for searching the carrier frequency at a predetermined time interval, identifying that the object does not exist, and when identifying that the object does not exist, re-performing the operation of determining the search carrier frequency.

[0145] At the same time, the step (S910) of sending a signal of a first carrier frequency may include: sending a first IR signal of the first carrier frequency, the determining step (S920) may include: when a second IR signal generated when the first IR signal is reflected by a space in which an electronic device is set is not received within a first threshold time after the first IR signal is sent, determining the first carrier frequency as the search carrier frequency, the step (S930) of sending a signal of a second carrier frequency may include: when a second IR signal is received within a first threshold time after the first IR signal is sent, sending a third IR signal of a second carrier frequency different from the first carrier frequency, the step (S940) of sending a signal of a search carrier frequency may include: sending a fourth IR signal of the search carrier frequency, and the identifying step (S950) may include: identifying the presence of an object based on whether a fifth IR signal is received within a second threshold time after the fourth IR signal of the search carrier frequency is sent.

[0146] According to the various embodiments described above, the electronic device can adaptively detect a user with respect to the surrounding space of the electronic device by changing the carrier frequency of the sensor.

[0147] In addition, when the presence of a user is detected by a sensor, the accuracy of user detection may be improved by detecting the user through an auxiliary device such as a microphone.

[0148] Furthermore, since a carrier frequency capable of passing through injection molding of an electronic device is used, the sensor can be provided inside the electronic device and it can be implemented regardless of the design of the electronic device.

[0149] At the same time, according to an embodiment of the present disclosure, the various embodiments described above may be implemented as software including instructions stored in a machine-readable storage medium that is readable by a machine (e.g., a computer). A machine is a device that can call instructions stored in a storage medium and operate according to the called instructions, and may include an electronic device (e.g., electronic device A) according to the embodiments described herein. When the instruction is executed by a processor, the function corresponding to the command may be executed directly by the processor or using other components under the control of the processor. The instruction may include code generated or executable by a compiler or interpreter. The machine-readable storage medium may be provided as a non-temporary storage medium. Here, the term "non-temporary" means that the storage medium does not include a signal and is tangible, but does not indicate whether the data is stored in the storage medium semi-permanently or temporarily.

[0150] In addition, according to an embodiment of the present disclosure, the method according to the various embodiments of the present disclosure described above can be provided by being included in a computer program product. The computer program product can be traded between a seller and a buyer as a product. The computer program product can be distributed in the form of a machine-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)), or can be downloaded through an application store (e.g., PlayStore). TM When distributed online, at least some of the computer program product may be temporarily stored or generated in a storage medium, such as a manufacturer's server, an application store's server, or a memory of a relay server.

[0151] According to the embodiment, the various embodiments of the present disclosure described above can be implemented in a recording medium readable by a computer or the like using software, hardware, or a combination thereof. In some cases, the embodiments described herein can be implemented as a processor. According to software implementation, the embodiments of the processes and functions described herein can be implemented as separate software modules. Each of the software modules can perform one or more of the functions and operations described herein.

[0152] Computer instructions for executing the processing operations of the apparatus according to the various embodiments described above may be stored in a non-transitory computer-readable medium. When the computer instructions stored in the non-transitory computer-readable medium are executed by the processor of the machine, the processing operations of the machine according to the various embodiments described above are executed by the specific machine. Non-transitory computer-readable media should be understood to mean a medium that stores data semi-permanently and can be read by a machine, rather than a medium that stores data for a short period of time (such as a register, cache, or memory). Examples of non-transitory computer-readable media may include CDs, DVDs, hard disks, Blu-ray discs, USBs, memory cards, and ROMs.

[0153] Each component (e.g., module or program) according to the various embodiments described above may include a single or multiple entities, and some of the subcomponents described above may be omitted, or other subcomponents may be further included in various embodiments. Typically or additionally, some components (e.g., modules or programs) may be integrated into an entity that performs the functions performed by the components in the same or similar manner. According to various embodiments, operations may be performed by modules, programs, or other components in a sequential, parallel, repetitive, or heuristic manner, at least some operations may be performed in a different order or omitted, or other operations may be added.

[0154] Although embodiments of the present disclosure have been shown and described herein, the present disclosure is not limited thereto, and various modifications may be made by one of ordinary skill in the art without departing from the spirit of the present disclosure as defined in the appended claims, and should not be understood separately from the technical ideas or prospects of the present disclosure.

Claims

1. An electronic device comprising: Communication interface; as well as A processor configured to: Controlling the communication interface to send a signal of a first carrier frequency; Based on receiving a first reflected signal through the communication interface, controlling the communication interface to transmit a signal of a second carrier frequency different from the first carrier frequency, the first reflected signal being generated by reflection of the transmitted signal of the first carrier frequency by a space in which the electronic device is disposed; determining the second carrier frequency as the search carrier frequency based on the absence of a second reflected signal received through the communication interface after the signal at the second carrier frequency is transmitted, the second reflected signal being generated by reflection of the transmitted signal at the second carrier frequency by a space in which the electronic device is disposed; Controlling the communication interface to send a signal for determining a search carrier frequency; as well as Whether an object exists is identified based on whether a third reflected signal generated by the transmission signal of the determined search carrier frequency is received through the communication interface after the signal at the determined search carrier frequency is transmitted.

2. The device according to claim 1, wherein The processor is configured to: identify the presence of the object based on receiving a third reflected signal after the signal at the determined search carrier frequency is transmitted, The third reflected signal is a signal generated when the signal of the determined search carrier frequency is reflected by the object.

3. The device according to claim 2, wherein The processor is configured to recognize that the object exists based on a difference between a carrier frequency of the third reflected signal and a determined search carrier frequency being equal to or smaller than a threshold.

4. The apparatus according to claim 1, further comprising: microphone, Wherein, the processor is configured to: upon recognizing the presence of the object, turning on the microphone; and The object is recognized as a user based on the sound received from the turned-on microphone.

5. The apparatus according to claim 4, further comprising: monitor, Wherein, the processor is configured to: Based on identifying the user while the electronic device is operating in the first mode, changing the first mode to a second mode; and The display is controlled to display a UI corresponding to the second mode.

6. The device according to claim 5, wherein The first mode is a power-off mode or a standby mode, and Among them, the second mode is the ambient mode.

7. The apparatus according to claim 1, wherein The processor is configured to control the communication interface to transmit a signal of a second carrier frequency based on a difference between a carrier frequency of the first reflected signal and the first carrier frequency being equal to or smaller than a threshold.

8. The apparatus according to claim 1, wherein The processor is configured to control the communication interface to transmit a signal of the determined search carrier frequency at predetermined time intervals based on the recognition that the object exists.

9. The apparatus according to claim 8, wherein The processor is configured to: recognizing that the object does not exist based on not receiving a signal through the communication interface after transmitting a signal of the determined search carrier frequency at the predetermined time interval; and Based on the recognition that the object does not exist, the operation of determining the search carrier frequency is re-performed.

10. The apparatus according to claim 1, wherein The communication interface includes: Infrared (IR) transmitter; and IR receiver, Wherein, the processor is configured to: controlling the IR transmitter to transmit a signal of a first carrier frequency; controlling the IR transmitter to transmit a signal of a second carrier frequency different from the first carrier frequency based on receiving a first reflected signal through the IR receiver, wherein the first reflected signal is generated by reflection of the transmitted signal of the first carrier frequency by a space in which the electronic device is located; determining the second carrier frequency as the search carrier frequency based on the absence of a second reflected signal received by the IR receiver after the signal at the second carrier frequency is transmitted, the second reflected signal being generated by reflection of the transmitted signal at the second carrier frequency by a space in which the electronic device is located; controlling the IR transmitter to transmit a signal of the determined search carrier frequency; and Whether the object exists is identified based on whether a third reflected signal generated by the transmission signal of the determined search carrier frequency is received by the IR receiver after the signal at the determined search carrier frequency is transmitted.

11. A method for controlling an electronic device, comprising: sending a signal at a first carrier frequency; transmitting a signal of a second carrier frequency different from the first carrier frequency based on the reception of a first reflected signal, wherein the first reflected signal is generated by the transmission signal of the first carrier frequency being reflected by a space in which the electronic device is disposed; determining the second carrier frequency as the search carrier frequency based on not receiving a second reflected signal after the signal at the second carrier frequency is transmitted, the second reflected signal being generated by reflection of the transmitted signal at the second carrier frequency by a space in which the electronic device is disposed; Sending a signal for determining a search carrier frequency; as well as Whether or not the object exists is identified based on whether or not a third reflected signal generated by the transmission signal of the determined search carrier frequency is received after the signal at the determined search carrier frequency is transmitted.

12. The method according to claim 11, wherein The identifying includes: identifying that the object exists based on receiving a third reflected signal after the signal at the determined search carrier frequency is transmitted, The third reflected signal is a signal generated when the signal of the determined search carrier frequency is reflected by the object.

13. The method according to claim 12, wherein: The identifying includes identifying that the object exists based on a difference between a carrier frequency of the third reflected signal and a determined search carrier frequency being equal to or smaller than a threshold.

14. The method according to claim 11, further comprising: upon recognizing the presence of the object, turning on the microphone; as well as The object is identified as a user based on the sound received from the open microphone.

15. The method according to claim 14, further comprising: based on identifying the user while the electronic device is operating in the first mode, changing the first mode to a second mode; as well as A UI corresponding to the second mode is displayed.

Images