Display device, and method for controlling IoT device using same

The display device's processor enables continuous IoT hub functionality by controlling IoT devices through function key inputs in both normal and standby modes, addressing the limitation of requiring a separate application when turned off, thus enhancing convenience and usage range.

WO2024232530A1PCT designated stage expired Publication Date: 2024-11-14SAMSUNG ELECTRONICS CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2024/003357
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-08
Filing Date
2024-03-18
Publication Date
2024-11-14

AI Technical Summary

Technical Problem

Display devices can only perform IoT hub functions when turned on, requiring a separate application to manage IoT devices when turned off, limiting their functionality and convenience.

Method used

A display device with a processor that executes instructions to control both displayed images and IoT devices based on function key inputs in normal and standby modes, allowing for continuous IoT hub functionality by mapping function keys to control operations such as power, temperature, direction, intensity, and mode controls for IoT devices.

Benefits of technology

Enables continuous IoT hub functionality regardless of the device's operation mode, expanding its usage and convenience by allowing control of IoT devices through function key inputs in both normal and standby modes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2024003357_14112024_PF_FP_ABST
    Figure KR2024003357_14112024_PF_FP_ABST
Patent Text Reader

Abstract

A display device according to embodiments of the present invention may comprise memory storing at least one command, and at least one processor executing the at least one command. The at least one processor can: set at least one control action corresponding to at least one function key input; detect the at least one function key input on the basis of at least one user input received from a control device; determine the operation mode at the time when the at least one function key input was detected; and perform the at least one control action on the basis of the operation mode and the at least one function key input. The at least one control action may include at least one of a first control action for controlling a displayed image or a second control action for controlling at least one IoT device.
Need to check novelty before this filing date? Find Prior Art

Description

Display device and method for controlling IoT devices using the same

[0001] Various embodiments of the present disclosure relate to a display device that performs a control operation based on a user input and a method for controlling an IoT device using the same.

[0002] A display device is a device that displays images for the user to view. Users can watch broadcasts through the display device. The display device displays the broadcast signals transmitted by the broadcasting station, selected by the user.

[0003] Digital broadcasting refers to broadcasting that transmits digital video and audio signals. Compared to analog broadcasting, digital broadcasting is more resistant to external noise, has less data loss, is more prone to error correction, and offers higher resolution and clearer images. Furthermore, unlike analog broadcasting, digital broadcasting allows for two-way communication.

[0004] Additionally, smart TVs are now available, offering a variety of content in addition to digital broadcasting capabilities. Rather than passively responding to user preferences, smart TVs aim to analyze and provide what users want without user intervention.

[0005] Internet of Things (IoT) systems require a hub to monitor the status of IoT devices and transmit the monitored information to a server. For example, a display device can function as an IoT hub in an IoT system.

[0006] Meanwhile, since the display device can perform the IoT hub function only when the power is on, the Internet of Things system requires a separate application to perform the IoT hub function when the display device is turned off.

[0007] Various embodiments of the present disclosure can provide a display device that controls an image displayed according to a function key input in a normal mode and controls an IoT device according to a function key input in a standby mode, and a method for controlling an IoT device using the same.

[0008] A display device according to embodiments of the present disclosure may include a memory that stores at least one command, and at least one processor that executes at least one command. The at least one processor may set at least one control action corresponding to at least one function key input. The at least one processor may detect the at least one function key input based on at least one user input received from a control device. The at least one processor may determine an operation mode at a time when the at least one function key input is detected. The at least one processor may perform the at least one control operation based on the operation mode and the at least one function key input. The at least one control operation may include at least one of a first control operation for controlling a displayed image and a second control operation for controlling at least one IoT device.

[0009] In one embodiment, the driving mode may include at least one of a normal mode that displays an image and a standby mode that does not display an image.

[0010] In one embodiment, the at least one processor can perform the first control operation based on the at least one function key input in the normal mode. The at least one processor can perform the second control operation based on the at least one function key input in the standby mode.

[0011] In one embodiment, the at least one processor can match the at least one IoT device to the at least one function key input. The at least one processor can map a control value to the at least one function key input.

[0012] In one embodiment, the control value may include a basic control value and an additional control value for the at least one IoT device. The basic control value may include power control of the at least one IoT device. The additional control value may include at least one of temperature control, direction control, intensity control, and mode control of the at least one IoT device.

[0013] In one embodiment, the at least one processor may map power control of the at least one IoT device to the at least one function key input. The at least one processor may map at least one of temperature control, direction control, intensity control, and mode control of the at least one IoT device to at least one of a direction key input, a channel key input, and a volume key input.

[0014] In one embodiment, the at least one processor may perform a power control operation for the at least one IoT device based on the at least one function key input in a standby mode.

[0015] In one embodiment, the at least one processor can perform at least one of a temperature control operation, a direction control operation, a strength control operation, and a mode control operation for the at least one IoT device based on at least one of a direction key input, a channel key input, and a volume key input in the standby mode.

[0016] A control device according to embodiments of the present disclosure may include a memory that stores at least one command, and at least one processor that executes the at least one command. The at least one processor may detect a user action for at least one of a function key, a direction key, a channel key, and a volume key. The at least one processor may generate a user input including at least one of a function key input, a direction key input, a channel key input, and a volume key input based on the user action. The at least one processor may output the user input to a display device. The display device may perform at least one control action based on the function key input. The at least one control action may include at least one of a first control action for controlling an image displayed in a normal mode and a second control action for controlling at least one IoT device in a standby mode.

[0017] In one embodiment, the function key input may be mapped to power control of the at least one IoT device. At least one of the direction key input, the channel key input, and the volume key input may be mapped to at least one of temperature control, direction control, intensity control, and mode control of the at least one IoT device.

[0018] In one embodiment, the at least one processor can control power of the at least one IoT device based on the user action on the function key in the standby mode.

[0019] In one embodiment, the at least one processor can control at least one of a temperature, a direction, an intensity, and a mode of the at least one IoT device based on the user action on at least one of the directional key, the channel key, and the volume key in the standby mode.

[0020] A method for controlling an IoT device according to embodiments of the present disclosure may include an operation of setting at least one control action corresponding to at least one function key input, an operation of detecting the at least one function key input based on at least one user input received from a control device, an operation of determining an operation mode at a time when the at least one function key input is detected, and an operation of performing the at least one control action based on the operation mode and the at least one function key input. The at least one control action may include at least one of a first control action for controlling a displayed image and a second control action for controlling at least one IoT device.

[0021] In one embodiment, the driving mode may include at least one of a normal mode that displays an image and a standby mode that does not display an image.

[0022] In one embodiment, the operation of performing the at least one control operation may include performing the first control operation based on the at least one function key input in the normal mode, and performing the second control operation based on the at least one function key input in the standby mode.

[0023] In one embodiment, the operation of setting the at least one control operation may include the operation of matching the at least one IoT device to the at least one function key input, and the operation of mapping a control value to the at least one function key input.

[0024] In one embodiment, the control value may include a basic control value and an additional control value for the at least one IoT device. The basic control value may include power control of the at least one IoT device. The additional control value may include at least one of temperature control, direction control, intensity control, and mode control of the at least one IoT device.

[0025] In one embodiment, the act of setting the at least one control operation may include an act of mapping power control of the at least one IoT device to the at least one function key input, and an act of mapping at least one of temperature control, direction control, intensity control, and mode control of the at least one IoT device to at least one of a direction key input, a channel key input, and a volume key input.

[0026] In one embodiment, the operation of performing the at least one control operation may include performing a power control operation for the at least one IoT device based on the at least one function key input in a standby mode.

[0027] In one embodiment, the operation of performing the at least one control operation may include performing at least one of a temperature control operation, a direction control operation, an intensity control operation, and a mode control operation for the at least one IoT device based on at least one of a direction key input, a channel key input, and a volume key input in the standby mode.

[0028] According to various embodiments of the present disclosure, the display device of the present disclosure and the IoT device control method using the same can control an image displayed according to a function key input of the control device in a normal mode, and can control an IoT device according to a function key input of the control device in a standby mode.

[0029] Therefore, the display device of the present disclosure and the IoT device control method using the same can expand the scope of use of the control device and maximize the convenience of the IoT hub function of the display device by constantly providing the IoT hub function regardless of the driving mode.

[0030] The effects that can be obtained from the exemplary embodiments of the present disclosure are not limited to the effects mentioned above, and other effects not mentioned can be clearly derived and understood by those skilled in the art to which the exemplary embodiments of the present disclosure pertain from the following description. In other words, unintended effects resulting from implementing the exemplary embodiments of the present disclosure can also be derived by those skilled in the art from the exemplary embodiments of the present disclosure.

[0031] Figure 1 illustrates an Internet of Things system according to one embodiment.

[0032] FIG. 2 illustrates a block configuration of a display device according to one embodiment.

[0033] Figure 3 illustrates the configuration of a control device according to one embodiment.

[0034] Figure 4 illustrates an operational flow of a display device according to one embodiment.

[0035] FIG. 5 illustrates an operation of mapping a basic control value to a function key input according to one embodiment.

[0036] FIG. 6 illustrates an operation of mapping additional control values ​​to additional key inputs according to one embodiment.

[0037] Figure 7 illustrates a driving mode of a display device according to one embodiment.

[0038] FIG. 8 illustrates the operation of a display device based on function key input in a normal mode according to one embodiment.

[0039] FIG. 9 illustrates the operation of a display device based on function key input in standby mode according to one embodiment.

[0040] Fig. 10 illustrates a notification function of an Internet of Things system according to one embodiment.

[0041] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.

[0042] FIG. 1 illustrates an Internet of Things (IoT) system (100) according to one embodiment.

[0043] Referring to FIG. 1, an IoT system (100) may include a display device (110), a control device (120), a server (188), and at least one IoT device (199).

[0044] In one embodiment, the display device (110) can display an image based on input data. For example, the display device (110) may be a TV that displays an image, but this is only one example of the display device (110), and the display device (110) may be implemented as an electronic device including at least one display unit. For example, the display device (110) may be implemented as various electronic devices such as a mobile phone, a tablet PC, a digital camera, a camcorder, a laptop computer, a tablet PC, a desktop, an e-book reader, a digital broadcasting terminal, a PDA (Personal Digital Assistant), a PMP (Portable Multimedia Player), a navigation device, an MP3 player, a wearable device, and the like. In addition, the display device (110) may be fixed or mobile, and may be a digital broadcasting receiver capable of receiving digital broadcasting.

[0045] For example, the display device (110) may be implemented as a flat display device, a curved display device having a screen with a curvature, or a flexible display device whose curvature can be adjusted. For example, the output resolution of the display device (110) may include HD (High Definition), Full HD, Ultra HD, or a resolution clearer than Ultra HD.

[0046] In one embodiment, the display device (110) can perform IoT hub functions. For example, the display device (110) can perform IoT hub functions in addition to broadcast reception functions, image processing functions, and image display functions. Specifically, the display device (110) can receive status information of IoT devices from at least one IoT device (199) via short-range communication (e.g., Zigbee).

[0047] The display device (110) can generate sensing data for the IoT device (199) based on status information of at least one IoT device. The display device (110) can display at least one IoT device (199) based on the sensing data. The display device (110) can control at least one IoT device (199) based on user input.

[0048] At least one IoT device (199) may include a general device (or object) to which the Internet of Things is applied. For example, the IoT device (199) may include at least one of a temperature sensor, a humidity sensor, an acoustic sensor, a motion sensor, a proximity sensor, a gas detection sensor, a heat detection sensor, a refrigerator, an air conditioner, a CCTV, a TV, a washing machine, a vacuum cleaner, an oven, a dehumidifier, a light, and a fire alarm. However, the IoT device (199) of the present disclosure is not limited thereto.

[0049] The server (188) can update status information of at least one IoT device (199) via a network. The server (188) can receive status information of at least one IoT device (199) from the display device (110) via the network. For example, the display device (110) can control at least one IoT device (199) and transmit status information and operation information of at least one IoT device (199) to the server (188) via the network. The server (188) can update status information and operation information of at least one IoT device (199) to at least one application (e.g., Smart Things).

[0050] The network used in the server (188) may include both wired and wireless networks. Wired networks include cable networks or telephone networks, and wireless networks may include any network that transmits and receives signals via radio waves. Wired and wireless networks may be interconnected.

[0051] For example, the network may include a wide area network (WAN) such as the Internet, a local area network (LAN) formed around an access point (AP), and a short-range wireless network that does not use an access point (AP). Short-range wireless networks may include, but are not limited to, Bluetooth™ (IEEE 802.15.1), Zigbee (IEEE 802.15.4), Wi-Fi Direct, Near Field Communication (NFC), Z-Wave, etc.

[0052] In one embodiment, the control device (120) can output user input to the display device (110). The control device (120) can be connected to the display device (110) via a wireless communication network. For example, the control device (120) can be located within a predetermined distance from the display device (110) and communicate with the display device (110) via a Bluetooth Low Energy (BLE) communication network. For example, the control device (120) can generate user input based on a user action and transmit the user input to the display device (110) via the BLE communication network.

[0053] For example, the control device (120) may be, but is not limited to, a remote control, a smartphone, a tablet PC, a PC, a smart TV, a mobile phone, a personal digital assistant (PDA), a laptop, a media player, a micro server, a global positioning system (GPS) device, an e-book reader, a digital broadcasting terminal, a navigation system, a kiosk, an MP3 player, a digital camera, and other mobile or non-mobile computing devices. In addition, the control device (120) may be a wearable device having communication functions and data processing functions.

[0054] Fig. 2 illustrates a block configuration of a display device (210) according to one embodiment. For example, the display device (210) of Fig. 2 may be the display device (110) of Fig. 1.

[0055] Referring to FIG. 2, the display device (210) may include an input unit (211), a memory (212), a processor (213), and a communication unit (214).

[0056] In one embodiment, the input unit (130) may receive a user input output from the control device (220) (e.g., the control device (120) of FIG. 1). For example, the input unit (130) may receive a user input including at least one of a power key input for turning the display device (210) on or off, a direction key input for controlling selection movement, a channel key input for selecting a channel, a volume key input for adjusting the volume level, and a predetermined function key input from the control device (220). The input unit (211) may transmit the received user input to the processor (213).

[0057] In one embodiment, the memory (212) may include at least one of a non-volatile memory device and a volatile memory device. For example, the non-volatile memory device may store various data and software (e.g., an operating system, an application program, etc.) for driving and controlling the display device (210). The non-volatile memory device may store the operating system, the first application program, and the second application program. In this case, the first application program may be a program that performs a function of receiving status information of the IoT device from the IoT device and transmitting the received information to a server. In addition, the second application program may be a program that performs the main functions of the display device (210) (e.g., a broadcast reception function, an image processing function, an image display function, etc.). For example, the non-volatile memory device may be a device in which stored data is not deleted even when the power supply is interrupted. For example, the non-volatile memory device may include a flash memory device such as a NAND flash or a NOR flash.

[0058] A nonvolatile memory device can be controlled by a controller. The controller can receive a control command from the processor (213) to store data in the nonvolatile memory device or read data stored in the nonvolatile memory device.

[0059] In one embodiment, the processor (213) can load software stored in a non-volatile memory device into a volatile memory device and run the software.

[0060] The processor (213) can access data related to software (e.g., an operating system and an application program) loaded in a volatile memory device. A volatile memory device is a device in which stored data is deleted when power is cut off, and the volatile memory device may include SRAM (Static RAM), DRAM (Dynamic RAM), etc.

[0061] For example, the volatile memory device may include a first volatile memory device and a second volatile memory device. An operating system and a first application may be loaded and executed on the first volatile memory device, and a second application may be loaded and executed on the second volatile memory device.

[0062] The processor (213) controls the overall operation of the display device (210) and the signal flow between internal components of the display device (210), and can process data. For example, the processor (213) may be a central processing unit (CPU) that controls the operation of software (e.g., an operating system (OS) and application programs) stored in the display device (210).

[0063] For example, the processor (213) can load software stored in a non-volatile memory device into a volatile memory device and drive it, and control the display device (210) by a user command received through the input unit (130) or the driven software.

[0064] Additionally, the processor (213) may include a graphic processor (Graphic Processing Unit, not shown) for graphic processing corresponding to video. The processor (213) may be implemented as a System On Chip (SoC) integrating a core and a GPU. For example, the processor (213) may include a single core, a dual core, a triple core, a quad core, and multiples thereof.

[0065] The processor (213) may include multiple processors. For example, the processor (213) may include a main processor and a sub processor operating in standby mode.

[0066] In one embodiment, the communication unit (214) can connect the display device (210) to an external device (e.g., a server, an IoT device, etc.) under the control of the processor (213). The processor (213) can transmit / receive content to / from the external device connected through the communication unit (214), download an application from the external device, or browse the web. The communication unit (214) can communicate with the external device using at least one of Bluetooth, Near Field Communication, Wi-Fi, Zigbee, Z-WAVE, infrared (IrDA, infrared Data Association) communication, Wi-Fi Direct (WFD), ultra wideband (UWB), Ant+ communication, and Bluetooth low energy (BLE).

[0067] In one embodiment, the communication unit (214) can receive status information of the IoT device from the IoT device. Sensing data generated based on the status information of the communication unit (214) can be transmitted to an external server. At this time, communication with the IoT device can be performed using Zigbee, Z-WAVE, etc., and communication with the external server can be performed using Bluetooth, Wi-Fi, etc.

[0068] Meanwhile, in one embodiment, the control device (220) may be implemented as various types of devices for controlling the display device (210), such as a remote control or a smartphone.

[0069] In addition, the control device (220) can control the display device (210) using short-range communication including infrared or Bluetooth. The control device (220) can control the function of the display device (210) using at least one of a predetermined key, a touchpad, a microphone capable of receiving a user's voice, and a sensor capable of recognizing the motion of the control device (220).

[0070] Fig. 3 illustrates the configuration of a control device according to one embodiment. For example, the control device (300a, 300b) of Fig. 3 may be the control device (220) of Fig. 2.

[0071] Referring to (a) of FIG. 3, the control device (300a) may include a processor (320), a memory (310), and a communication unit (330). The configuration illustrated in (a) of FIG. 3 illustrates a configuration for explaining an embodiment of the control device (300a) according to the present disclosure, and other configurations for performing a control function of the control device may be added in addition to the illustrated configuration, and the illustrated configurations may be omitted.

[0072] According to one embodiment, the memory (310) is a storage medium used by the control device (300a), and can store data such as at least one command or setting information corresponding to at least one program. The program may include an operating system (OS) program and various application programs.

[0073] In one embodiment, the memory (310) may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., an SD or XD memory, etc.), a random access memory (RAM), a static random access memory (SRAM), a read only memory (ROM), an electrically erasable programmable ROM (EEPROM), a programmable ROM (PROM), a magnetic memory, a magnetic disk, and an optical disk.

[0074] According to one embodiment, the communication unit (330) can perform wired or wireless communication between the control device (300a) and an external device (e.g., a display device). For example, the communication unit (330) can transmit a user input for controlling an IoT device to the display device based on a user action.

[0075] In one embodiment, the communication unit (330) may include a wireless communication unit (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication unit. The communication unit (330) may communicate with an external device (e.g., a client device, an IAM server, a billing server, a cloud server, an IPFS server) via a network (e.g., a long-distance communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)).

[0076] In one embodiment, the communication unit (330) may support 5G networks and next-generation communication technologies, such as new radio access technology (NR). NR access technology may support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimizing terminal power and connecting multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency communications (URLLC (ultra-reliable and low-latency communications)). For example, the communication unit (330) may support high-frequency bands (e.g., mmWave bands) to achieve high data transmission rates. The communication unit (330) can support various technologies (e.g., beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna) to secure performance in a high-frequency band.

[0077] In one embodiment, the communication unit (330) may support various requirements specified in the control device (300a), external device (e.g., display device), or network system.

[0078] A processor (320) according to one embodiment may, for example, execute software (e.g., a program) to control at least one other component (e.g., a hardware or software component) of a control device (300a) connected to the processor (320) and perform various data processing or operations.

[0079] In one embodiment, the processor (320) may store commands or data received from another component (e.g., a communication unit (330)) in volatile memory, process the commands or data stored in the volatile memory, and store resulting data in non-volatile memory as at least part of data processing or calculation.

[0080] In one embodiment, the processor (320) may include a main processor (e.g., a central processing unit or an application processor) or a secondary processor (e.g., a graphics processing unit, a neural processing unit (NPU), or a communications processor) that can operate independently or in conjunction therewith.

[0081] For example, the processor (320) can generate user input based on user actions and control the display device according to the user input.

[0082] Referring to (b) of FIG. 3, the control device (300b) may include at least one of a power key (PK) for turning the display device on or off, a direction key (AK) for controlling selection movement of a displayed image, a channel key (CK) for selecting a channel of the display device, a volume key (VK) for adjusting the volume size of the display device, and a function key (FK) for performing a predetermined function. In addition, the control device (300b) may include at least one of an LED module (LM) for providing a predetermined notification to a user, and a vibration module (VM).

[0083] The control device (300b) can detect a user action on at least one of a function key (FK), a direction key (AK), a channel key (CK), and a volume key (VK). For example, the user can select or repeatedly press at least one of a function key (FK), a direction key (AK), a channel key (CK), and a volume key (VK).

[0084] The control device (300b) can generate a user input including at least one of a function key input, a direction key input, a channel key input, and a volume key input based on the user action. The control device (300b) can output the user input to a display device. For example, the control device (300b) can control the display device by outputting the user input to the display device via a BLE communication network.

[0085] The control device (300b) can perform a notification function based on at least one of the provided LED module (LM) and vibration module (VM). The LED module (LM) can include at least one of a red LED, a green LED, and a blue LED. For example, the control device (300b) can provide visual feedback to the user by outputting a predetermined light through the LED module (LM). The vibration module (VM) can include a vibration motor and a driving circuit. For example, the control device (300b) can provide tactile feedback to the user by generating a predetermined vibration through the vibration module (VM).

[0086] FIG. 4 illustrates an operation flow of a display device according to one embodiment, FIG. 5 illustrates an operation of mapping a basic control value to a function key input according to one embodiment, FIG. 6 illustrates an operation of mapping an additional control value to an additional key input according to one embodiment, and FIG. 7 illustrates a driving mode of a display device according to one embodiment.

[0087] Referring to FIG. 4, the display device of the present disclosure can control an image to be displayed in accordance with a function key input of a control device in a normal mode, and can control an IoT device in accordance with a function key input of the control device in a standby mode.

[0088] For example, in operation 410, the display device may set at least one control action corresponding to at least one function key input. For example, the display device may set a control action to be performed by the display device in response to at least one function key input.

[0089] The at least one control operation may include at least one of a first control operation for controlling a displayed image and a second control operation for controlling at least one IoT device.

[0090] For example, the first control operation may be an operation that controls at least one of channel settings, volume settings, application settings, and playback settings of the displayed image. For example, the second control operation may be an IoT hub function that controls at least one registered IoT device.

[0091] The display device can set at least one control operation corresponding to at least one function key input for each operating mode of the display device. For example, the operating mode can include at least one of a normal mode that displays an image and a standby mode that does not display an image.

[0092] The display device can set at least one control operation corresponding to at least one function key input in each of the normal mode and the standby mode. For example, the display device can map a control value to the at least one function key input in each of the normal mode and the standby mode.

[0093] The control value may include a basic control value and an additional control value for the at least one IoT device. For example, the basic control value may include power control of the at least one IoT device. For example, the additional control value may include at least one of temperature control, direction control, intensity control, and mode control of the at least one IoT device.

[0094] Referring to FIG. 5, the display device (500) can map a basic control value to at least one function key input in each of the normal mode and the standby mode.

[0095] The display device (500) can map a control value for controlling an image displayed to at least one function key input in normal mode.

[0096] For example, as shown in FIG. 5, the input of the first function key (FK1) can be mapped to the execution of the first application (APP1). For example, the input of the second function key (FK2) can be mapped to the execution of the second application (APP2). For example, the input of the third function key (FK3) can be mapped to the execution of the third application (APP3). For example, the input of the fourth function key (FK4) can be mapped to the execution of the fourth application (APP4).

[0097] The display device (500) can match at least one IoT device to at least one function key input in standby mode.

[0098] For example, as shown in FIG. 5, a first function key (FK1) input may be matched to a first IoT device (e.g., a robot vacuum cleaner). For example, a second function key (FK2) input may be matched to a second IoT device (e.g., a washing machine). For example, a third function key (FK3) input may be matched to a third IoT device (e.g., an air purifier). For example, a fourth function key (FK4) input may be matched to a fourth IoT device (e.g., a standing air conditioner).

[0099] The display device (500) can map power control of at least one IoT device to at least one function key input in standby mode.

[0100] For example, as shown in FIG. 5, the input of the first function key (FK1) can be mapped to power control of a first IoT device (e.g., a robot vacuum cleaner). For example, the input of the second function key (FK2) can be mapped to power control of a second IoT device (e.g., a washing machine). For example, the input of the third function key (FK3) can be mapped to power control of a third IoT device (e.g., an air purifier). For example, the input of the fourth function key (FK4) can be mapped to power control of a fourth IoT device (e.g., a standing air conditioner).

[0101] Referring to FIG. 6, the display device (600) can map additional control values ​​to at least one additional key input in each of the normal mode and the standby mode.

[0102] For example, the at least one additional key input may include at least one of a directional key input, a channel key input, and a volume key input.

[0103] The display device (600) can map a control value for controlling an image displayed to at least one additional key input in normal mode.

[0104] For example, as shown in Fig. 6, the directional key (AK) input can be mapped to selection movement in the four directions of up / down / left / right. For example, the channel key (CK) input can be mapped to channel control. For example, the volume key (VK) input can be mapped to volume control.

[0105] The display device (600) can map at least one of temperature control, direction control, intensity control, and mode control of at least one IoT device to at least one additional key input in standby mode.

[0106] For example, as shown in Fig. 6, the directional key (AK) input can be mapped to directional control in the four directions of up / down / left / right of the IoT device. For example, the channel key (CK) input can be mapped to temperature control of the IoT device. For example, the volume key (VK) input can be mapped to intensity control of the IoT device.

[0107] In one example, at operation 420, the display device can detect at least one function key input based on at least one user input received from the control device. For example, the control device can detect a user action for at least one of a function key, a direction key, a channel key, and a volume key, and generate a user input based on the user action. In this case, the display device can detect at least one function key input included in the user input received from the control device.

[0108] According to an example, in operation 430, the display device can determine the operation mode at the time when the at least one function key input is detected. For example, the operation mode can include at least one of a normal mode that displays an image and a standby mode that does not display an image.

[0109] As shown in (a) of Fig. 7, the normal mode may mean a state in which power is supplied to all components of the display device (700a). In the normal mode, each component of the display device (700a) operates normally, so the display device (700a) can normally perform its main functions (e.g., broadcast reception function, image processing function, image display function, etc.) based on input data.

[0110] As shown in (b) of Fig. 7, the standby mode may be a power-saving mode of the display device (700b). In the standby mode, power may be supplied only to the communication unit (not shown) of the display device (700b), and power may be cut off to other components. Therefore, in the standby mode, the display device (700b) may only operate the network function. In the standby mode, the display device (700b) may receive a control signal (e.g., user input) from the control device, or transmit and receive predetermined data with the control device. For example, the standby mode may be referred to as a suspend mode or a low power mode (LPM). For example, in the standby mode, the display device (700b) may operate in a power-saving mode (e.g., LPM, Off state) and the screen may be turned off. For example, in standby mode, the display device (700b) may operate in AoD (Always on Display) mode to display only simple information (e.g., time, weather, location, driving mode).

[0111] According to an example, in operation 440, the display device may perform at least one control operation based on the driving mode and the at least one function key input. For example, the display device may perform a first control operation for controlling an image to be displayed based on at least one function key input in a normal mode. For example, the display device may perform a second control operation for controlling an IoT device based on at least one function key input in a standby mode.

[0112] Hereinafter, the control operation of the display device (810) according to the driving mode will be compared and explained with reference to FIGS. 8 and 9.

[0113] FIG. 8 illustrates the operation of a display device (810) based on a function key input in a normal mode according to one embodiment. For example, the display device (810) may determine the operating mode at the time when a function key input is detected as the normal mode.

[0114] Referring to FIG. 8, the display device (810) can control an image to be displayed in response to a function key input of the control device (820) in a normal mode. For example, an input of at least one function key (e.g., FK3) can be mapped to the execution of at least one application (e.g., APP3).

[0115] That is, the display device (810) can execute at least one application (e.g., APP3) based on the input of at least one function key (e.g., FK3) in normal mode.

[0116] FIG. 9 illustrates the operation of a display device (910) based on a function key input in a standby mode according to one embodiment. For example, the display device (910) may determine the operating mode at the time when a function key input is detected as the standby mode.

[0117] Referring to FIG. 9, the display device (910) can control an IoT device in standby mode according to a function key input of the control device (920). For example, an input of at least one function key (e.g., FK3) can be mapped to power control for at least one pre-matched IoT device (999) (e.g., an air purifier).

[0118] That is, the display device (810) can control the power of at least one IoT device (999) (e.g., air purifier) ​​based on the input of at least one function key (e.g., FK3) in standby mode.

[0119] Additionally, at least one additional key input may be mapped to at least one of temperature control, direction control, intensity control, and mode control for at least one matched IoT device (999) (e.g., air purifier). For example, in the standby mode, at least one of a direction key input, a channel key input, and a volume key input may be mapped to at least one of a temperature control operation, a direction control operation, an intensity control operation, and a mode control operation for at least one IoT device.

[0120] That is, the display device (910) can control at least one of the temperature, direction, intensity, and mode of at least one IoT device (999) (e.g., air purifier) ​​based on at least one additional key input in standby mode.

[0121] Meanwhile, in the standby mode, the power control operation of at least one IoT device (999) based on a function key, and the temperature control operation, direction control operation, intensity control operation, and mode control operation of at least one IoT device (999) based on an additional key can be performed continuously within a reference control time. For example, the display device (910) can turn on the power of at least one IoT device (999) based on at least one function key input. For example, the display device (910) can control at least one of the temperature, direction, intensity, and mode of at least one IoT device (999) based on at least one additional key input when an additional key input is detected within a reference control time (e.g., 3 to 5 seconds) after the function key input is detected.

[0122] Fig. 10 illustrates a notification function of an Internet of Things system according to one embodiment.

[0123] Referring to FIG. 10, the Internet of Things system of the present disclosure can provide a user with a notification (e.g., Noti1, Noti2, Noti3) for a display device (1010) and at least one IoT device (1099).

[0124] In one embodiment, the display device (1010) may perform a notification function to provide a notification (e.g., Noti1) to the user.

[0125] The display device (1010) may provide a user with a feedback notification including an operation performed by at least one IoT device (1099) based on operation information of at least one IoT device (1099). For example, the display device (1010) may receive operation information from at least one IoT device (1099) and output a sound (e.g., “Turn on the air purifier”) including an operation performed by at least one IoT device (1099) through a speaker. As another example, the display device (1010) may receive operation information from at least one IoT device (1099) and display an image (e.g., “Turn on the air purifier”) including an operation performed by at least one IoT device (1099). For example, in standby mode, the display device (1010) may operate in AoD (Always on Display) mode to display the image including the execution operation of at least one IoT device (1099) (e.g., “Turn on the air purifier”) for a predetermined period of time.

[0126] In addition, the display device (1010) can provide a mode notification including the driving mode of the display device (1010) to the user. For example, the display device (1010) can provide a mode notification regarding the driving mode to the user by changing the color of the LED lamp based on the driving mode. For example, in the standby mode, the display device (1010) can provide a notification regarding the standby mode to the user by displaying a predetermined color different from the general mode on the LED lamp. As another example, the display device (1010) can display a mode notification including the driving mode as an image (e.g., “Standby Mode”, “Control Mode”). For example, in the standby mode, the display device (1010) operates in an AoD (Always on Display) mode and can display an image (e.g., “Standby Mode”, “Control Mode”) indicating the standby mode for a predetermined period of time based on receiving a function key input and an additional key input.

[0127] In one embodiment, the control device (1020) may perform a notification function to provide a notification (e.g., Noti2) to the user.

[0128] The control device (1020) may provide a feedback notification including the execution operation of at least one IoT device (1099) to the user based on the operation information of at least one IoT device (1099). For example, the control device (1020) may receive the operation information of at least one IoT device (1099) from the display device (1010). For example, the control device (1020) may provide a feedback notification to the user by outputting a predetermined light through an LED module (LM) based on the power-on of at least one IoT device (1099). For example, the control device (1020) may provide a feedback notification to the user by generating a predetermined vibration through a vibration module (VM) based on the power-on of at least one IoT device (1099).

[0129] In addition, the control device (1020) can provide a mode notification including the driving mode of the display device (1010) to the user. For example, the control device (1020) can receive information about the driving mode from the display device (1010). For example, the control device (1020) can provide a feedback notification to the user by outputting a predetermined light through the LED module (LM) based on the driving mode of the display device (1010). For example, in the standby mode, the control device (1020) can provide a notification about the standby mode to the user by outputting a light of a different color from the normal mode through the LED module. As another example, the control device (1020) can provide a feedback notification to the user by generating a predetermined vibration through the vibration module (VM) based on the driving mode of the display device (1010). For example, in standby mode, the control device (1020) may receive a user action for at least one of a function key, a direction key, a channel key, and a volume key, and generate a predetermined vibration through a vibration module (VM) to provide a notification to the user about the standby mode.

[0130] In one embodiment, at least one IoT device (1099) can perform a notification function that provides a notification (e.g., Noti3) to a user. At least one IoT device (1099) can provide a feedback notification (Feedback Notification) including an operation performed by at least one IoT device (1099) to a user based on a control operation of the display device (1010). For example, at least one IoT device (1099) can perform an operation corresponding to the control operation of the display device (1010). At least one IoT device (1099) can output a sound including the operation performed (e.g., “Turn on the power”) through a speaker.

[0131] In this way, the display device of the present disclosure can control an image to be displayed according to a function key input of a control device in a normal mode, and can control an IoT device according to a function key input of a control device in a standby mode.

[0132] Accordingly, the display device of the present disclosure can expand the scope of use of the control device and maximize the convenience of the IoT hub function of the display device by constantly providing the IoT hub function regardless of the driving mode.

[0133] The display devices according to the various embodiments disclosed in this document may take various forms. The display devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. The display devices according to the embodiments of this document are not limited to the aforementioned devices.

[0134] The various embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. For example, a component expressed in the singular should be understood to include plural components unless the context clearly indicates only the singular. It should be understood that the term "and / or" used in this document encompasses any and all possible combinations of one or more of the listed items. The terms "comprise," "have," "consist of," and the like used in this disclosure are intended to specify only the presence of a feature, component, part, or combination thereof described in this disclosure, and the use of such terms does not exclude the presence or addition of one or more other features, components, parts, or combinations thereof. In this document, phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can each include any one of the items listed together in that phrase, or all possible combinations thereof. Terms such as "first", "second", or "first" or "second" may be used merely to distinguish the corresponding component from other corresponding components and do not limit the corresponding components in any other respect (e.g., importance or order).

[0135] The terms "part" or "module" used in various embodiments of this document may include units implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. The "part" or "module" may be an integrally formed component or a minimum unit or part of the component that performs one or more functions. For example, according to one embodiment, the "part" or "module" may be implemented in the form of an application-specific integrated circuit (ASIC).

[0136] The term “if” as used in various embodiments of this document may be interpreted to mean “when”, “when”, “in response to determining”, or “in response to detecting”, depending on the context. Similarly, “if it is determined that” or “if ~ is detected” may be interpreted to mean “upon determining”, “in response to determining”, or “upon detecting”, or “in response to detecting”, depending on the context.

[0137] The program executed by the electronic device (200) described in this document may be implemented as hardware components, software components, and / or a combination of hardware components and software components. The program may be executed by any system capable of executing computer-readable instructions.

[0138] Software may include a computer program, code, instructions, or a combination of one or more of these, which can configure a processing device to perform a desired operation or command the processing device, either independently or collectively. Software may be implemented as a computer program including instructions stored on a computer-readable storage medium. Examples of the computer-readable storage medium include magnetic storage media (e.g., read-only memory (ROM), random-access memory (RAM), floppy disks, hard disks, etc.) and optical reading media (e.g., CD-ROMs, digital versatile discs (DVDs)). The computer-readable storage medium may be distributed across network-connected computer systems so that the computer-readable code can be stored and executed in a distributed manner. Computer programs can be distributed online (e.g., by download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0139] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In the display device (210), a memory (212) storing at least one command; and At least one processor (213) for executing at least one instruction, At least one processor of the above, Set at least one control action corresponding to at least one function key input, Detecting at least one function key input based on at least one user input received from a control device, Determine the operation mode at the time when at least one of the above function keys is detected, Performing at least one control operation based on the driving mode and the input of at least one function key; At least one of the above control actions, Comprising at least one of a first control operation for controlling a displayed image and a second control operation for controlling at least one IoT device. device.

2. In paragraph 1, The above driving mode is, Including at least one of a normal mode that displays images and a standby mode that does not display images. device.

3. In paragraph 2, At least one processor of the above, In the above general mode, the first control operation is performed based on the input of at least one function key, In the above standby mode, performing the second control operation based on the input of at least one function key. device.

4. In any one of paragraphs 1 to 3, At least one processor of the above, Matching at least one IoT device to at least one function key input, Mapping a control value to at least one of the above function key inputs, device.

5. In paragraph 4, The above control values ​​include a basic control value and an additional control value for at least one IoT device, The above basic control value includes power control of at least one IoT device, The above additional control value includes at least one of temperature control, direction control, intensity control, and mode control of the at least one IoT device. device.

6. In paragraph 4, At least one processor of the above, Mapping power control of at least one IoT device to at least one function key input, Mapping at least one of temperature control, direction control, intensity control, and mode control of at least one IoT device to at least one of directional key input, channel key input, and volume key input. device.

7. In any one of paragraphs 1 to 3, At least one processor of the above, In standby mode, performing a power control operation for the at least one IoT device based on the input of the at least one function key; device.

8. In paragraph 7, At least one processor of the above, In the standby mode, at least one of a temperature control operation, a direction control operation, a strength control operation, and a mode control operation is performed for the at least one IoT device based on at least one of a direction key input, a channel key input, and a volume key input. device.

9. In the control device (220), A memory (310) storing at least one command; and At least one processor (320) for executing at least one instruction, At least one processor of the above, Detects a user action on at least one of the function keys, directional keys, channel keys, and volume keys, Generate a user input including at least one of a function key input, a directional key input, a channel key input, and a volume key input based on the user action, Output the above user input to a display device, The display device performs at least one control action based on the function key input, At least one of the above control actions, Comprising at least one of a first control operation for controlling an image displayed in a normal mode and a second control operation for controlling at least one IoT device in a standby mode. device.

10. In paragraph 9, The above function key input is mapped to power control of at least one IoT device, At least one of the above directional key input, the channel key input, and the volume key input is mapped to at least one of the temperature control, direction control, intensity control, and mode control of the at least one IoT device. device.

11. In clause 9 or 10, At least one processor of the above, In the above standby mode, power of the at least one IoT device is controlled based on the user action on the function key. device.

12. In paragraph 11, At least one processor of the above, In the standby mode, controlling at least one of the temperature, direction, intensity, and mode of the at least one IoT device based on the user operation of at least one of the directional keys, the channel keys, and the volume keys. device.

13. A method for controlling an IoT device using a display device, An action (410) of setting at least one control action corresponding to at least one function key input; An operation (420) of detecting at least one function key input based on at least one user input received from a control device; An operation (430) for determining the operation mode at the time when at least one function key input is detected; and An operation (440) for performing at least one control operation based on the driving mode and the at least one function key input, At least one of the above control actions, Comprising at least one of a first control operation for controlling a displayed image and a second control operation for controlling at least one IoT device. method.

14. In paragraph 13, The above driving mode is, Including at least one of a normal mode that displays images and a standby mode that does not display images. method.

15. In paragraph 14, An operation for performing at least one of the above control operations is: In the above general mode, the first control operation is performed based on the input of at least one function key, In the above standby mode, performing the second control operation based on the input of at least one function key. method.

Citation Information

Patent Citations

  • AN INTEGRATED REMOTE CONTROLLER SUPPORTING INTERNET OF THINGS(IoT) AND THE CONTROL METHOD THEREOF

    KR101588595B1

  • Torque test device for temperature control valve

    KR102150537B1

  • Multi-Function Remote Control

    KR200493908Y1

  • Electronic device and operation method thereof

    WO2023022330A1

  • Remote controller, display apparatus for setting keys of remote controller, and methods thereof

    WO2023033570A1