Server device, method for controlling server device, and IoT system

Abstract

Disclosed is a server device including: a communication circuit configured to communicate with a first electronic device and a second electronic device configured to be connected to the first electronic device via a network and to provide a voice guidance function; and a processor configured to perform control to: control the communication circuit to receive state change information of the first electronic device; and controlling the communication circuit to transmit the received state change information and a command for causing the second electronic device to provide a voice guidance function according to a user operation of the first electronic device to the second electronic device, the second electronic device being connected to the first electronic device via a network.

Description

Technical Field

[0001] The present disclosure relates to a server device, a control method of the server device, and an Internet of Things (IoT) system, and more particularly, to a method for providing voice guidance in household appliances included in an electronic device. Background Art

[0002] The Internet was mainly developed to enable computers to communicate with each other using the TCP / IP protocol. In recent years, research has been conducted to enable all things that can identify, calculate, and communicate to communicate with each other via the Internet, and this technology that enables all things to perform communication is called the Internet of Things (hereinafter simply referred to as IoT).

[0003] Electronic devices that provide voice guidance in response to user interaction with the device have been developed. However, users with low vision (such as visually impaired persons) may not be able to operate electronic devices that do not support voice guidance. Summary of the Invention

[0004]

Technical Solution

[0005] The present disclosure relates to providing a server device, a control method of the server device, and an Internet of Things (IoT) system, the server device enabling a second electronic device to support a voice guidance function based on a user operation of a first electronic device, in place of the first electronic device that does not support the voice guidance function.

[0006] The technical objects that the present disclosure can achieve are not limited to the above objects, and other technical objects not mentioned will be clearly understood by those of ordinary skill in the technical field to which the present disclosure belongs according to the following description.

[0007] According to an embodiment, a server device includes: a communication circuit configured to communicate with a first electronic device and a second electronic device, the first electronic device not providing a voice guidance function, the second electronic device being configured to be connected to the first electronic device via a home network and provide a voice guidance function; a memory configured to store status information of the first electronic device and the second electronic device; and a processor configured to control the communication circuit to send status change information and a command for activating the voice guidance function to the second electronic device based on receiving the status change information of the first electronic device.

[0008] According to an embodiment, a control method of a server device includes: storing status information of a first electronic device and a second electronic device; receiving status change information from the first electronic device; and based on receiving the status change information, sending the status change information and a command for activating the voice guidance function to one of a list of second electronic devices.

[0009] According to an embodiment, an Internet of Things (IoT) system includes: a first electronic device configured not to provide a voice guidance function; a second electronic device configured to be connected to the first electronic device via a home network and provide a voice guidance function; and a server device configured to communicate with the first electronic device and the second electronic device, wherein the first electronic device is configured to send status change information to the server device, and the server device is configured to store the status information of the first electronic device and the second electronic device and, based on the received status change information, send the status change information and a command for activating the voice guidance function to the second electronic device. Description of the Drawings

[0010] Figure 1 is a schematic diagram showing communication between an electronic device and a server device according to an embodiment.

[0011] Figure 2 is a control block diagram showing a server device according to an embodiment.

[0012] Figure 3 is a flowchart showing operations of an electronic device and a server device according to an embodiment.

[0013] Figure 4 shows a user operating a first electronic device in an Internet of Things (IoT) system according to an embodiment.

[0014] Figure 5 shows a second electronic device providing voice guidance in response to a user operation of a first electronic device in an IoT system according to an embodiment.

[0015] Figure 6 shows a user operating a first electronic device in an IoT system according to an embodiment.

[0016] Figure 7 shows a second electronic device providing voice guidance in response to a user operation of a first electronic device in an IoT system according to an embodiment.

[0017] Figure 8 shows an example where the distance between a first electronic device and a second electronic device in an IoT system exceeds a reference distance according to an embodiment.

[0018] Figure 9 shows an example where the distance between a first electronic device and a second electronic device in an IoT system is less than or equal to a reference distance according to an embodiment.

[0019] Figure 10 and Figure 11 shows reactivating the voice guidance of a second electronic device in an IoT system according to an embodiment.

[0020] Figure 12 is a flowchart showing a control method of a server device according to an embodiment.

[0021] Figure 13 is a flowchart showing a control method of a second electronic device according to an embodiment. Detailed implementation manners

[0022] The various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features described in the present disclosure to specific embodiments, but should be construed as including various modifications, equivalents or alternatives of the corresponding embodiments.

[0023] Regarding the description of the drawings, similar reference numerals may be used for similar or related components.

[0024] Unless otherwise clearly indicated in the context, the singular form of a noun corresponding to an item may include one item or multiple items.

[0025] As used herein, each of the expressions "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "at least one of A, B or C" may include one or all possible combinations of the items listed together with the corresponding expressions in these expressions.

[0026] It will be understood that the terms "first", "second", etc. may be used only to distinguish one component from another component, and are not intended to limit the corresponding component in other respects (such as importance or order).

[0027] When it is said that one (e.g., first) component "is coupled" or "is connected" to another (e.g., second) component, whether with the term "functionally" or "communicatively" or not, it means that one component can be directly (e.g., by wire), wirelessly, or through a third component connected to another component.

[0028] It will be understood that when the terms "comprise", "include" and / or "contain" are used in this specification, the presence of the specified features, numbers, steps, operations, components, members, or combinations thereof is specified, but the presence or addition of one or more other features, numbers, steps, operations, components, members, or combinations thereof is not excluded.

[0029] The expressions that one component "is connected", "is coupled", "supports" or "contacts" another component include the cases where these components are directly "connected", "coupled", "supported" or "contacted" to each other, and the cases where these components are indirectly "connected", "coupled", "supported" or "contacted" to each other through a third component.

[0030] It will also be understood that when a component is referred to as being "on" or "above" another component, it can be directly on the other component or there can also be an intermediate component.

[0031] The term "and / or" includes any and all combinations of one or more of the associated listed items.

[0032] Figure 1 is a schematic diagram showing communication between an electronic device and a server device according to an embodiment.

[0033] The electronic device including the first electronic device and the second electronic device can be at least one of various types of household appliances. For example, the electronic device can include a refrigerator, a dishwasher, an electric stove, an electric oven, an air conditioner, a clothes care device, a washing machine, a dryer, and a microwave oven, but is not limited thereto. For example, the electronic device can include various types of appliances such as a cleaning robot, a vacuum cleaner, a television, etc. In addition, the above household appliances are only examples.

[0034] The electronic device can communicate with the server device 1. The server device 1 can include: a communication module capable of communicating with another server device 1 or a user device; at least one processor for processing data received from another server or user device; and at least one memory for storing a program for processing data or the processed data. The server device 1 can be implemented as various computing devices such as a workstation, a cloud, a data drive, a data station, etc. The server device 1 can be implemented as one or more server devices 1 that are physically or logically separated based on functions, detailed configurations of functions, or data, and can send and receive data and process the sent data and the received data through communication between the server devices 1.

[0035] The server device 1 can perform functions such as managing user accounts, registering an electronic device in association with a user account, and managing or controlling the registered electronic device. For example, a user can access the server device 1 via a user device and can generate a user account. The user account can be identified by an identifier (ID) and a password set by the user. The server device 1 can register an electronic device in the user account according to a predetermined process. For example, the server device 1 can link the identification information (such as a serial number or a MAC address) of the electronic device to the user account to register, manage, and control the electronic device. The user device can include: a communication module capable of communicating with the electronic device or the server device 1; a user interface for receiving user input or outputting information to the user; at least one processor for controlling the operation of the user device; and at least one memory for storing a program for controlling the operation of the user device.

[0036] The user device can be carried by the user or placed in the user's home, office, etc. The user device can include, but is not limited to, a personal computer, a terminal, a portable phone, a smartphone, a handheld device, a wearable device, etc.

[0037] The memory of the user device can store a program for controlling the electronic device, i.e., an application. The application can be sold in a form installed on the user device or can be downloaded from an external server for installation.

[0038] By executing the application installed by the user on the user device, the user can access the server device 1, generate a user account, and communicate with the server device 1 based on logging in to the user account to register the electronic device.

[0039] For example, by operating the electronic device so that the electronic device can access the server according to the process guided by the application installed on the user device, the server device 1 can register the electronic device with the user account by assigning the identification information (such as the serial number or MAC address) of the electronic device to the corresponding user account.

[0040] The user can use the application installed on the user device to control the electronic device. For example, by logging in to the user account using the application installed on the user device, the electronic devices registered in the user account appear, and by inputting a control command for the electronic device, the control command can be transmitted to the electronic device via the server device 1.

[0041] The network 4 can include both a wired network 4 and a wireless network 4. The wired network 4 can include a cable network 4 or a telephone network 4, and the wireless network 4 can include any network that sends and receives signals via radio waves. The wired network 4 and the wireless network 4 can be connected to each other.

[0042] The network 4 can include a wide area network (WAN) such as the Internet, a local area network (LAN) formed around an access point (AP), and a short-range wireless network 4 that does not use an AP. The short-range wireless network 4 can include Bluetooth (IEEE 802.15.1), Zigbee (IEEE 802.15.4), Wi-Fi Direct, near field communication (NFC), and Z-Wave, but is not limited thereto.

[0043] The AP can connect the electronic device or the user device to the WAN to which the server device 1 is connected. The electronic device or the user device can be connected to the server via the WAN 4.

[0044] The AP can use such as Wi-Fi TM (IEEE 802.11), Bluetooth TMcommunicate with an electronic device or a user device using wireless communication such as Bluetooth (IEEE 802.15.1), Zigbee (IEEE 802.15.4), etc., and use wired communication to access the WAN 4, but not limited thereto.

[0045] According to various embodiments, the electronic device may be directly connected to the user device or the server device 1 without passing through the AP.

[0046] The electronic device may be connected to the user device or the server device 1 via a long-range wireless network 4 or a short-range wireless network 4.

[0047] For example, the electronic device may be connected to the user device via a short-range wireless network 4 (e.g., Wi-Fi Direct).

[0048] In another example, the electronic device may use a long-range wireless network 4 (e.g., a cellular communication module) to be connected to the user device or the server device 1 via the WAN 4.

[0049] In yet another example, the electronic device may use wired communication to access the WAN 4 and may be connected to the user device or the server device 1 via the WAN 4.

[0050] When using wired communication to access the WAN 4, the electronic device may also act as an access point. Thus, the electronic device may connect another household appliance to the WAN 4 to which the server device 1 is connected. In addition, other household appliances may connect the electronic device to the WAN 4 to which the server device 1 is connected.

[0051] The electronic device may send information about the operation or status to other household appliances, user devices, or the server device 1 via the network 4. For example, the electronic device may send information about the operation or status to other household appliances, user devices, or the server device 1 when receiving a request from the server device 1, in response to an event in the electronic device, or periodically or in real time. In response to receiving the information about the operation or status from the electronic device, the server may update the stored information about the operation or status of the electronic device and send the updated information about the operation and status of the electronic device to the user device via the network 4. Here, the updated information may include various operations that change the existing information, such as adding new information to the existing information, replacing the existing information with new information, etc.

[0052] The electronic device can obtain various information from other household appliances, user devices, or server device 1, and can provide the obtained information to the user. For example, the electronic device can obtain information related to the functions of the electronic device (e.g., recipes, washing instructions, etc.) and various environmental information (e.g., weather, temperature, humidity, etc.) from the server, and can output the obtained information via the user interface.

[0053] The electronic device can operate according to control commands received from other household appliances, user devices, or server device 1. For example, the electronic device can operate according to control commands received from server device 1. Based on the pre-authorization obtained from the user, even without user input, the electronic device can operate according to the control commands of server device 1. Here, the control commands received from server device 1 can include control commands input by the user via the user device or control commands based on preset conditions, but are not limited thereto.

[0054] The user device can send information about the user to the electronic device or server device 1 through the communication module. For example, the user device can send information about the user's location, the user's health status, the user's preferences, the user's schedule, etc. to the server. The user device can send information about the user to the server based on the user's pre-authorization.

[0055] The electronic device, user device, or server device 1 can use technologies such as artificial intelligence to determine control commands. For example, server device 1 can receive information about the operation or state of the electronic device or information about the user of the user device, use technologies such as artificial intelligence to process the received information, and send the processing result or control command to the electronic device or user device based on the processing result.

[0056] In the following, refer to Figure 2 Describe the operation principle and embodiments.

[0057] Figure 2 is a control block diagram showing server device 1 according to an embodiment.

[0058] As Figure 2 shown, server device 1 according to an embodiment can include a communication circuit 110, a user interface 120, and a controller 100. The communication circuit 110 communicates with the electronic device 2 via the network 4.

[0059] The communication circuit 110 can be connected to the electronic device 2 including the first electronic device 2 and the second electronic device 2, and send data to the electronic device 2 and receive data from the electronic device 2. In this instance, the first electronic device 2 can refer to an electronic device that does not provide a voice guidance function, and the second electronic device 2 can refer to an electronic device that provides a voice guidance function.

[0060] Specifically, the communication circuit 110 may receive status change information of the first electronic device 2, or may send status change information and a command for activating the voice guidance function to the second electronic device 2.

[0061] The communication circuit 110 may include: a wireless communication circuit 111 that wirelessly sends data to and receives data from an external electronic device 2; and a wired communication circuit 112 that sends data to and receives data from an external device in a wired manner.

[0062] The wireless communication circuit 111 may wirelessly communicate with a base station or an AP, and may access a wired communication network through the base station or the access point. The wireless communication circuit 111 may also communicate with an external device connected to the wired communication network via the base station or the access point. As described above, the wireless communication circuit 111 may use Wi-Fi TM (e.g., the IEEE 802.11 standard) to wirelessly communicate with the AP, or use the Global System for Mobile Communications (GSM), Code Division Multiple Access (CDMA), Wideband CDMA (WCDMA), Long Term Evolution (LTE), or Wibro to communicate with the base station. The wireless communication circuit 111 may also receive data from an external device via the base station or the access point.

[0063] In addition, the wireless communication circuit 111 may directly communicate with an external device.

[0064] The wired communication circuit 112 may access the wired communication network and communicate with an external device via the wired communication network. For example, the wired communication circuit 112 may access the wired communication network via Ethernet (IEEE 802.3 standard) and receive data from an external device via the wired communication network.

[0065] The communication method between the electronic device 2 and the communication circuit 110 is not limited.

[0066] The server device 1 may include a user interface 120. For example, the user interface 120 is provided on the outer surface of the server device 1, and may receive a control command from a user and display information related to the operation of the server device 1.

[0067] The user interface 120 may include an inputter 121 for receiving a control command and an outputter 122 for displaying information related to the operation.

[0068] The inputter 121 may be implemented as at least one of input devices such as a touch screen, a button, a membrane button, a dial, a slide switch, etc., but is not limited thereto.

[0069] The output device 122 can be implemented as a display device, such as a plasma display panel (PDP), a liquid crystal display (LCD) panel, a light emitting diode (LED) panel, an organic light emitting diode (OLED) panel, an active matrix organic light emitting diode (AMOLED) panel, a curved display panel, etc., but not limited thereto.

[0070] In addition, the output device 122 can be implemented as a touch screen panel (TSP), which also includes a touch input device for detecting user contact. When the output device 122 is implemented as a touch screen panel, the user can input a control command by touching the output device 122.

[0071] The controller 100 outputs control signals to provide overall control of the server device 1. The controller 100 may include one or more processors 101. In this instance, the processor 101 can be implemented as an array of logic gates, or can be implemented as a combination of a general-purpose microprocessor 101 and a memory 102 that stores programs executable in the microprocessor 101.

[0072] The memory 102 can store various information required for the operation of the server device 1. Specifically, the memory 102 can store an operating system or programs required for the operation of the server device 1, or store data required for the operation of the server device 1.

[0073] For example, the memory 102 can store the current status information of the first electronic device 2 and the second electronic device 2. In addition, the memory 102 can include high-speed random access memory, disks, static random access memory (SRAM), dynamic random access memory (DRAM), read-only memory (ROM), etc., but not limited thereto.

[0074] In addition, the memory 102 can be removable from the device. For example, the memory 102 can include a compact flash card (CF card), a secure digital card (SD card), a smart media card (SM card), a multimedia card (MMC), or a memory stick, but not limited thereto.

[0075] The controller 100 can control each component to allow the second electronic device 2 to provide voice guidance according to the user operation of the first electronic device 2 that does not provide a voice guidance function.

[0076] Specifically, based on the received status change information of the first electronic device 2, the controller 100 can control the communication circuit 110 to send the status change information and a command for activating the voice guidance function to the second electronic device 2.

[0077] In addition, the controller 100 may control the communication circuit 110 to send status change information and a command for activating the voice guidance function to the second electronic devices 2 among the plurality of second electronic devices 2 whose distance from the first electronic device 2 is less than or equal to a preset reference distance.

[0078] In addition, the controller 100 may control the communication circuit 110 to send status change information and a command for activating the voice guidance function to the second electronic device 2 with the highest priority based on the priority set by the user.

[0079] In addition, the controller 100 may exclude the second electronic devices 2 set by the user not to use the voice guidance function from the targets for sending the status change information and the command for activating the voice guidance function.

[0080] In addition, based on not receiving status change information from the first electronic device 2 within a preset reference time period, the controller 100 may control the communication circuit 110 to send a command for deactivating the voice guidance function to the second electronic device 2. Based on receiving a preset user input from the second electronic device 2 within a reference time period after sending the deactivation command, the controller 100 may reactivate the voice guidance function of the second electronic device 2.

[0081] Therefore, the controller 100 of the server device 1 according to the embodiment may notify the user of the operation status of the first electronic device 2 that does not provide the voice guidance function through the voice guidance function of the second electronic device 2.

[0082] According to an embodiment, the electronic device 2 may include a first electronic device 2 and a second electronic device 2, and the electronic device 2 may include a communication circuit 210, a user interface 220, and a controller 200. The communication circuit 210 communicates with the server device 1 via the network 4.

[0083] The communication circuit 210 may be connected to the server device 1 and may send data to the server device 1 and receive data from the server device 1. Specifically, the communication circuit 210 of the first electronic device 2 may send status change information to the server device 1, and the communication circuit 210 of the second electronic device 2 may receive status change information and a command for activating the voice guidance function from the server device 1.

[0084] The communication circuit 210 may include: a wireless communication circuit 211 that wirelessly sends data to an external electronic device 2 and receives data from the external electronic device 2; and a wired communication circuit 212 that sends data to an external device and receives data from the external device in a wired manner. The configuration of the communication circuit 210 is the same as that of the communication circuit of the server device 1, and thus its detailed description is omitted herein.

[0085] The electronic device 2 may include a user interface 220. For example, the user interface 220 is provided on the outer surface of the electronic device 2, and may receive control commands from a user and display information related to the operation of the electronic device 2.

[0086] The user interface 220 may include an inputter 221 for receiving control commands and an outputter 222 for displaying information related to the operation.

[0087] The inputter 221 may be implemented as at least one of input devices such as a touch screen, a button, a membrane button, a dial, a slide switch, etc., but is not limited thereto.

[0088] The outputter 222 may be implemented as a display device such as a plasma display panel (PDP), a liquid crystal display (LCD) panel, a light emitting diode (LED) panel, an organic light emitting diode (OLED) panel, an active matrix organic light emitting diode (AMOLED) panel, a curved display panel, etc., but is not limited thereto.

[0089] In addition, the outputter 222 may be implemented as a touch screen panel (TSP), and the TSP further includes a touch input device for detecting user contact. When the outputter 222 is implemented as a touch screen panel, the user may input a control command by touching the outputter 222.

[0090] In this example, the outputter 222 of each of the first electronic device 2 and the second electronic device 2 may include a speaker. Through the speaker, the first electronic device 2 may output a beep related to the operation of the electronic device 2, and the second electronic device 2 may output both a beep and a voice guidance.

[0091] The controller 200 outputs control signals to provide overall control of the electronic device 2. The controller 200 may include one or more processors 201, and the memory 202 may store various information required for the operation of the electronic device 2.

[0092] The controller 200 of the first electronic device 2 may control the communication circuit 210 of the first electronic device 2 to send the status information and status change information of the first electronic device 2 to the server device 1.

[0093] The controller 200 of the second electronic device 2 may control the communication circuit 210 of the second electronic device 2 to receive the status change information of the first electronic device 2 and a command for activating the voice guidance function.

[0094] In addition, the controller 200 of the second electronic device 2 may activate the voice guidance function based on the received activation command and play voice guidance content corresponding to the received status change information. Based on the updated status change information after activating the voice guidance function, the controller 200 of the second electronic device 2 may play voice guidance content corresponding to the updated status change information.

[0095] Figure 3 is a flowchart showing the operations of an electronic device and a server device according to an embodiment.

[0096] Referring to Figure 3 , the server device 1 may interact with the first electronic device 2 and the second electronic device 3 to allow the second electronic device 3 to provide status change information by voice, where the status change information is information about a change in the operating state of the first electronic device 2.

[0097] The first electronic device 2 may identify whether a user command for controlling the first electronic device 2 has been input (S300). For example, assuming that the first electronic device 2 is a cooking appliance, the user command may include an input for increasing the cooking temperature of the cooking appliance or an input for selecting a cooking mode. The state of the first electronic device 2 may be changed according to the user's intention based on the user command for controlling the first electronic device 2 (S310).

[0098] The first electronic device 2 may send status change information of the first electronic device 2 to the server device 1 based on the user command (S320).

[0099] The server device 1 may update the status information of the first electronic device 2 (S330). Based on the updated state of the first electronic device 2, the server device 1 may search for a second electronic device 3 that provides a voice guidance function so that the second electronic device 3 provides voice guidance (S340). For example, the second electronic device 3 that provides the voice guidance function may include a smart phone, a smart watch, and smart headphones.

[0100] In response to searching for a second electronic device 3 that provides a voice guidance function ( "Yes" in S340), the server device 1 may establish communication with the searched second electronic device 3 (S350).

[0101] The server device 1 may identify whether the voice guidance function is activated in the connected second electronic device 3 (S360). To this end, the server device 1 may store and maintain information in the memory 102 regarding whether the second electronic device 3 supports the voice guidance function.

[0102] Based on the voice guidance function being recognized as activated in the connected second electronic device 3 (Yes in S360), the server device 1 can send the status change information of the first electronic device 2 to the second electronic device 3 (S370).

[0103] The second electronic device 3 can receive the status change information of the first electronic device 2 and confirm whether the status information of the first electronic device 2 has been updated (S380). For example, it can be recognized that the status information of the first electronic device 2 has been updated based on a change in the cooking mode of the cooking appliance which is the first electronic device 2.

[0104] Based on the status information of the first electronic device 2 being confirmed as updated (Yes in S380), the second electronic device 3 can activate the voice guidance function to play voice guidance content corresponding to the updated status information of the first electronic device 2 (S390).

[0105] Based on the Internet of Things (IoT) system according to the embodiment, even a user with poor eyesight (such as a visually impaired person) can operate an electronic device that does not provide a voice guidance function by receiving guidance in real time without having to remember the operation process. Therefore, the convenience of using IoT devices by users can be increased.

[0106] In Figures 4 to 7 it is assumed that the first electronic device 2 that does not provide a voice guidance function is a washing machine, and the second electronic device 3 that provides a voice guidance function is a smart phone.

[0107] Figure 4 Illustrated is a user operating the first electronic device 2 in the IoT system according to the embodiment. Figure 5 Illustrated is the second electronic device 3 in the IoT system according to the embodiment that provides voice guidance in response to a user operation of the first electronic device 2.

[0108] The first electronic device 2 may include: an input unit 221 that can receive inputs regarding washing temperature, number of rinses, rotation speed, and additional functions; and an output unit 222 that displays the washing mode and remaining time.

[0109] The user can input a command for setting the washing temperature to the input unit 221 of the first electronic device 2. Accordingly, the first electronic device 2 can send the status change information changed according to the user's command to the server device 1. For example, the user can change the washing temperature by touching the input unit 221 for changing the washing temperature and can send information about the changed washing temperature to the server device 1.

[0110] The server device 1 can receive status change information (which is information about the changed washing temperature), and can search for a second electronic device 3 that provides a voice guidance function among the electronic devices included in the home network 4.

[0111] In response to searching for multiple second electronic devices 3, the server device 1 can establish communication with the second electronic device 3 whose distance from the first electronic device 2 is less than or equal to a preset reference distance. Alternatively, the server device 1 can establish communication with the second electronic device 3 having the highest priority according to a preset priority based on user settings.

[0112] However, in this instance, the server device 1 can exclude the second electronic device 3 that is set not to use the voice guidance function from the targets for establishing communication. Therefore, the server device 1 may not send the status change information and the command for activating the voice guidance function to the second electronic device 3 excluded from the targets for establishing communication.

[0113] The server device 1 can establish communication with the second electronic device 3 that is set to use the voice guidance function among the second electronic devices 3 whose distance from the first electronic device 2 is less than or equal to the preset reference distance, or the second electronic device 3 having the highest priority.

[0114] Thereafter, the server device 1 can send the status change information received from the first electronic device 2 and the command for activating the voice guidance function to the second electronic device 3 through the established communication.

[0115] Referring to Figure 5 , the smart phone corresponding to the second electronic device 3 can receive the washing temperature change information corresponding to the status change information of the washing machine from the server, and can identify that the status information of the washing machine has been changed. In addition, the second electronic device 3 can activate the voice guidance function based on the command for activating the voice guidance function received from the server.

[0116] Specifically, the smart phone corresponding to the second electronic device 3 can provide voice guidance by executing an application for providing voice guidance. For example, as Figure 5 shown, the smart phone can provide a voice message about the temperature setting because the status change information of the washing machine is related to the washing temperature setting.

[0117] That is, the smart phone can provide voice guidance for the washing temperature setting item selected by the user among a total of 13 items that can be set in the washing machine, and can also provide voice guidance for the user operations required to change the washing temperature. Specifically, in response to the user input of the washing temperature change button, the smart phone can provide voice guidance in the form of a voice message, which includes the total number of items, the order, the content, and operation instructions (such as "click here to select 'Temperature' as the first item among the 13 items").

[0118] Therefore, the user can confirm the function of the selected item and can also confirm the user operations required to select the function.

[0119] Figure 6 The user operation of the first electronic device 2 in the IoT system according to an embodiment is shown. Figure 7 The second electronic device 3 that provides voice guidance in response to the user operation of the first electronic device 2 in the IoT system according to an embodiment is shown.

[0120] As described above, the first electronic device 2 may include: an inputter 221 that can receive inputs regarding the washing temperature, the number of rinses, the rotation speed, and additional functions; and an outputter 222 that displays the washing mode and the remaining time.

[0121] The user can input a command for setting the number of rinses to the inputter 221 of the first electronic device 2. Therefore, the first electronic device 2 can send the status change information changed according to the user's command to the server device 1. For example, the user can change the number of rinses by touching the inputter 221 for changing the number of rinses and send information about the changed number of rinses to the server device 1.

[0122] The server device 1 can receive the status change information (which is information about the changed number of rinses) and search for the second electronic device 3 that provides the voice guidance function among the electronic devices included in the home network 4.

[0123] Similar to Figure 5 the server device 1 can establish communication with the second electronic device 3 that is set to use the voice guidance function among the second electronic devices 3 whose distance from the first electronic device 2 is less than or equal to a preset reference distance or the second electronic device 3 with the highest priority.

[0124] After that, the server device 1 can send the status change information received from the first electronic device 2 and a command for activating the voice guidance function to the second electronic device 3 through the established communication.

[0125] Refer to Figure 7, the smart phone corresponding to the second electronic device 3 can receive information on the change in the number of rinses corresponding to the status change information of the washing machine from the server and can recognize that the status information of the washing machine has been changed. In addition, the second electronic device 3 can activate the voice guidance function based on a command received from the server for activating the voice guidance function.

[0126] Specifically, the smart phone corresponding to the second electronic device 3 can provide voice guidance by executing an application for providing voice guidance. For example, as Figure 7 shown, since the status change information of the washing machine is related to the setting of the number of rinses, the smart phone can provide a voice message regarding the setting of the number of rinses.

[0127] That is, the smart phone can provide voice guidance for the item of the setting of the number of rinses selected by the user among a total of 13 items that can be set in the washing machine, and can also provide voice guidance for the user operation required to change the number of rinses. Specifically, in response to a user input to a button for changing the number of rinses, the smart phone can provide voice guidance in the form of a voice message that includes the total number of items, the order, the content, and operation instructions (such as "click here to select 'Rinse' as the second item among 13 items").

[0128] A user with low vision may not be able to visually confirm which command has been input into the IoT device. Based on the IoT system according to the embodiment, a user with low vision can confirm in real time whether he or she has operated the setting button for the washing temperature or the number of rinses through voice guidance. That is, even if the user operates an electronic device without a voice guidance function, the user can receive voice guidance through an electronic device equipped with a voice guidance function instead of an electronic device without a voice guidance function, thereby achieving a similar effect as if a voice guidance function has been added.

[0129] Figure 8 An example in which the distance between the first electronic device 2 and the second electronic device 3 in the IoT system according to the embodiment exceeds the reference distance is shown. Figure 9 An example in which the distance between the first electronic device 2 and the second electronic device 3 in the IoT system according to the embodiment is less than or equal to the reference distance is shown.

[0130] In Figure 8 and Figure 9 , it is assumed that the first electronic device 2 that does not provide a voice guidance function is a cooking appliance, and the second electronic device 3 that provides a voice guidance function is a smart watch.

[0131] Referring to Figure 8, the server device 1 can maintain (store) and update the GPS information included in the status information of the first electronic device 2 and the second electronic device 3 in the memory 102. Therefore, the server device 1 can determine the relative positions of the cooking appliance corresponding to the first electronic device 2 and the smart watch corresponding to the second electronic device 3 in real time, and can identify the distance between the cooking appliance and the smart watch.

[0132] The server device 1 can identify whether the distance a between the cooking appliance and the smart watch is less than or equal to a preset reference distance. For example, the preset reference distance can be 20 cm, which is the minimum distance required for the user to control the first electronic device 2, and this reference distance can be set by the user.

[0133] In response to the distance a between the cooking appliance and the smart watch exceeding the preset reference distance, the server device 1 may not send the status change information of the cooking appliance to the smart watch.

[0134] That is, as Figure 8 shown, when the distance a between the cooking appliance and the smart watch exceeds the preset reference distance, the server device 1 can determine that the user is not operating the cooking appliance, and can keep the voice guidance function of the smart watch in the deactivated state.

[0135] Referring to Figure 9 , in contrast to Figure 8 , in response to the distance b between the cooking appliance and the smart watch being less than or equal to the preset reference distance, the server device 1 can send the status change information of the cooking appliance to the smart watch.

[0136] Therefore, as Figure 9 shown, when the distance b between the cooking appliance and the smart watch is less than or equal to the preset reference distance, the server device 1 can determine that the user is operating the cooking appliance, and switch the voice guidance function of the smart watch to the activated state.

[0137] After activating the voice guidance function of the smart watch, when the operation state of the cooking appliance changes, the voice guidance for the smart watch can be performed based on the change in the operation state, as described above.

[0138] According to an embodiment, in response to activating the voice guidance function based on determining that the distance b between the cooking appliance and the smart watch is less than or equal to the preset reference distance, the smart watch corresponding to the second electronic device 3 can notify the user of the enabling of the voice guidance function.

[0139] That is, as Figure 9As shown, when the distance b from the cooking appliance is less than the reference distance, the smartwatch can provide a voice message such as "The cooking appliance is ready to be enabled". Thus, the user can receive a voice notification that he or she is approaching the cooking appliance, and at the same time, can confirm that the voice guidance has been enabled through the second electronic device 3.

[0140] According to another embodiment, in the case of searching for multiple second electronic devices 3, the server device 1 can control the voice guidance to be executed by the second electronic device 3 closest to the first electronic device 2.

[0141] For example, in the case where a smartwatch and a smart TV are searched as second electronic devices 3 providing voice guidance functions, the server device 1 can identify the distance between the smartwatch and the cooking appliance and the distance between the smart TV and the cooking appliance. In this instance, when the distance between the smartwatch and the cooking appliance is determined to be 20 cm and the distance between the smart TV and the cooking appliance is determined to be 1 m, the closest smartwatch can provide voice guidance. Thus, the best conditions for the user to hear voice guidance when operating the cooking appliance can be met, and multiple second electronic devices 3 outputting voice guidance simultaneously can be prevented.

[0142] Figure 10 and Figure 11 shows the reactivation of the voice guidance of the second electronic device in the IoT system according to an embodiment.

[0143] Referring to Figure 10 , in the case where the distance b between the cooking appliance corresponding to the first electronic device 2 and the smartwatch corresponding to the second electronic device 3 is less than or equal to a preset reference distance, the smartwatch can provide voice guidance by outputting a message such as "The cooking appliance is operating in oven mode".

[0144] In this instance, the user may not have clearly heard the message provided by the second electronic device 3, or a specific period of time has passed after the message, so the user may not be able to distinguish the current function menu structure and the position of the menu items.

[0145] In this case, based on the IoT system according to the embodiment, the voice guidance can be provided again through interaction with the second electronic device 3 before a preset reference time has passed after the previous voice guidance. In this instance, the interaction with the second electronic device 3 can include simple operations such as touching the screen or clicking a physical button, but is not limited thereto.

[0146] Therefore, when the user needs the voice guidance again because he or she did not clearly hear the voice guidance or a specific period of time has passed after the voice guidance, the user can receive the voice guidance again only by interacting with the second electronic device 3, without operating the first electronic device 2, thereby improving user convenience.

[0147] Referring to Figure 11 , Figure 10 the embodiments of [reference] can also be applied to the case where the voice guidance is assisted by one of the second electronic devices 3 that provide the voice guidance function.

[0148] The user can set the second electronic device 3 that provides the voice guidance function to provide the voice guidance instead of the first electronic device 2 that does not provide the voice guidance function, and can also set another second electronic device 3 to provide the voice guidance instead of the second electronic device 3.

[0149] For example, as Figure 11 shown, when the user operates the menu of the smart TV 3-1 corresponding to the second electronic device 3, the smart TV 3-1 can provide voice guidance such as "OTT has been selected".

[0150] In this example, since he or she cannot hear the voice guidance provided by the smart TV 3-1 for various reasons or a specific period of time has passed after the previous voice guidance, the user may need the voice guidance again. Even in this case, according to the user's settings, the voice guidance can be provided again by interacting with the smart watch 3-2 that assists in providing the voice guidance before the reference time has passed after the previous voice guidance.

[0151] Figure 12 is a flowchart showing a control method of a server device according to an embodiment.

[0152] Referring to Figure 12 , the user can input a user command (1200) for controlling the first electronic device 2 to the first electronic device 2. For example, the user can input a user command for controlling the operation of the first electronic device 2 or changing the state of the first electronic device 2.

[0153] The server device 1 can receive the changed state information of the first electronic device 2 in response to the user command (1210), and the server device 1 can select a second electronic device 3 whose voice guidance function is not restricted from the electronic devices connected to the home network 4 (1220).

[0154] The server device 1 can establish communication with the selected second electronic device 3 to allow the selected second electronic device 3 to perform voice guidance (1230). The server device 1 can send the changed status information of the first electronic device 2 and a command for activating the voice guidance function to the second electronic device 3 (1240). Therefore, the server device 1 can allow the second electronic device 3 to perform voice guidance based on the change in the status of the first electronic device 2.

[0155] Figure 13 It is a flowchart showing a control method of a second electronic device according to an embodiment.

[0156] Referring to Figure 13 , the second electronic device 3 can identify whether it has received the changed status information of the first electronic device 2 and a command for activating the voice guidance function from the server device 1 (1300). Based on being identified as having received the changed status information and the activation command from the server device 1 ( "Yes" in operation 1300), the second electronic device 3 can play voice guidance content corresponding to the changed status information of the first electronic device 2 (1310).

[0157] The second electronic device 3 can identify whether the status of the first electronic device 2 has changed by more than a preset reference time (1320). Based on the status of the first electronic device 2 being identified as not having changed by more than the preset reference time ( "Yes" in operation 1320), the second electronic device 3 can release the voice guidance function of the second electronic device 3 (1330).

[0158] The second electronic device 3 can identify whether a user interaction such as touching a display is detected within a preset reference time after releasing the voice guidance function (1340). In response to detecting a user interaction such as touching a display within the preset reference time after releasing the voice guidance function ( "Yes" in operation 1340), the second electronic device 3 can re - activate the voice guidance function and play the voice guidance content (1350). Therefore, when the user expects to listen to the voice guidance again, the user can receive the voice guidance through a simple interaction without operating the first electronic device 2.

[0159] The processor 101 of the server device 1 according to an embodiment can control the communication circuit 110 to send status change information and a command for activating the voice guidance function to a second electronic device 3 whose distance from the first electronic device 2 is less than or equal to a preset reference distance.

[0160] The processor 101 can control the communication circuit 110 to send status change information and a command for activating the voice guidance function to a second electronic device 3 whose distance from the first electronic device 2 is less than or equal to a preset reference distance.

[0161] The processor 101 may control the communication circuit 110 to send status change information and a command for activating the voice guidance function to the second electronic device 3 with the highest priority based on the priority set by the user.

[0162] The processor 101 may exclude the second electronic device 3 set by the user not to use the voice guidance function from the targets for sending status change information and a command for activating the voice guidance function.

[0163] The processor 101 may control the communication circuit 110 to send a command for deactivating the voice guidance function to the second electronic device 3 based on not receiving status change information from the first electronic device 2 within a preset reference time period.

[0164] The processor 101 may reactivate the voice guidance function of the second electronic device 3 based on receiving a preset user input from the second electronic device 3 within a reference time period after sending the command for deactivating the voice guidance function.

[0165] In the control method of the server device 1 according to the embodiment, sending status change information and a command for activating the voice guidance function may include sending status change information and a command for activating the voice guidance function to the second electronic device 3 whose distance from the first electronic device 2 is less than or equal to a preset reference distance.

[0166] Sending status change information and a command for activating the voice guidance function may include sending status change information and a command for activating the voice guidance function to the second electronic device 3 with the highest priority based on the priority set by the user.

[0167] The control method according to the embodiment may further include excluding the second electronic device 3 set by the user not to use the voice guidance function from the targets for sending status change information and a command for activating the voice guidance function.

[0168] The control method according to the embodiment may further include: sending a command for deactivating the voice guidance function to the second electronic device 3 based on not receiving status change information from the first electronic device 2 within a preset reference time period.

[0169] The control method according to the embodiment may further include: reactivating the voice guidance function of the second electronic device 3 based on receiving a preset user input from the second electronic device 3 within a reference time period after sending the command for deactivating the voice guidance function.

[0170] In the IoT system according to the embodiment, the server device 1 may send status change information and a command for activating the voice guidance function to the second electronic device 3 whose distance from the first electronic device 2 is less than or equal to a preset reference distance.

[0171] The server device 1 can send status change information and a command for activating the voice guidance function to the second electronic device 3 with the highest priority based on the priority set by the user.

[0172] The server device 1 can exclude the second electronic device 3 set by the user not to use the voice guidance function from the targets for sending status change information and the command for activating the voice guidance function.

[0173] Based on not receiving status change information from the first electronic device 2 within a preset reference time period, the server device 1 can control the communication circuit 110 to send a command for deactivating the voice guidance function to the second electronic device 3.

[0174] Based on receiving a preset user input from the second electronic device 3 within a reference time period after sending the command for deactivating the voice guidance function, the server device 1 can reactivate the voice guidance function of the second electronic device 3.

[0175] The second electronic device 3 can activate the voice guidance function based on the received command for activating the voice guidance function, and play voice guidance content corresponding to the received status change information.

[0176] Based on updating the status change information after activating the voice guidance function, the second electronic device 3 can play voice guidance content corresponding to the updated status change information.

[0177] Meanwhile, the disclosed embodiments can be implemented in the form of a recording medium storing instructions executable by a computer. These instructions can be stored in the form of program code, and when executed by a processor, these instructions can generate program modules for performing the operations of the disclosed embodiments. The recording medium can be implemented as a computer-readable recording medium.

[0178] The computer-readable recording medium can include all kinds of recording media storing instructions interpretable by a computer. For example, the computer-readable recording medium can be a read-only memory (ROM), a random access memory (RAM), a magnetic tape, a magnetic disk, a flash memory, an optical data storage device, etc.

[0179] The computer-readable recording medium can be provided in the form of a non-transitory storage medium. The term "non-transitory storage medium" can refer to a tangible device that does not include signals (e.g., electromagnetic waves), and can not distinguish between storing data semi-permanently and temporarily in the storage medium. For example, the non-transitory storage medium can include a buffer for temporarily storing data.

[0180] The methods according to various embodiments of the present disclosure may be provided in the form of a computer program product. The computer program product may be a commercial product that can be traded between a seller and a buyer. The computer program product may be distributed in the form of a storage medium (e.g., a compact disc read-only memory (CD-ROM)), through an application store (e.g., the Play Store™), directly between two user devices (e.g., smart phones), or online (e.g., downloading or uploading). In the case of online distribution, at least a part of the computer program product (e.g., a downloadable application) may be at least temporarily stored or arbitrarily created in a storage medium readable by a device such as a manufacturer's server, an application store's server, or a relay server.

[0181] Although the present disclosure has been shown and described in conjunction with specific embodiments, those skilled in the art will understand that changes and modifications may be made to these embodiments without departing from the principles and scope of the present disclosure, and the scope of the present disclosure is defined by the claims and their equivalents.

Claims

1. A server device, comprising: a communication circuit configured to communicate with a first electronic device and a second electronic device, the second electronic device being configured to be connected to the first electronic device via a network and provide a voice guidance function; and a processor configured to perform control to: control the communication circuit to receive status change information of the first electronic device; and control the communication circuit to send the received status change information and a command for causing the second electronic device to provide the voice guidance function according to a user operation of the first electronic device to the second electronic device, the second electronic device being connected to the first electronic device via the network.

2. The server device according to claim 1, wherein The processor is configured to: control the communication circuit to send the status change information and the command for providing the voice guidance function to a second electronic device whose distance from the first electronic device is less than or equal to a preset reference distance.

3. The server device according to claim 1, wherein, The processor is configured to: based on the priority set by a user, control the communication circuit to send the status change information and the command for providing the voice guidance function to the second electronic device with the highest priority.

4. The server device according to claim 1, wherein, The processor is configured to: exclude from the targets for sending the status change information and the command for providing the voice guidance function a second electronic device that is set by the user not to use the voice guidance function.

5. The server device according to claim 1, wherein, The processor is configured to: based on not receiving the status change information from the first electronic device within a preset reference time period, control the communication circuit to send a command for deactivating the voice guidance function to the second electronic device.

6. The server device according to claim 5, wherein, The processor is configured to: based on receiving a preset user input from the second electronic device within a reference time period after sending the command for deactivating the voice guidance function, reactivate the voice guidance function of the second electronic device.

7. A control method for a server device, the control method comprising: receiving status change information from a first electronic device; and sending the received status change information and a command for causing a second electronic device connected to the first electronic device via a network to provide a voice guidance function according to a user operation of the first electronic device to the second electronic device, the second electronic device being configured to be connected to the first electronic device via the network and provide the voice guidance function.

8. The control method according to claim 7, wherein, Sending the status change information and the command for providing the voice guidance function includes: sending the status change information and the command for providing the voice guidance function to a second electronic device whose distance from the first electronic device is less than or equal to a preset reference distance.

9. The control method according to claim 7, wherein Sending the status change information and the command for providing the voice guidance function includes: based on the priority set by a user, sending the status change information and the command for providing the voice guidance function to the second electronic device with the highest priority.

10. The control method according to claim 7, further comprising: Exclude a second electronic device that is set by a user not to use the voice guidance function from targets for sending the status change information and commands for providing the voice guidance function.

11. The control method according to claim 7, further comprising: Based on not receiving the status change information from the first electronic device within a preset reference time period, send a command for deactivating the voice guidance function to the second electronic device.

12. The control method according to claim 11, further comprising: Based on receiving a preset user input from the second electronic device within a reference time period after sending the command for deactivating the voice guidance function, reactivate the voice guidance function of the second electronic device.

13. An Internet of Things (IoT) system, comprising: A first electronic device; A second electronic device, configured to be connected to the first electronic device via a network and provide a voice guidance function; And A server device, configured to communicate with the first electronic device and the second electronic device, Wherein, The first electronic device is configured to send status change information to the server device, and The server device is configured to: send the received status change information and a command for causing the second electronic device to provide the voice guidance function according to a user operation of the first electronic device to the second electronic device, and the second electronic device is connected to the first electronic device via the network.

14. The IoT system according to claim 13, wherein, The server device is configured to: send the status change information and a command for providing the voice guidance function to a second electronic device whose distance from the first electronic device is less than or equal to a preset reference distance.

15. The IoT system according to claim 13, wherein, The server device is configured to: based on a priority set by a user, send the status change information and a command for providing the voice guidance function to a second electronic device having the highest priority.

Images