Control method of electronic device

Abstract

The present disclosure discloses a method for controlling multiple electronic devices, the method comprising the following steps: (a) collecting voice by the multiple electronic devices; (b) extracting voice commands based on information of the voice collected by each of the multiple electronic devices; (c) determining one of the multiple electronic devices that collects the voice as a master device, and determining the other devices among the multiple electronic devices that collect the voice as slave devices; (d) determining a target electronic device of the voice command by analyzing the voice command by the master device; and (e) transmitting the voice command to the target electronic device by the master device.

Description

Technical Field

[0001] The present disclosure relates to a method of controlling a plurality of electronic devices, and more particularly, to a method of controlling a plurality of electronic devices that determines priorities between voice command recognition devices and target electronic devices without server intervention. Background Art

[0002] Home appliances refer to appliances provided in homes, such as refrigerators, air conditioners, cooking appliances, cleaners (vacuum cleaners), etc. Conventionally, in order to operate such home appliances, users directly operate the home appliances while approaching them, or remotely control the home appliances using a remote controller or the like.

[0003] However, with the development of communication technology in recent years, a technology has been introduced in which a user operates a home appliance using a voice input command and the home appliance operates by recognizing the content of the voice input to the home appliance.

[0004] Conventional home appliances include a voice recognition system, a controller, a memory, and a driving unit. When a user speaks or issues a voice corresponding to a specific command, the home appliance collects the voice and analyzes the collected voice using the voice recognition system.

[0005] As a result of analyzing the collected voice, text corresponding to the voice may be extracted. The controller may compare the extracted first text information with the second text information stored in the memory and determine whether the texts match each other.

[0006] When the first text information and the second text information match each other, the controller may identify a predetermined function of the home appliance corresponding to the second text information.

[0007] The controller may then operate the drive unit based on the identified function.

[0008] According to such conventional home appliances, when a voice given by a user is input to a plurality of home appliances capable of recognizing a voice, operational confusion of the home appliances may occur.

[0009] In addition, in conventional home appliances, different characteristic points (starting commands) of home appliances are used to prevent confusion. However, in this case, the user should remember the different starting commands of each home appliance.

[0010] Furthermore, among conventional home appliances, electronic devices or home appliances without a voice input unit cannot be controlled by voice commands.

[0011] Furthermore, in conventional home appliances, intervention of a server is necessary to select a priority of a voice command among a plurality of electronic devices or home appliances.

[0012] (Related patent publication) Korean Patent Laid-Open Publication: 10-2005-0088538 Summary of the invention

[0013] Technical issues

[0014] The present disclosure is to provide a method for controlling a plurality of electronic devices, which can operate the plurality of electronic devices by a user's voice or feature points (startup commands) using natural language, so that the user does not need to remember or distinguish the feature points of each electronic device.

[0015] The present disclosure also provides a method for controlling multiple electronic devices, which is capable of executing voice commands without additional server intervention and reducing the burden on the server because one of the controllers of the multiple electronic devices becomes a main device that analyzes the voice command, determines the target electronic device, and transmits the voice command to the target electronic device.

[0016] The present disclosure further provides a method of controlling a plurality of electronic devices, which is capable of manipulating or operating an electronic device that does not have a voice recognition device among the plurality of electronic devices.

[0017] The present disclosure further provides a method of controlling a plurality of electronic devices, which is capable of manipulating or operating the electronic devices located at a location where the user's voice cannot be collected by a user's voice.

[0018] The present disclosure further provides a method of controlling a plurality of electronic devices, which is capable of accurately determining a target electronic device based on voice information and operation information of each electronic device.

[0019] The present disclosure is not limited to the above contents, and unmentioned problems to be solved will be clearly understood by those skilled in the art from the following description.

[0020] Technical Solution

[0021] A method for controlling multiple electronic devices according to the present disclosure relates to a method for controlling multiple electronic devices connected by a network, the method comprising the following steps: (a) collecting voices by the multiple electronic devices; (b) extracting voice commands based on information of the voices collected by each of the multiple electronic devices; (c) determining one of the multiple electronic devices that collect the voices as a master device, and determining the other devices of the multiple electronic devices that collect the voices as slave devices; (d) determining a target electronic device of the voice command by analyzing the voice command by the master device; and (e) transmitting the voice command to the target electronic device by the master device.

[0022] When the plurality of electronic devices extract the same voice command simultaneously, step (c) may be performed.

[0023] In step (c), one of the plurality of electronic devices that collect the voice may be randomly determined as the master device.

[0024] In step (c), the electronic device that collects the voice loudest among the multiple electronic devices that collect the voice may be determined as the main device.

[0025] In step (c), the electronic device that collects the voice with the highest accuracy among the multiple electronic devices that collect the voice may be determined as the master device.

[0026] In step (d), the master device may determine an electronic device among the master device and the slave device that can be operated according to the voice command as the target electronic device.

[0027] In step (d), when there are multiple electronic devices among the main device and the slave device that can operate according to the voice command, the main device determines the electronic device that collects the voice with the highest accuracy among the multiple electronic devices that collect the voice as the target electronic device.

[0028] In step (d), when there are multiple electronic devices among the main device and the slave device that can be operated according to the voice command, the main device can determine one of the multiple electronic devices that can be operated according to the voice command based on a user's pre-stored command pattern as the target electronic device.

[0029] In step (d), when there are multiple electronic devices that can be operated according to the voice command in the main device and the slave device, the main device can determine one of the multiple electronic devices that can be operated according to the voice command as the target electronic device based on a pre-stored user's command pattern.

[0030] In step (d), when there is no electronic device among the main device and the slave device that can be operated according to the voice command, the main device can determine an electronic device among electronic devices other than the main device and the slave device that can be operated according to the voice command as the target electronic device.

[0031] In step (d), when there is no electronic device among the multiple electronic devices connected via the network that can operate according to the voice command, the main device can enable one of the multiple electronic devices to operate as a wireless router and transmit the voice command to the wireless router.

[0032] Each of the plurality of electronic devices connected via the network may transmit to the main device whether the voice command is operable.

[0033] The method may further include: updating, by the main device, a voice command pattern of the user.

[0034] The main device may transmit the updated voice command pattern of the user to the plurality of electronic devices connected via the network.

[0035] Details of other implementations are included in the detailed description and accompanying drawings.

[0036] Beneficial Effects

[0037] According to a method of controlling multiple electronic devices disclosed in the present invention, there are one or more of the following effects.

[0038] First, according to the present disclosure, a user can operate multiple electronic devices by using a natural language voice or a feature point without having to remember or distinguish the feature point (startup command) of each electronic device. Therefore, it is convenient to perform voice operation on the electronic device by using the user's voice.

[0039] Secondly, since one of the controllers of the plurality of electronic devices becomes a master device that analyzes a voice command, determines a target electronic device, and transmits the voice command to the target electronic device, the voice command can be executed without intervention of an additional server. Therefore, the burden on the server can be reduced, no additional server is required, the cost of the server can be reduced, and the voice command can be executed even when the server and the electronic device are disconnected.

[0040] Third, when the electronic device with the voice recognition device cannot execute the extracted voice command, the electronic device with the voice recognition device transmits the voice command to the electronic device without the voice recognition device. Therefore, the electronic device without the voice recognition device can be voice-operated by the electronic device with the voice recognition device. Moreover, since there is no need to install the voice recognition device in the electronic device without the voice recognition device, the cost can be reduced.

[0041] Fourth, according to the present disclosure, an electronic device located in a position where the user's voice cannot be collected can be manipulated or operated by the user's voice. Therefore, regardless of the user's position, the user's voice command can be executed, thereby providing convenience to the user.

[0042] Furthermore, since a target electronic device can be accurately determined based on voice information and operation information of each electronic device, confusion of voice commands and malfunction of the electronic devices can be prevented.

[0043] The effects of the present disclosure are not limited to the above-mentioned effects, and other unmentioned effects will be clearly understood by those skilled in the art from the claims. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] Figure 1 is a perspective view showing a mobile robot and a charging station for charging the mobile robot according to one embodiment of the present disclosure.

[0045] Figure 2 Observed from the top Figure 1 A top view of the mobile robot is shown.

[0046] Figure 3 Viewed from the front Figure 1 Front view of the mobile robot shown in .

[0047] Figure 4 Observed from the bottom Figure 1 A bottom view of the mobile robot is shown.

[0048] Figure 5 An electronic device and an operating method of the electronic device according to one embodiment of the present disclosure are shown.

[0049] Figure 6 A plurality of electronic devices according to one embodiment of the present disclosure are shown.

[0050] Figure 7 A case where voice is uttered to a plurality of electronic devices is shown.

[0051] Figure 8 An operation of a target electronic device among a plurality of electronic devices is illustrated.

[0052] Fig. 9 is a flow chart illustrating a method of controlling a plurality of electronic devices. DETAILED DESCRIPTION

[0053] Please refer to the following and attached Figure 1 The present disclosure is illustrated by the following detailed description of the embodiments. However, the present disclosure is not limited to the embodiments disclosed below, but can be implemented in various different forms. These embodiments are provided only to make the present disclosure complete and to fully disclose the present disclosure to those of ordinary skill in the art to which the present disclosure belongs. The scope of the present disclosure is defined only by the claims. The same figure numerals refer to the same parts, units, components, parts or elements throughout the specification.

[0054] Spatially relative terms such as "under," "below," "below," "above," and "above" may be used to easily describe the relationship of an element to another element. Spatially relative terms should be understood in accordance with the orientations shown in the figures, including different orientations of the components when in use or operation. For example, an element described as being below or below another element may be placed above another element when the elements shown in the figures are inverted. Thus, the exemplary term "under" may include both downward and upward directions. Elements may also be oriented in different directions, and therefore, spatially relative terms may be interpreted based on orientation.

[0055] The terms used herein are used to describe the embodiments and are not intended to limit the present disclosure. In this specification, the singular includes the plural, unless the context clearly dictates otherwise. It should be noted that the term "comprising" used in this specification means that the elements, steps and / or operations mentioned do not exclude the existence or addition of one or more other elements, steps and / or operations.

[0056] Unless otherwise defined, all terms (including technical and scientific terms) used herein may be used in the sense commonly understood by those of ordinary skill in the art to which the present disclosure belongs. In addition, unless otherwise clearly defined, predetermined and commonly used terms are not ideally or overly interpreted.

[0057] In the drawings, for the sake of convenience and clarity, the thickness or size of each component, unit, member, part or element is enlarged, omitted or schematically shown. In addition, the size and area of ​​each component, unit, member, part or element do not fully reflect the actual size or area.

[0058] Hereinafter, preferred embodiments of the present disclosure will be described with reference to the accompanying drawings.

[0059] The mobile robot 100 according to the present disclosure may include a robot capable of self-movement using wheels or the like, and may include a home helper robot, a robot cleaner, and the like.

[0060] In the following, reference will be made to Figures 1 to 4 A mobile robot in a plurality of home appliances (a plurality of electronic devices) is described. The robot cleaner 100 is described as one embodiment of the mobile robot, but the present disclosure is not necessarily limited thereto.

[0061] The mobile robot 100 may include a body 110. Hereinafter, when defining each portion of the body 110, a portion facing the ceiling in a driving area may be defined as an upper portion (refer to Figure 2 ), the part facing the floor in the driving area can be defined as the lower part (refer to Figure 4), and a portion facing the driving direction among the portions forming the circumference of the main body 110 between the upper portion and the lower portion may be defined as a front portion (refer to Figure 3 ). In addition, a portion facing the opposite direction of the front of the body 110 may be defined as a rear portion. The body 110 may include a housing 111 forming a space in which various components constituting the mobile robot 100 are accommodated.

[0062] The mobile robot 100 includes a sensing unit 130 that senses or detects information about the outside of the mobile robot 100 .

[0063] The sensing unit 130 may sense or detect information about a driving area. The sensing unit 130 may detect obstacles such as walls, furniture, and cliffs on a driving surface. The sensing unit 130 may detect information about a ceiling. The sensing unit 130 may detect an object placed on a driving surface. With the help of the information detected by the sensing unit 130, the mobile robot 100 may perform mapping of a driving area. The sensing unit 130 may be composed of at least one sensor. The sensing unit 130 may detect intrusion detection information using a sensor. Specifically, the sensing unit 130 may detect image information surrounding the mobile robot.

[0064] In this case, the intrusion detection information may include all information capable of detecting external intrusion. For example, the intrusion detection information may include image information and sound information around the mobile robot, image information and sound information around the front door and windows. In addition, the intrusion detection information may include image information and sound information around the electronic device connected to the mobile robot via a network.

[0065] For example, the sensing unit 130 may include an image sensing unit 135 that senses or acquires an image of the outside (the periphery of the mobile robot). The image sensing unit 135 takes a picture of the driving area. The image sensing unit 135 may include a digital camera. The digital camera may include at least one optical lens, an image sensor, and a digital signal processor (DSP). The image sensor may include a plurality of photodiodes (e.g., pixels), wherein the image is focused by light passing through at least one optical lens. For example, the image sensor may be a complementary metal oxide semiconductor (CMOS) image sensor. The digital signal processor may generate an image based on a signal output by the photodiode. The digital signal processor may generate not only a static image, but also a dynamic image formed by a frame including a static image.

[0066] The sensing unit 130 may include a distance detection unit 131 that detects the distance to an obstacle. The distance detection unit 131 may be arranged at the front of the main body 110. The distance detection unit 131 may detect an obstacle on the front side. A plurality of distance detection units 131 may be provided. The distance detection unit 131 may include ultrasonic waves or infrared rays.

[0067] The distance detecting unit 131 may include a camera.

[0068] The sensing unit 130 may include a cliff detection unit 132 that detects a cliff on a floor in a driving area. A plurality of cliff detection units 132 may be provided.

[0069] In addition, the sensing unit 130 may include an illuminance detection sensor (not shown) that detects illuminance (brightness level) of the driving area. A plurality of cliff detection units 132 may be provided.

[0070] The sensing unit 130 may further include a lower image sensor 137 for acquiring an image of a floor.

[0071] The mobile robot 100 may include a driving unit 160 that moves the main body 110. The driving unit 160 moves the main body 110 relative to the floor. The driving unit 160 may include at least one driving wheel 166 that moves the main body 110. The driving unit 160 may include a driving motor. The driving wheels 166 may be respectively provided on the left and right sides of the main body 110. Hereinafter, the driving wheels 166 on the left and right sides are referred to as a left wheel 166 (L) and a right wheel 166 (R).

[0072] The left wheel 166 (L) and the right wheel 166 (R) may be driven by one drive motor, but if necessary, a left wheel drive motor for driving the left wheel 166 (L) and a right wheel drive motor for driving the right wheel 166 (R) may be provided separately. The driving direction of the main body 110 may be switched to the left or right side by making the rotation speeds of the left wheel 166 (L) and the right wheel 166 (R) different.

[0073] The mobile robot 100 may include an operation unit that performs a predetermined operation. The operation unit generates noise while performing a predetermined operation, for example, rotating a brush for combing or sweeping to generate noise, and operating a suction motor for vacuum suction to generate noise.

[0074] As an embodiment, the operation unit can be provided to perform household chores such as cleaning (combing or sweeping, vacuum cleaning, mopping, etc.), dishwashing, cooking, laundry, and garbage disposal. As another embodiment, the operation unit can be provided to perform operations such as manufacturing or repairing electrical appliances or devices. As another embodiment, the operation unit can perform operations such as finding objects or repelling insects.

[0075] As another example, the operation unit may perform a security function of detecting an external intruder, a dangerous situation, etc. The operation unit may include a camera for performing the security function, in which case the image sensing unit 135 may perform the function of the camera for performing the security function.

[0076] Hereinafter, in the present embodiment, it will be described that the operation unit performs the cleaning operation. However, the operation type of the operation unit may be various, and the operation unit need not be limited to the described embodiment.

[0077] The mobile robot 100 can clean the floor while moving the driving area with the help of the working unit. The working unit may include a suction device for sucking foreign matter, brushes 184 and 185 for performing combing or sweeping, a dust container (not shown) in which foreign matter collected by the suction device or the brush is stored, and / or a mop part (not shown) for performing mopping, etc.

[0078] A suction port 180h for sucking air may be formed at the lower surface of the main body 110. In the main body 110, a suction device (not shown) may be provided, which provides a suction force so that air can be sucked through the suction port 180h; and a dust container (not shown) in which dust sucked together with the air through the suction port 180h is collected.

[0079] In the housing 111 , an opening for inserting and separating the dust container may be formed, and a dust container cover 112 that opens and closes the opening may be rotatably provided with respect to the housing 111 .

[0080] A main brush 184 and an auxiliary brush 185 may be provided. The main brush 184 may be a roll type including a brush member exposed via the suction port 180h. The auxiliary brush 185 may have a brush member formed of a plurality of wings radially extending at the front side of the lower portion of the body 110. Dust may be removed from the floor in the driving area by the rotation of the brushes 184 and 185, and the dust separated from the floor is sucked via the suction port 180h and collected in a dust container.

[0081] The battery 177 may supply power for the overall operation of the mobile robot 100, including power for driving the motor.

[0082] The battery 177 may be rechargeable. When the mobile robot 100 docks at the charging station (charging base) 200, the charging terminal 210 and the corresponding terminal 190 are connected to each other, thereby charging the battery 177. When the charge amount of the battery 177 is equal to or less than a predetermined value, the mobile robot 100 may perform a return drive to the charging station 200 to charge the battery 177. During the return drive, the mobile robot 100 may detect the position of the charging station 200 itself.

[0083] The charging station 200 may include a signal transmission part (not shown) that transmits a predetermined return signal, which may be an ultrasonic signal or an infrared signal, but is not limited thereto.

[0084] Reference Figure 6 , a speech recognition system 10 according to one embodiment of the present disclosure may include a plurality of electronic devices 100 , 200 , 300 , and 400 capable of speech recognition.

[0085] For example, the plurality of intelligent electronic devices 100 , 200 , 300 , and 400 may include a cleaner 100 , a cooking appliance 200 , an air conditioner 300 , and a refrigerator 400 .

[0086] The plurality of electronic devices 100, 200, 300, and 400 may be in a standby state capable of receiving a voice. When the user sets a voice recognition mode for each intelligent electronic device, the standby state may be entered and maintained.

[0087] In this case, the setting of the voice recognition mode may be performed by input via a predetermined input unit or by inputting a predetermined voice.

[0088] One of the plurality of electronic devices 100, 200, 300, and 400 may not include a voice input unit and a voice recognition unit. In this case, another electronic device having a voice input unit and a voice recognition unit may extract the voice command and provide it to the electronic device not including the voice input unit and the voice recognition unit.

[0089] Each electronic device may include a communication unit (not shown) that can be connected to a terminal and / or other electronic devices located in a specific area by a connection method among wired, wireless and satellite communication methods to transmit and receive data with the terminal and / or other electronic devices.

[0090] The communication unit can receive various command signals (terminal signals) from external devices such as other electronic devices or terminals. The communication unit can transmit information to be output to external devices such as terminals.

[0091] For example, the communication unit may perform wireless communication via wireless communication technologies such as IEEE 802.11 WLAN, IEEE 802.15 WPAN, UWB, Wi-Fi, Zigbee, Z-wave, Bluetooth, etc. The communication unit may be changed according to the communication method of other devices or a server to be communicated with.

[0092] Information of the electronic devices 100 , 200 , 300 , and 400 may be received on the network 600 via the communication unit, and the electronic devices 100 , 200 , 300 , 400 may be controlled based on the received information.

[0093] The network 600 may refer to a communication network connected directly or indirectly via wires and / or wireless. That is, the phrase "the communication unit communicates with the terminal via the network 600" may include the case where the communication unit and the terminal communicate indirectly via the wireless router 400, etc., as well as the case where the communication unit and the terminal communicate directly.

[0094] The network 600 may be formed based on technologies such as Wi-Fi, Ethernet, zigbee, z-wave, and Bluetooth.

[0095] The plurality of electronic devices 100, 200, 300, and 400 may be located together in a predetermined space. In this case, even if the user issues a predetermined voice command toward a specific electronic device among the plurality of electronic devices 100, 200, 300, and 400, other electronic devices may respond to the voice command.

[0096] Therefore, in this embodiment, when the user utters a predetermined voice, the target electronic device that executes the voice command can be appropriately estimated or determined. In addition, according to this embodiment, when the user's voice command is determined to be a command of an electronic device that does not receive voice, the electronic device that does not receive voice can be controlled.

[0097] For details, refer to Figure 6 , each of the electronic devices 100 , 200 , 300 , and 400 may include a voice input unit 510 , a voice recognition unit (language recognition unit) 520 , and a command recognition unit 530 .

[0098] The voice input unit 510 can collect the voice uttered by the user. As an embodiment, the voice input unit 510 can include a microphone.

[0099] The voice input unit 510 can extract the collected voice information. In this case, the voice information can include the loudness and accuracy of the voice. When there is less other noise when the voice is input, the accuracy of the voice is higher, and when there is more other noise when the voice is input, the accuracy of the voice is lower.

[0100] The voice recognition unit 520 may extract text from the collected voice. The command recognition unit 530 may determine whether a text in which a predetermined distinguishing word related to the operation of each electronic device is used is included using the extracted text. The command recognition unit 530 may include a memory in which information about the distinguishing word is stored.

[0101] When the collected speech includes speech (information on speech) in which a distinguishing word is used, the command recognition unit 530 extracts a speech command from the speech in which the distinguishing word is used.

[0102] Although the voice recognition unit 520 and the command recognition unit 530 are described in the specification as having different functions, the voice recognition unit 520 and the command recognition unit 530 may be provided in one controller.

[0103] Figure 7 shows a case where a voice is emitted to a plurality of electronic devices 100, 200, 300, and 400, and Figure 8 An operation of a target electronic device among the plurality of electronic devices 100 , 200 , 300 , and 400 is illustrated.

[0104] Reference Figure 7 and Figure 8 For example, when a user says "please clean" or makes a voice of "please clean", and there are air conditioners 300 and refrigerators 400 capable of voice recognition at home, the air conditioners 300 and refrigerators 400 analyze the voice and extract the voice command. As an embodiment, the distinguishing word "please clean" is recognized, and the voice command of "start cleaning" can be extracted.

[0105] One of the air conditioner 300 and the refrigerator 400 that receives the voice is designated as the master device. For example, when the refrigerator 400 is designated as the master device, the refrigerator 400 may determine the target electronic device using various algorithms and various factors.

[0106] The refrigerator 400 may determine an electronic device capable of executing the voice command of 'start cleaning' in the order of the electronic device receiving the voice command and the electronic device not receiving the voice command.

[0107] The refrigerator 400 may determine that the air conditioner 300 and the refrigerator 400 receiving the voice command cannot execute the voice command of "start cleaning", and may determine the cleaner 100 as the target electronic device capable of executing the voice command of "start cleaning". In this case, the cleaner 100 is in a state where the user's voice is not input.

[0108] The refrigerator 400 may transmit the voice command to the cleaner 100 , and the cleaner 100 receiving the voice command may start cleaning.

[0109] According to this embodiment, the user can operate multiple electronic devices by using a natural language voice or a feature point without having to remember or distinguish the feature point (startup command) of each electronic device. Therefore, by using the user's voice, the electronic device can be easily operated.

[0110] In addition, since one of the controllers of the plurality of electronic devices becomes a master device that analyzes a voice command, determines a target electronic device, and transmits the voice command to the target electronic device, the voice command can be executed without intervention of an additional server. Therefore, the burden on the server can be reduced, no additional server is required, the cost of the server can be reduced, and the voice command can be executed even when the server and the electronic device are disconnected.

[0111] In addition, thirdly, when the electronic device with the voice recognition device cannot execute the extracted voice command, the electronic device with the voice recognition device transmits the voice command to the electronic device without the voice recognition device. Therefore, the electronic device without the voice recognition device can be operated by voice via the electronic device with the voice recognition device. In addition, since there is no need to install the voice recognition device on the electronic device without the voice recognition device, the cost can be reduced.

[0112] In the following, reference will be made to Fig. 9 A control method of a robot cleaner according to the present disclosure is described. The same or similar steps are denoted by the same reference numerals in the flowcharts, and overlapping descriptions will be omitted.

[0113] The control method may be executed by a controller (not shown) of each electronic device. The control method may be executed by a computer program that implements each step of the control method, or may be a recording medium on which a program for implementing the control method is recorded. In this specification, "recording medium" refers to a recording medium that can be read by a computer. The control method according to one embodiment may be executed by a control system of an electronic device including both hardware and software.

[0114] Each step and combination of the flowchart of the control method can be performed by computer program instructions. These instructions can be installed on a general-purpose computer or a dedicated computer, etc., and these instructions can create a means for performing the functions described in one or more steps of the flowchart.

[0115] In addition, in some embodiments, the functions mentioned in the steps may not appear in order. For example, two steps shown in succession may be performed substantially simultaneously, or may be performed in reverse order according to the corresponding functions.

[0116] According to an embodiment of the present disclosure, a control method may include: steps S110, S210 and S310, wherein voices are collected by multiple electronic devices 100, 200, 300 and 400; steps S120 and S220, wherein a voice command is extracted based on information of the voices collected by each of the multiple electronic devices; steps S140 and S240, wherein one of the multiple electronic devices 100, 200, 300 and 400 that collect voices is determined as a master device, and the other devices are determined as slave devices; step S150, wherein the master device determines a target electronic device (target device) of the voice command by analyzing the voice command; and step S160, wherein the master device transmits the voice command to the target electronic device.

[0117] In each of the steps S110, S210 and S310 of collecting voice, each of the plurality of electronic devices 100, 200, 300 and 400 can collect the user's voice. Specifically, each of the cleaner 100, the air conditioner 300 and the refrigerator 400 capable of voice recognition at home can collect the user's voice.

[0118] In each of the steps S120 and S220 of extracting the voice command, each electronic device may extract the voice command based on the information about the collected voice. The method of extracting the voice command is as described in reference to Figure 6 Specifically, when a user says "please clean" or makes a voice of "please clean" in a state where there are air conditioners 300 and refrigerators 400 at home, both of which can perform voice recognition, each of the air conditioners 300 and refrigerators 400 can extract the voice command by analyzing the voice. As an embodiment, it is recognized that the distinguishing word "start cleaning" is used, and the voice command of "start cleaning" can be extracted.

[0119] In the steps S140 and S240 of determining the master device and the slave device, among the plurality of electronic devices 100 , 200 , 300 , and 400 from which voices are collected, one is determined as the master device, and the others are determined as slave devices.

[0120] Among the multiple electronic devices 100, 200, 300 and 400 that have collected voice, when the multiple electronic devices 100, 200, 300 and 400 extract the same voice command at the same time, a step of determining that one is a master device and the others are slave devices is performed. In this case, the same time may refer to a time range including a certain range of error.

[0121] For example, when a user says "Please clean" or makes a voice of "Please clean" while the air conditioner 300 and the refrigerator 400 are together, if the air conditioner 400 and the refrigerator 500 analyze the voice and extract the voice command of "Start cleaning", it can be considered that multiple electronic devices 100, 200, 300 and 400 extract the same voice command at the same time.

[0122] The plurality of electronic devices 100, 200, 300, and 400 may provide basic data related to determining a master device and a slave device to the network 600, or provide their own operation information to the network 600 (S130, S230, S330). The operation information of each electronic device may be pre-stored in a memory.

[0123] In detail, the air conditioner 300 and the refrigerator 400 that have collected the voice and extracted the voice command can provide: operation information including whether the operation according to the extracted voice command is possible; and voice information including the loudness and accuracy of the collected voice to the network 600. The cleaner 100 can provide the network 600 with operation information including the voice command that can be operated by the cleaner 100.

[0124] As a method of determining a master device among a plurality of electronic devices 100, 200, 300, and 400 that have collected voices, various methods can be used. For example, one of the plurality of electronic devices 100, 200, 300, and 400 that have collected voices can be randomly determined as a master device. As another embodiment, the electronic device that has collected the loudest voice among the plurality of electronic devices 100, 200, 300, and 400 that have collected voices can be determined as a master device. As yet another embodiment, the electronic device that has collected voices with the highest accuracy among the plurality of electronic devices 100, 200, 300, and 400 that have collected voices can be determined as a master device. As yet another embodiment, the electronic device with the lowest numbered IP address among the plurality of electronic devices 100, 200, 300, and 400 that have collected voices can be determined as a master device.

[0125] More specifically, among the air conditioner 400 and the refrigerator 500 that have collected voices, the refrigerator 400 whose collected voice is the loudest and most accurate can become the master device.

[0126] In the step S150 of determining the target electronic device, the host device may determine the target electronic device of the voice command by analyzing each voice command. The host device may determine the target electronic device in various ways.

[0127] The main device may determine the target electronic device in consideration of whether the operation according to the voice command is possible, the accuracy of the voice, and the loudness of the voice. In this case, the target electronic device may refer to an electronic device that executes the user's voice command.

[0128] For example, the master device may determine an electronic device that can be operated according to a voice command among the master device and the slave device as a target electronic device. Considering the location where the user issues a voice command, the electronic device that collects the voice may have priority in executing the voice command.

[0129] As another embodiment, when there are multiple electronic devices that can operate according to voice commands among the master device and the slave devices, the master device can determine the electronic device that collects voice with the highest accuracy among the multiple electronic devices 100, 200, 300 and 400 as the target electronic device.

[0130] As another embodiment, when there are multiple electronic devices that can be operated according to voice commands among the master device and the slave devices, the master device can determine the electronic device with the loudest collected voice among the multiple electronic devices 100, 200, 300 and 400 as the target electronic device.

[0131] More specifically, when the air conditioner 300 and the refrigerator 400 extract the voice command "Please lower the temperature", both the air conditioner 300 and the refrigerator 400 can operate according to the voice command, so the main device can determine that the refrigerator 400 with the loudest collected voice is the target electronic device.

[0132] As another embodiment, when there are multiple electronic devices that can be operated according to voice commands among the main device and the slave devices, the main device can determine an electronic device that can be operated based on a user's pre-stored command mode among the multiple electronic devices 100, 200, 300 and 400 as a target electronic device.

[0133] In this case, the user's command pattern may refer to information of an electronic device used by the user at a current date and a current time within a past period of time.

[0134] As another embodiment, if there is no electronic device operable according to a voice command among the master device and the slave device, the master device may determine an electronic device operable according to a voice command among electronic devices other than the master device and the slave device as a target electronic device.

[0135] Specifically, when the air conditioner 300 and the refrigerator 400 extract the voice command of "start cleaning", neither the air conditioner 300 as a slave device nor the refrigerator 400 as a master device can execute the voice command. Therefore, the refrigerator 400 can determine the cleaner that can be operated according to the voice command among electronic devices other than the master device and the slave device as the target electronic device.

[0136] As another embodiment, if there is no electronic device operable according to the voice command among the plurality of electronic devices 100, 200, 300, and 400 connected via the network 600, the master device causes one of the plurality of electronic devices 100, 200, 300, and 400 to operate as a wireless router, and the master device transmits the voice command to the wireless router. When the target electronic device is located in a shielded area or a shadowed area, the master device causes the electronic device connected to the network 600 to operate as a wireless router, thereby operating the target electronic device in the shielded area or the shadowed area.

[0137] In the step S160 of transmitting the voice command, the main device may transmit the voice command to the target electronic device. Specifically, the refrigerator may transmit the voice command of "start cleaning" to the cleaner.

[0138] The electronic device receiving the voice command from the main device operates according to the voice command.

[0139] The main device may determine the target electronic device and update the user's voice command pattern (S170). The main device may transmit the user's updated voice command pattern to the plurality of electronic devices 100, 200, 300, and 400 connected via the network 600 (S180).

[0140] Each electronic device that receives the user's updated voice command pattern may update its voice command pattern (S280, S380). That is, each electronic device may store the updated data of the user's voice command pattern in its memory.

[0141] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and the present disclosure does not depart from the technical features of the present disclosure required in the claims. In addition, various modifications may be made by those skilled in the art, and these modifications should not be understood independently from the technical spirit or prospects of the present disclosure.

Claims

1. A method for controlling a plurality of electronic devices connected via a network, the method comprising the following steps: (a) collecting voices by the plurality of electronic devices; (b) extracting a voice command based on the voice information collected by each of the plurality of electronic devices; (c) determining one of the multiple electronic devices that collect the voice as a master device, and determining the other devices of the multiple electronic devices that collect the voice as slave devices; (d) determining a target electronic device for the voice command by analyzing the voice command by the host device; as well as (e) transmitting the voice command from the host device to the target electronic device, Wherein, in step (d), when there is no electronic device among the multiple electronic devices connected via the network that can operate according to the voice command, the main device enables one of the multiple electronic devices to operate as a wireless router and transmits the voice command to the wireless router.

2. The method according to claim 1, wherein: When the multiple electronic devices simultaneously extract the same voice command, step (c) is performed.

3. The method according to claim 1, wherein: In step (c), one of the plurality of electronic devices that collect the voice is randomly determined as the master device.

4. The method according to claim 1, wherein: In step (c), the electronic device that collects the loudest voice among the multiple electronic devices that collect the voice is determined as the main device.

5. The method according to claim 1, wherein: In step (c), the electronic device that collects the speech with the highest accuracy among the multiple electronic devices that collect the speech is determined as the main device.

6. The method according to claim 1, wherein: In step (d), the master device determines an electronic device among the master device and the slave device that can be operated according to the voice command as the target electronic device.

7. The method according to claim 6, wherein: In step (d), when there are multiple electronic devices among the main device and the slave device that can operate according to the voice command, the main device determines the electronic device that collects the voice with the highest accuracy among the multiple electronic devices that collect the voice as the target electronic device.

8. The method according to claim 6, wherein: In step (d), when there are multiple electronic devices among the master device and the slave device that can operate according to the voice command, the master device determines the electronic device among the multiple electronic devices that collects the loudest voice as the target electronic device.

9. The method according to claim 6, wherein: In step (d), when there are multiple electronic devices among the main device and the slave device that can be operated according to the voice command, the main device determines one of the multiple electronic devices that can be operated according to the voice command based on a user's pre-stored command pattern as the target electronic device.

10. The method according to claim 1, wherein: In step (d), when there is no electronic device among the main device and the slave device that can be operated according to the voice command, the main device determines an electronic device among electronic devices other than the main device and the slave device that can be operated according to the voice command as the target electronic device.

11. The method according to claim 1, wherein: Each of the plurality of electronic devices connected via the network transmits to the main device whether the voice command is operable.

12. The method according to claim 1, further comprising: The user's voice command pattern is updated by the master device.

13. The method according to claim 12, wherein: The main device transmits the updated voice command pattern of the user to the plurality of electronic devices connected via the network.

Images