Selecting a more appropriate input modality related to a user command for light control

Abstract

A system (1) for determining suitability of an input modality (36) for providing a user command for controlling at least one lighting device (31) is configured to receive a signal indicative of a user command for controlling at least one lighting device. The user command is provided by a user (69) using an input modality. The system is further configured to determine a suitability rating of the used input modality in relation to the user command, determine one or more further suitability ratings of one or more further input modalities (19, 37, 38) in relation to the user command, compare the suitability rating with the one or more further suitability ratings, and output information specifying a recommended input modality in relation to the user command. The recommended input modality is selected from the one or more further input modalities and has a further suitability rating that is higher than the suitability rating.

Description

Technical Field

[0001] The present invention relates to a system for determining the suitability of an input mode for providing user commands for controlling at least one lighting device.

[0002] The present invention further relates to a method for determining the suitability of an input modality for providing user commands for controlling at least one lighting device.

[0003] The present invention also relates to a computer program product that enables a computer system to execute this method. Background Technology

[0004] Philips' Hue portfolio of smart lighting products is growing, and the combination of fixtures, accessories, and services offered can vary and cover a wide range of use cases. This number increases even more when all Hue-compatible products are included in the portfolio (such as Alexa or any IFTTT integration).

[0005] From a consumer's perspective, it can be difficult to find the proper configuration or optimal settings required to achieve the desired use case. This is confirmed by numerous user studies of Hue customers, in which users reported missing but available features that were unknown to them. For example, one user might only be interested in changing light bulbs and controlling them with a switch, while another user might be interested in a combination of voice control and buttons that could improve their entertainment setup. The complexity behind a large product line of multifunctional devices that can be used in multiple ways can lead consumers to make suboptimal choices when purchasing or configuring products, resulting in a poor user experience.

[0006] It is known in the prior art that there are mechanisms for recommending products based on simple specifications (e.g., lux levels). US 2020 / 0104900 A1 discloses a more advanced product recommendation system in which users can rate products using different input modalities (e.g., voice, text, body language). Rating inputs using a first input modality can be weighted differently from rating inputs using a second input modality. However, these product recommendations do not take into account the specific circumstances of the buyer. Summary of the Invention

[0007] The first objective of this invention is to provide a system that makes it easier for a user to control at least one lighting device in his or her specific circumstances.

[0008] A second objective of the present invention is to provide a method that makes it easier for a user to control at least one lighting device in his or her particular circumstances.

[0009] In a first aspect of the invention, a system for determining the suitability of an input modality of a first input type for providing a user command for controlling at least one lighting device includes: at least one receiver, at least one output interface, and at least one processor configured to: receive, via the at least one receiver, a signal indicating a user command for controlling the at least one lighting device, the user command being provided by a user using the input modality of the first input type; determine a suitability rating for the input modality used in relation to the user command; determine one or more additional suitability ratings for one or more additional input modalities in relation to the user command; compare the suitability ratings with the one or more additional suitability ratings; and output, via the at least one output interface, information specifying a recommended second input type input modality in relation to the user command, the recommended input type being selected from the one or more additional input modalities, the additional suitability rating of the recommended input modality being higher than the suitability rating.

[0010] By comparing the suitability ratings of the input modal of the first input type used with those of other input modalities associated with the user command, a second input type (different from the first input type) or a set of second input type input modalities that is more suitable for the user's specific situation can be selected / recommended. The input modal used and the one or more other input modalities may include, for example, one or more of voice input, light switch input, and sensor input. An input modality is a specific type of input. For example, different light control devices can be considered different types of input modalities. For example, different types of buttons on different types of light switches can be considered different types of input modalities. For example, different types of sensor inputs from different types of sensors can be considered different types of input modalities.

[0011] Additional input modalities may include only those already available to the user, such as devices already present in the lighting system; or they may include all input modalities that could potentially be used by the user, such as devices supported by the lighting system. For example, suitability ratings and one or more additional suitability ratings can be determined by obtaining them from (local) memory. Alternatively, for example, the suitability ratings and the one or more additional suitability ratings may be obtained from another system. Optionally, the output information includes the main reasons for recommending one or more additional input modalities.

[0012] The at least one processor can be configured to determine an input modality suitability rating based on whether the input modality already exists in the lighting system. For example, devices already existing in the lighting system may slightly improve their suitability, so when there are two more suitable input modalities (one present and the other absent) than the one currently used by the user, the system can recommend the existing input modality. When determining whether to recommend repurposing an existing device or purchasing another similar device, the suitability rating of an existing input modality associated with another (previously received) user command can be considered.

[0013] The at least one processor can be configured to determine the suitability rating and the one or more additional suitability ratings based on the size of the space in which the user commands are provided. For example, the benefit / suitability of a voice assistant is typically higher in a larger space.

[0014] The at least one processor can be configured to determine the suitability rating and the one or more additional suitability ratings based on the functionality of the space. For example, the functionality of the space can indicate how the space is used.

[0015] The at least one processor can be configured to determine the suitability rating and the one or more additional suitability ratings based on the complexity of the user interaction associated with providing the user command using the input modality. The complexity of the user interaction can depend on the location of the lighting equipment and(s) of the lighting control devices. Locating and unlocking a mobile phone requires some effort and may therefore increase the complexity of the user interaction. Selecting three light scenes on a Hue tap switch is less complex than using the Hue app, and the Hue tap switch can be recommended if the user frequently selects three light scenes.

[0016] The at least one processor may be configured to determine, based on a specific action specified in the user command, the suitability rating of the used input modality of the first input type associated with the user command. The specific action may include, for example, selecting any lighting scene, selecting a specific lighting scene, turning off all lighting devices, or turning on all lighting devices. For example, information presented to the user may indicate, "To directly select a scene, I recommend using a tap switch" or "To select only a scene, a tap switch may be a better choice than a dimmer switch."

[0017] Alternatively or additionally, the at least one processor may be configured to determine, independently of a specific action specified in the user command, the suitability rating of the used input modality of the first input type associated with the user command. For example, for any user command provided in a living room and / or large room, voice input may be preferred over light switch input. The content and context of the user command can be evaluated to determine whether the suitability rating should depend on or be determined independently of a specific action specified in the user command.

[0018] The suitability rating and the one or more additional suitability ratings can be calculated based on input modalities used by other users in relation to the user's command. For example, the other user may have a lighting system that is more similar to the user's lighting system than a first threshold, and / or may have a space that is more similar to the user's space than a second threshold. The similarity between lighting systems can be determined, for example, based on the type of device, the number of devices, their relative location, and / or device settings (e.g., the lighting system may include a light control device of the "tap switch" type, located in the living room and set to control all living room lights). The similarity between spaces can be determined, for example, based on the shape (e.g., square), size (e.g., m^2), function (e.g., bedroom vs. living room), and / or content (e.g., two single beds vs. one single bed vs. one double bed, or a central sofa vs. a sofa plus a table).

[0019] As a first example, if many other users with spaces of the same type and / or similar size use different input modalities associated with commands also executed by the user, this different input modality can be recommended to the user. As a second example, if many other users with the same type of lighting equipment and the same type of light control equipment use different input modalities associated with commands also executed by the user, this different input modality can be recommended to the user.

[0020] The threshold can be expressed as a percentage, such as 70% or 80%. The first and second thresholds can be the same or different. As an example, if two users share six out of their respective seven and eight spaces, a similarity can be determined between 75% (six divided by eight) and 85% (six divided by seven).

[0021] Alternatively, the suitability rating and the one or more additional suitability ratings may be calculated based on input modalities related to the user command recommended by the lighting company (e.g., based on user testing).

[0022] The at least one processor can be configured to: determine settings for a lighting control device based on the user command, the lighting control device being associated with the recommended input mode of the second input type; and transmit the settings to the lighting control device via the at least one output interface. For example, if the user has already configured a light scene for a first light control device (e.g., a dimmer switch) corresponding to the first input mode or in the first light control device, and the second input mode is more suitable for selecting that light scene, the light scene can be configured for a second light control device (e.g., a smart speaker system) corresponding to the second input mode or configured in the second light control device.

[0023] The information may also specify additional recommended input modalities associated with the user command, the additional recommended input modalities being selected from the one or more additional input modalities, and the additional suitability rating of the combination of the recommended input modalities and the additional recommended input modalities being higher than the suitability rating. For example, in a bedroom, it might be preferable not to use voice control at certain times so as not to wake a partner. In this case, a combination of a smart speaker system and a smart button could be recommended. The lights could then be turned on using voice control. The smart button could be attached to the side of the bed and could be used to turn off the lights, for example, after it has been used in conjunction with a "reading" light scene.

[0024] The at least one processor can be configured to determine an suitability rating for the used input modality of the first input type associated with the user command by determining a user-independent suitability rating that is universal to all users of the system and applying user-related weights to the user-independent suitability rating. For example, the at least one processor can be configured to determine the user-related weights based on user-specified preferences and / or previous user commands provided by the user. Some aspects of suitability are typically user-independent, such as depending on the size of the space, the function of the space, the location of the device, and / or the suitability of the light control device for certain types of commands. Some other aspects of suitability are typically user-related. For example, some users may dislike using their mobile devices and / or voice assistants to control lights, for example, because their voice assistants rarely understand their commands.

[0025] In a second aspect of the invention, a method for determining the suitability of an input modality of a first input type for providing a user command for controlling at least one lighting device includes: receiving a signal indicating the user command for controlling the at least one lighting device, the user command being provided by a user using the input modality of the first input type; determining a suitability rating of the used input modality associated with the user command; determining one or more additional suitability ratings of one or more additional input modalities associated with the user command; comparing the suitability rating with the one or more additional suitability ratings; and outputting information specifying a recommended input modality of a second input type associated with the user command, the recommended input modality of the second input type being selected from the one or more additional input modalities, the additional suitability rating of the recommended input modality being higher than the suitability rating. The method can be performed by software running on a programmable device. The software can be provided as a computer program product.

[0026] Furthermore, a computer program for implementing the methods described herein is provided, along with a non-transitory computer-readable storage medium for storing the computer program. The computer program may, for example, be downloaded to or uploaded to an existing device, or stored during the manufacture of these systems.

[0027] A non-transitory computer-readable storage medium stores at least one portion of software code that, when executed or processed by a computer, is configured to perform executable operations to determine the suitability of an input modality for providing user commands for controlling at least one lighting device.

[0028] The executable operations include: receiving a signal indicating a user command for controlling the at least one lighting device, the user command being provided by a user using an input modality of a first input type; determining an suitability rating for the used input modality associated with the user command; determining one or more additional suitability ratings for one or more additional input modalities associated with the user command; comparing the suitability ratings with the one or more additional suitability ratings; and outputting information specifying a recommended input modality of a second input type associated with the user command, the recommended input modality of the second type being selected from the one or more additional input modalities, the additional suitability rating of the recommended input modality being higher than the suitability rating.

[0029] As those skilled in the art will understand, aspects of the present invention can be embodied as an apparatus, method, or computer program product. Accordingly, aspects of the present invention can take the form of a completely hardware embodiment, a completely software embodiment (including firmware, resident software, microcode, etc.), or an embodiment combining software and hardware aspects, all of which may generally be referred to herein as a “circuit,” “module,” or “system.” The functionality described in this disclosure can be implemented as an algorithm executed by a computer’s processor / microprocessor. Furthermore, aspects of the present invention can take the form of a computer program product embodied in one or more computer-readable media having computer-readable program code embodied thereon (e.g., stored thereon).

[0030] Any combination of one or more computer-readable media can be used. A computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. A computer-readable storage medium can be, for example, but not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatuses, or devices, or any suitable combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections having one or more wires, portable computer floppy disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable optical disc read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In the context of this invention, a computer-readable storage medium can be any tangible medium that can contain or store a program used by or in conjunction with an instruction execution system, apparatus, or device.

[0031] A computer-readable signal medium may contain a propagated data signal having computer-readable program code embodied therein, such as a data signal propagated in baseband or as part of a carrier wave. This propagated signal may take any of a variety of forms, including, but not limited to, electromagnetic, optical, or any suitable combination thereof. A computer-readable signal medium may be any computer-readable medium that is not a computer-readable storage medium and can convey, propagate, or deliver a program for use by or in connection with an instruction execution system, apparatus, or device.

[0032] Program code embodied on a computer-readable medium may be transmitted using any suitable medium, including but not limited to wireless, wired, fiber optic, cable, RF, or any suitable combination thereof. Computer program code used to implement aspects of this invention may be written in any combination of one or more programming languages, including: object-oriented programming languages ​​such as Java™, Smalltalk, C++, or similar languages; and conventional procedural programming languages ​​such as the "C" programming language or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be established to an external computer (e.g., through the use of the Internet provided by an Internet service provider).

[0033] Aspects of the invention are described below with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block in the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, or other programmable data processing apparatus, particularly a microprocessor or central processing unit (CPU), to produce a machine such that the instructions, executable via the processor of the computer, other programmable data processing apparatus, or other device, create components for implementing the functions / behaviors specified in one or more blocks of the flowchart illustrations and / or block diagrams.

[0034] These computer program instructions may also be stored in a computer-readable medium that can instruct a computer, other programmable data processing apparatus, or other device to function in a particular manner, such that the instructions stored in the computer-readable medium produce an article of manufacture comprising instructions that implement the functions / behaviors specified in one or more boxes of a flowchart and / or block diagram.

[0035] Computer program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus, or other device to produce a computer-implemented process, such that the instructions, which execute on the computer or other programmable apparatus, provide for implementing the functions / behaviors specified in one or more boxes of a flowchart and / or block diagram.

[0036] The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of devices, methods, and computer program products according to various embodiments of the present invention. In this regard, each box in a flowchart or block diagram may represent a module, segment, or portion of code, which includes one or more executable instructions for implementing a specified logical function(s). It should also be noted that in some alternative implementations, the functions indicated in the boxes may occur in a different order than shown in the figures. For example, two boxes shown consecutively may actually be executed substantially simultaneously, or, depending on the functions involved, these blocks may sometimes be executed in reverse order. It should also be noted that each box in a block diagram and / or flowchart, and combinations of boxes in block diagrams and / or flowcharts, can be implemented by a system based on dedicated hardware or a combination of dedicated hardware and computer instructions that performs the specified functions or behaviors. Attached Figure Description

[0037] These and other aspects of the invention will be apparent by way of example and will be further illustrated by way of example with reference to the accompanying drawings, wherein:

[0038] Figure 1 This is a block diagram of the first embodiment of the system;

[0039] Figure 2 An example of a space where user commands can be provided is shown;

[0040] Figure 3 This is a block diagram of the second embodiment of the system;

[0041] Figure 4 This is a flowchart of the first embodiment of the method;

[0042] Figure 5 This is a flowchart of the second embodiment of the method;

[0043] Figure 6 This is a flowchart of the third embodiment of the method;

[0044] Figure 7 This is a flowchart of the fourth embodiment of the method;

[0045] Figure 8 This is a flowchart of the fifth embodiment of the method; and

[0046] Figure 9 This is a block diagram of an exemplary data processing system for performing the methods of the present invention.

[0047] Corresponding elements in the accompanying drawings are indicated by the same reference numerals. Detailed Implementation

[0048] Figure 1A first embodiment of a system for determining the suitability of an input modality for providing user commands to control at least one lighting device is shown. In this first embodiment, the system is a mobile device 1. The lighting system includes a bridge 16, lighting devices 31-34, and light control devices 36-38. Lighting devices 31-34 can be controlled via bridge 16 using light control devices 36-38. For example, light control device 37 can be used to control lighting device 33.

[0049] Lighting fixtures 31-34 can be, for example, Philips Hue lamps. For example, bridge 16 can be a Philips Hue bridge. Figure 1 In the example, light control devices 36-38 are different types of light switches. For example, lighting devices 31-34 and light control devices 36-38 can communicate with bridge 16 using Zigbee technology. Bridge 16 is connected to wireless LAN access point 17, for example, via Wi-Fi or Ethernet. Wireless LAN access point 17 is connected to the Internet 11.

[0050] Mobile device 1 and Internet server 13 can control lighting devices 31-34 via wireless LAN access point 17 and bridge 16. Internet server 13 is also connected to Internet 11. An Internet server cluster can be used instead of a single Internet server. This cluster can be part of one or more clouds.

[0051] Mobile device 1 includes a transceiver 3, a transmitter 4, a processor 5, a memory 7, and a touchscreen display 9. The processor 5 is configured to receive signals via the receiver 3 indicative of user commands for controlling lighting devices 31 and / or 32. Figure 1 In this embodiment, the signal is received from bridge 16. User commands are provided by the user using an input modality, such as a button on one of the light control devices 36-38 or a touchscreen display 9 of the mobile device 1.

[0052] The processor 5 is further configured to: determine an applicability rating for the input modality used in relation to the user command; determine one or more additional applicability ratings for one or more additional input modalities associated with the user command; and compare the applicability rating with one or more additional applicability ratings.

[0053] The processor 5 is also configured to output information via the touchscreen display 9 specifying recommended input modalities related to user commands. The recommended input modalities are selected from one or more other input modalities. The additional suitability rating of the recommended input modalities is higher than the general suitability rating.

[0054] In a first implementation, the mobile device 1 (its processor 5) calculates the suitability rating and one or more additional suitability ratings itself. In a second implementation, the processor 5 is configured to determine the suitability rating and one or more additional suitability ratings by obtaining the suitability rating and one or more additional suitability ratings from the Internet server 13.

[0055] Figure 2 An example space where user commands can be provided is shown. The ground floor 61 of the residence includes a foyer 63, a kitchen 64, and a living room 65. A wireless LAN access point 17, lighting fixtures 34, and a light control device 38 are installed in the foyer 63. Lighting fixtures 33 and a light control device 37 are installed in the kitchen 33. A bridge 16, lighting fixtures 31 and 32, and a light control device 36 are installed in the living room 65.

[0056] The light control device 36 is a light switch with multiple buttons. Each button can be associated with a light scene, and each light scene can be associated with one or more lighting devices. Figure 2 In the example, one light scene is already associated with lighting device 32, and two light scenes are already associated with lighting device 31. Each of these three light scenes is associated with a different button on light control device 36.

[0057] exist Figure 2 In the example, user 69 is sitting on the sofa in living room 65, holding... Figure 1 Mobile device 1. Before user 69 sits down on the sofa, he uses light control device 36 to turn on lighting device 31. At some point, user 69 wants to change the scene, so he walks to light control device 36 and presses a button.

[0058] Shortly thereafter, or at another appropriate time, mobile device 1 provides a recommendation to user 69 to control lighting device 31 using the smart speaker system. The mobile device can recommend this additional input modality because the scene-changing button was pressed, for example, in the living room and / or a large room.

[0059] After user 69 installed the new smart speaker system 19 and the wireless connection between the smart speaker system 19 and the wireless LAN access point 17 was established (see...) Figure 1 The mobile device 1 or bridge 16 detects the new smart speaker system 19 and configures the smart speaker system 19 using at least two light scenes associated with the lighting device 31. This configuration may be stored, for example, in the smart speaker system 19 itself or on a cloud server used by the smart speaker system 19.

[0060] Instead of a smart speaker system, mobile device 1 can recommend using an additional light switch, such as a tap switch or smart button, in the living room, which can be placed closer to the lighting fixture 31 than the light control device 36. For example, if a user has already programmed the lighting fixture 34 to automatically turn on and off based on a schedule and is not actually using the light control device 38 as a smart button, the user can move the light control device 38 to the back of the living room 65. The advantage of voice control is that it is beneficial in larger spaces. However, selecting a light scene using a tap switch or smart button is easier than using voice control.

[0061] Mobile device 1 can use a baseline scoring method that defines the optimal input modality or set of input modalities that maximizes the value of the user's interaction with the lighting system. This method can determine the value that each (reasonable) device or combination of devices will generate for a given interaction. Furthermore, user-defined weights can be used for the baseline value, which are based on and depend on user preferences, usage over time, time of day, or a combination thereof. Recommendations for the optimal set of interactive devices can then be generated based on the baseline score and the user-defined weights. Weights indicating whether an input modality already exists in the lighting system can also be applied.

[0062] If mobile device 1 recommends repurposing an existing device, it can also recommend an alternative input mode to replace the repurposing input mode. For example, mobile device 1 can suggest a dimmer switch and simultaneously propose a better solution for a portion of the lighting system currently controlled by the dimmer switch, allowing the user to reconfigure their dimmer switch and use a different input mode for the space previously controlled by the dimmer switch.

[0063] exist Figure 1 In the embodiment of the mobile device 1 shown, the mobile device 1 includes a processor 5. In alternative embodiments, the mobile device 1 includes multiple processors. The processor 5 of the mobile device 1 may be a general-purpose processor, such as one from ARM or Qualcomm, or a dedicated processor. The processor 5 of the mobile device 1 may run an operating system such as Android or iOS. The display 9 may include, for example, an LCD or OLED display panel. The processor 5 may use, for example, a touchscreen display 9 to provide a user interface. The memory 7 may include one or more storage units. For example, the memory 7 may include solid-state memory.

[0064] For example, receiver 3 and transmitter 4 can use one or more wireless communication technologies, such as Wi-Fi (IEEE 802.11) for communicating with wireless LAN access point 17. In alternative embodiments, multiple receivers and / or multiple transmitters are used instead of a single receiver and a single transmitter. Figure 1In the illustrated embodiment, a separate receiver and a separate transmitter are used. In an alternative embodiment, receiver 3 and transmitter 4 are combined into a transceiver. The mobile device 1 may include other components typical of mobile devices, such as a battery and power connector. The invention can be implemented using a computer program running on one or more processors. Figure 1 In one embodiment, lighting devices 31-34 are controlled by mobile device 1 via bridge 16. In an alternative embodiment, one or more of lighting devices 31-34 are controlled by mobile device 1 without a bridge, for example, via Internet server 13 and wireless LAN access point 17 or directly via Bluetooth. For example, lighting devices 31-34 may be able to receive and transmit Wi-Fi signals.

[0065] Figure 3 A second embodiment of a system for determining the suitability of an input modality for providing user commands to control at least one lighting device is shown. In this second embodiment, the system is a computer 21. Computer 21 is connected to the Internet 11 and acts as a server. Computer 21 may be operated, for example, by a lighting company. Figure 3 In one embodiment, computer 21 can control lighting devices 31-34 via wireless LAN access point 17 and bridge 16.

[0066] Computer 21 includes receiver 23, transmitter 24, processor 25, and storage device 27. Processor 25 is configured to receive signals via receiver 23 indicative of user commands for controlling lighting equipment 31 and / or 32. Figure 3 In this embodiment, the signal is received from bridge 16. User commands are provided by the user using an input modality, such as a button on one of the light control devices 36-38 or a touchscreen display of the mobile device 41.

[0067] The processor 25 is further configured to: determine an suitability rating for the input modality used in relation to the user command; determine one or more additional suitability ratings for one or more additional input modalities associated with the user command; and compare the suitability rating with one or more additional suitability ratings.

[0068] Processor 25 is also configured to output information via transmitter 24 specifying a recommended input modality associated with the user command. The recommended input modality is selected from one or more other input modalities. The recommended input modality has an additional suitability rating higher than the initial suitability rating. This information can be transmitted to mobile device 41, which then displays it on its display. Alternatively, the information can be transmitted in a different manner, such as via email, and output to a device other than the mobile device. In that case, the mobile device will not be involved.

[0069] exist Figure 3 In the illustrated embodiment of computer 21, computer 21 includes a processor 25. In alternative embodiments, computer 21 includes multiple processors. The processor 25 of computer 21 may be a general-purpose processor, such as one from Intel or AMD, or it may be a dedicated processor. The processor 25 of computer 21 may, for example, run a Windows or Unix-based operating system. Storage device 27 may include one or more memory units. Storage device 27 may include, for example, one or more hard disks and / or solid-state storage. Storage device 27 may be used to store, for example, operating systems, applications, and application data.

[0070] For example, receiver 23 and transmitter 24 can communicate with wireless LAN access point 17 using one or more wired and / or wireless communication technologies such as Ethernet and / or Wi-Fi (IEEE 802.11). In alternative embodiments, multiple receivers and / or multiple transmitters are used instead of a single receiver and a single transmitter. Figure 3 In the illustrated embodiment, a separate receiver and a separate transmitter are used. In an alternative embodiment, receiver 23 and transmitter 24 are combined into a transceiver. Computer 21 may include other typical components for a computer, such as a power connector. The invention can be implemented using a computer program running on one or more processors.

[0071] exist Figure 3 In one embodiment, computer 21 transmits data to lighting devices 31-34 via bridge 16. In an alternative embodiment, computer 21 receives data from lighting control devices 36-38 and transmits data to lighting devices 31-34 without a bridge.

[0072] A first embodiment of a method for determining the suitability of an input modality for providing user commands for controlling at least one lighting device is described in [the following text is missing]. Figure 4 As shown in the figure. This method can, for example, be derived from... Figure 1 mobile device 1 or Figure 3 The cloud computer 21 performs the operation. Step 101 includes receiving a signal indicating a user command for controlling at least one lighting device. The user command is provided by the user using an input modality.

[0073] Step 103 includes determining an suitability rating for the input modality used in relation to the user command. Step 105 includes determining one or more additional suitability ratings for one or more additional input modalities used in relation to the user command. The input modality used and one or more additional input modalities may include, for example, one or more of voice input, light switch input, and sensor input.

[0074] exist Figure 4 In the embodiment, step 103 is implemented by step 121, and step 105 is implemented by step 123. In steps 121 and 123, an suitability rating and one or more additional suitability ratings are determined based on the size of the space in which user commands are provided, the functionality of the space, and / or the complexity of user interactions associated with providing user commands using an input modality.

[0075] In addition, Figure 4 In this embodiment, in steps 121 and 123, an suitability rating and one or more additional suitability ratings are determined independently of the specific action specified in the user command. Examples of specific actions are selecting any lighting scene, selecting a specific lighting scene, turning off all lighting devices, and turning on all lighting devices.

[0076] The suitability of an input modality can be defined as a combination of factors such as ease of use (how easy it is to access a specific function), accessibility to different system features (what functions can be controlled), and relevance and fit to the context (does a particular interaction mean that it is appropriate for the context in which the interaction occurs).

[0077] A rating system can be used to determine an applicability rating. This rating system can, for example, determine the value generated by a device or combination of devices when used with a given command. For example, a device could be a mobile device running a Hue app or a tap switch. An example of a command is scrolling through a predefined scenario in a room.

[0078] Step 107 includes comparing the suitability rating determined in step 103 with one or more additional suitability ratings determined in step 123. Step 108 includes selecting a single recommended input modality from one or more additional input modalities. The additional suitability rating of the recommended input modality is higher than the suitability rating. Step 109 includes outputting information specifying the recommended input modality selected in step 108. If the suitability rating determined in step 103 is higher than all the additional suitability ratings determined in step 105, steps 108 and 109 are not performed.

[0079] Figure 5 A second embodiment of a method for determining the suitability of an input modality for providing user commands for controlling at least one lighting device is shown. Figure 4 Compared to the previous embodiment, step 103 is implemented by step 141 instead of step 121, and step 105 is implemented by step 143 instead of step 123.

[0080] In steps 141 and 143, with in Figure 4Similar to steps 121 and 123, an suitability rating and one or more additional suitability ratings are determined based on the size of the space in which user commands are provided, the functionality of the space, and / or the complexity of user interactions associated with providing user commands using input modalities.

[0081] With Figure 4 Steps 121 and 123 are different. Figure 5 In steps 141 and 143, the suitability rating and one or more additional suitability ratings are determined based on a specific action specified in the user command. Examples of specific actions are selecting any lighting scene, selecting a specific lighting scene, turning off all lighting devices, and turning on all lighting devices.

[0082] Figure 6 A third embodiment of a method for determining the suitability of an input modality for providing user commands to control at least one lighting device is shown. Figure 4 Compared to the previous embodiment, step 103 is implemented by step 161 instead of step 121, and step 105 is implemented by step 163 instead of step 123.

[0083] Steps 161 and 163 involve obtaining an applicability rating and one or more additional applicability ratings from another system. This other system may calculate the applicability rating and one or more additional applicability ratings based on an input modality used by another user in relation to the user's command. For example, the other user may have a lighting system that has a similarity to the user's lighting system exceeding a first threshold, and / or may have a space that has a similarity to the user's space exceeding a second threshold. Alternatively, the applicability rating may have been associated with parameter values ​​(e.g., "select light scene" or "living room") related to the input modality and the user command, as authorized by the administrator of the other system.

[0084] Step 161 may include transmitting information describing the input modality used and information describing the user command and / or the context associated with the user command to another system. Steps 161 and 163 may be combined into a single step in which an suitability rating and one or more additional suitability ratings are received simultaneously.

[0085] Figure 7 A fourth embodiment of a method for determining the suitability of an input modality for providing a user command for controlling at least one lighting device is shown. Step 101 includes receiving a signal indicating a user command for controlling at least one lighting device. The user command is provided by the user using an input modality.

[0086] Step 103 includes determining an suitability rating for the input modality used in relation to the user command. Step 105 includes determining one or more additional suitability ratings for one or more additional input modalities associated with the user command.

[0087] exist Figure 7 In this embodiment, step 105 is implemented by step 181. Step 181 includes determining one or more additional suitability ratings for a plurality of additional input modalities. The one or more additional suitability ratings include at least one additional suitability rating for a combination of two of the plurality of additional input modalities.

[0088] Step 107 includes comparing the suitability rating determined in step 103 with one or more additional suitability ratings determined in step 181. Step 183 includes selecting a recommended input modality or two recommended input modalities from one or more additional input modalities. The additional suitability rating of the recommended input modality or the two recommended input modalities is higher than the suitability rating.

[0089] Next, step 185 includes determining settings for one or more lighting control devices based on user commands. The one or more lighting control devices are associated with a recommended input mode or at least one of two recommended input modes selected in step 183.

[0090] exist Figure 7 In this embodiment, step 109 is implemented by step 187. Step 187 includes outputting information specifying one or more recommended input modalities selected in step 183. Step 189 is performed after step 187. Furthermore, step 101 can be repeated after step 187, thereafter the method proceeds as follows. Figure 7 Continue as shown.

[0091] Step 189 includes detecting whether one or more lighting control devices, for which the settings were determined in step 185, have been installed. If not installed, step 189 is repeated at a later time. When one or more lighting control devices are detected, step 191 is executed. Step 191 includes transmitting the settings determined in step 185 to the one or more lighting control devices for which the settings were determined.

[0092] Figure 8 A fifth embodiment of a method for determining the suitability of an input modality for providing a user command for controlling at least one lighting device is shown. This method is performed by a system. Step 101 includes receiving a signal indicating a user command for controlling at least one lighting device. The user command is provided by the user using an input modality. Step 201 is performed after step 101. Step 201 includes determining user-related weights based on user-specified preferences and / or previous user commands provided by the user.

[0093] Next, step 103 includes determining an suitability rating for the input modality used in relation to the user command, and step 105 includes determining one or more additional suitability ratings for one or more additional input modalities associated with the user command. Figure 8 In the embodiment, step 103 is implemented by step 203, and step 105 is implemented by step 205.

[0094] Step 203 includes determining a user-independent suitability rating that is universal to all users of the system and applying the user-related weights determined in step 201 to that user-independent suitability rating. Step 205 includes determining one or more additional user-independent suitability ratings that are universal to all users of the system and applying the user-related weights determined in step 201 to these one or more additional user-independent suitability ratings.

[0095] Weights can be defined as a function W(user, time), starting with a default definition common to all users and evolving differently for each user over time. A customized example might be that voice control is unacceptable for a given user, independent of how well it might work for certain interactions / commands. In different examples, the system might learn that a user could benefit from having different scene sequences in their dimming switch based on the time of day.

[0096] This value, as it evolves over time, allows for continuous optimization specific to each user. It can be used to provide customized recommendations on how to configure the system, and to suggest new input modalities and how they can enable interesting interactions.

[0097] Step 107 includes comparing the suitability rating determined in step 203 with one or more additional suitability ratings determined in step 205. Step 108 includes selecting a recommended input modality from one or more additional input modalities when the additional suitability rating of the recommended input modality is higher than the recommended input modality. Step 109 includes outputting information specifying the recommended input modality selected in step 108.

[0098] Figures 4 to 8 The embodiments differ from each other in several ways, namely, multiple steps have been added or replaced. In variations of these embodiments, only a subset of these steps have been added or replaced and / or one or more steps have been omitted. As a first example, Figures 4 to 8 Multiple examples in the embodiments, such as Figure 4 and Figure 5 The embodiments can be combined. As a second example, steps 185, 189, and 191 can be derived from... Figure 7In the embodiments, omit and / or add Figure 4 , Figure 5 , Figure 6 and Figure 8 One or more embodiments of the embodiments.

[0099] Figure 9 The diagram illustrates what can be performed as shown in the reference. Figure 4-8 A block diagram of an exemplary data processing system describing the method.

[0100] like Figure 9 As shown, the data processing system 300 may include at least one processor 302 coupled to a memory element 304 via a system bus 306. Therefore, the data processing system can store program code within the memory element 304. Furthermore, the processor 302 can execute program code accessed from the memory element 304 via the system bus 306. In one aspect, the data processing system can be implemented as a computer suitable for storing and / or executing program code. However, it should be understood that the data processing system 300 can be implemented in the form of any system including a processor and memory capable of performing the functions described herein. For example, the data processing system may be an Internet / cloud server.

[0101] Memory element 304 may include one or more physical memory devices, such as local memory 308 and one or more mass storage devices 310. Local memory may refer to random access memory or other non-persistent memory devices typically used during the actual execution of program code. Mass storage devices may be implemented as hard disk drives or other persistent data storage devices. Processing system 300 may also include one or more cache memories (not shown) that provide temporary storage for at least some program code to reduce the number of times program code must be retrieved from mass storage device 310 during execution. Processing system 300 may also be able to use memory elements of another processing system, for example, if processing system 300 is part of a cloud computing platform.

[0102] The input / output (I / O) devices, depicted as input device 312 and output device 314, may optionally be coupled to the data processing system. Examples of input devices may include, but are not limited to, a keyboard, a directional device such as a mouse, a microphone (e.g., for sound and / or speech recognition), etc. Examples of output devices may include, but are not limited to, a monitor or display, a speaker, etc. The input and / or output devices may be coupled to the data processing system directly or through an intermediary I / O controller.

[0103] In this embodiment, the input and output devices can be implemented as follows (in...) Figure 9(Illustrated with dashed lines surrounding input device 312 and output device 314) This is a combined input / output device. An example of such a combined device is a touch-sensitive display, sometimes also called a "touchscreen display" or simply a "touchscreen". In such embodiments, input to the device can be provided by movement of a physical object on or near the touchscreen display, such as, for example, a stylus or a user's finger.

[0104] Network adapter 316 can also be coupled to the data processing system, enabling it to be coupled to other systems, computer systems, remote network devices, and / or remote storage devices via an intermediary private or public network. The network adapter may include: a data receiver for receiving data transmitted to the data processing system 300 from the systems, devices, and / or networks; and a data transmitter for transmitting data from the data processing system 300 to the systems, devices, and / or networks. Modems, cable modems, and Ethernet cards are examples of different types of network adapters that can be used with the data processing system 300.

[0105] like Figure 9 As depicted, memory element 304 can store application 318. In various embodiments, application 318 may be stored in local memory 308, one or more mass storage devices 310, or separately from local memory and mass storage devices. It should be understood that data processing system 300 may further execute an operating system that facilitates the execution of application 318. Figure 9 (Not shown in the image). Application 318, implemented as executable program code, can be executed by data processing system 300, for example, by processor 302. In response to executing the application, data processing system 300 can be configured to perform one or more operational or method steps described herein.

[0106] Various embodiments of the present invention can be implemented as a program product for use with a computer system, wherein the program(s) of the program product define the functionality of the embodiments (including the methods described herein). In one embodiment, the program(s) may be contained on a variety of non-transitory computer-readable storage media, wherein, as used herein, the expression “non-transitory computer-readable storage media” includes all computer-readable media, with the sole exception being transient propagation signals. In another embodiment, the program(s) may be contained on a variety of transient computer-readable storage media. Illustrative computer-readable storage media include, but are not limited to: (i) non-writable storage media (e.g., read-only memory devices within a computer, such as CD-ROM discs readable by a CD-ROM drive, ROM chips, or any type of solid-state non-volatile semiconductor memory) on which information is permanently stored; and (ii) writable storage media (e.g., flash memory, floppy disks or hard disk drives within a floppy disk drive, or any type of solid-state random access semiconductor memory) on which variable information is stored. The computer program may run on the processor 302 described herein.

[0107] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the invention. As used herein, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprising” and / or “including” as used in this specification define the presence of the described features, integrals, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components, and / or groups thereof.

[0108] The corresponding structures, materials, actions, and equivalents of all components or steps plus functional elements in the following claims are intended to include any structure, material, or action that performs the function in combination with other claimed elements as specifically claimed. The description of embodiments of the invention has been presented for illustrative purposes but is not intended to be exhaustive or limited to implementations of the disclosed forms. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the invention. Embodiments have been chosen and described to best explain the principles of the invention and some practical applications, and to enable others skilled in the art to understand the various embodiments of the invention and various modifications suitable for the particular uses contemplated.

Claims

1. A system (1, 21) for determining the suitability of an input modality of a first input type for providing user commands for controlling at least one lighting device (31, 32), the system (1, 21) comprising: At least one receiver (3, 23); At least one output interface (4, 9, 24); as well as At least one processor (5, 25) is configured to: - A signal indicating a user command for controlling the at least one lighting device (31, 32) is received via the at least one receiver (3, 23), the user command being provided by the user using an input modality of the first input type. - Determine the suitability rating of the input modality of the first input type used in relation to the user command. - Determine one or more additional suitability ratings for one or more additional input modalities related to the user command. - Compare the suitability rating with one or more other suitability ratings, and - Output information via the at least one output interface (4, 9, 24) specifying an input modality for a recommended second input type associated with the user command, the recommended second input type being selected from the one or more other input modalities, the other suitability rating of the recommended second input type being higher than the suitability rating.

2. The system (1, 21) of claim 1, wherein the at least one processor (5, 25) is configured to: determine, independently of a specific action specified in the user command, the suitability rating of the input modality of the first input type used in relation to the user command.

3. The system (1, 21) of claim 1, wherein the at least one processor (5, 25) is configured to: determine the suitability rating of the input modality of the first input type used in relation to the user command based on a specific action specified in the user command.

4. The system (1, 21) as claimed in claim 2 or 3, wherein the specific action includes selecting any light scene, selecting a specific light scene, turning off all lighting devices (31, 32), or turning on all lighting devices (31, 32).

5. The system (1, 21) of claim 1, wherein the at least one processor (5, 25) is configured to: determine the suitability rating and the one or more additional suitability ratings based on the size of the space (63, 64, 65) in which the user command is provided, the functionality of the space (63, 64, 65), and / or the complexity of the user interaction associated with providing the user command using the input modality of the first input type.

6. The system (1, 21) of claim 1, wherein the at least one processor (5, 25) is configured to determine the suitability rating and the one or more additional suitability ratings by obtaining the suitability rating and the one or more additional suitability ratings from another system (13).

7. The system (1, 21) of claim 1, wherein the suitability rating and the one or more additional suitability ratings are calculated based on input modalities used by other users in relation to the user command.

8. The system (1, 21) of claim 7, wherein the other user has a lighting system that is more similar to the user's lighting system than a first threshold, and / or has a space that is more similar to the user's space (63, 64, 65) than a second threshold.

9. The system (1, 21) of claim 1, wherein the at least one processor (5, 25) is configured to: determine settings for a lighting control device (19) based on the user command, the lighting control device (19) being associated with an input mode of the recommended second input type; and transmit the settings to the lighting control device (19) via the at least one output interface (4, 9, 24).

10. The system of claim 1 (1, 21), wherein the information further specifies additional recommended input modalities associated with the user command, the additional recommended input modalities being selected from the one or more additional input modalities, and the combination of the recommended second input type input modalities and the additional recommended input modalities having an additional suitability rating higher than the suitability rating.

11. The system (1, 21) of claim 1, wherein the input modality of the first input type used and the one or more additional input modalities include one or more of voice input, light switch input and sensor input.

12. The system (1, 21) of claim 1, wherein the at least one processor (5, 25) is configured to: determine the suitability rating of the input modality of the first input type used in relation to the user command by determining a user-independent suitability rating that is general to all users of the system (1, 21) and applying user-related weights to the user-independent suitability rating.

13. The system (1, 21) of claim 12, wherein the at least one processor (5, 25) is configured to determine the user-related weights based on user-specified preferences and / or previous user commands provided by the user.

14. A method for determining the suitability of an input modality for providing a user command for controlling at least one lighting device, the method comprising: - Receive (101) a signal indicating a user command for controlling the at least one lighting device, the user command being provided by a user using an input modality of the first input type; - Determine (103) the suitability rating of the input modality of the first input type used in relation to the user command; - Determine (105) one or more additional suitability ratings for one or more additional input modalities associated with the user command; - Compare the suitability rating described in (107) with one or more other suitability ratings; as well as - Output (109) specifies information about a recommended second input type input modality associated with the user command, the recommended second input type input modality being selected from the one or more other input modalities, the other suitability rating of the recommended second input type input modality being higher than the suitability rating.

15. A computer program product for a computing device, the computer program product comprising computer program code for performing the method of claim 14 when the computer program product is run on a processing unit of the computing device.

Images