A method for selecting control mode during commissioning of lighting control system

Abstract

A method for selecting a control mode of a user device (4) for use in commissioning a lighting control system (2), the method comprising: a) determining (101), by a detector (24), a head orientation of a user (3) of a lighting control system commissioning program, b) determining (102), by a processor (26) of the user device (4), whether the user (3) is focused on a user interface (28) of the user device (4) based on the determined head orientation, c) if it is determined that the user (3) is focused on the user interface (28), automatically switching (103), by the processor (26), the lighting control system debug program to a first control mode (11) in which feedback from the lighting control system debug program and control of the lighting control system debug program are at least one of graphical and visual, and if it is determined that the user (3) is focused on the user interface (28), automatically switching (103) the lighting control system debug program to a second control mode (11) in which feedback from the lighting control system debug program and control of the lighting control system debug program. D) if it is determined that the user (3) is not focused on the user interface (28), automatically switching (104), by the processor (26), the lighting control system debug program to a second control mode (12) in which feedback from the lighting control system debug program and control of the lighting control system debug program are based on at least one of audio and haptic, and e) continuously repeating (105) steps a) to d) while using the lighting control system debug program.

Description

Technical Field

[0001] The present invention relates to a method for selecting a control mode of a user device used in debugging a lighting control system, wherein the user device is configured to run a lighting control system debugging program, wherein the user device includes a user interface configured to present the lighting control system debugging program, and wherein during the debugging, a user of the lighting control system debugging program switches between focusing on one or more lighting components of the lighting control system and focusing on the user interface presenting the lighting control system debugging program. Background Art

[0002] During the commissioning of a lighting control system, a commissioning engineer needs to change his / her focus between a mobile lighting control system commissioning program and lighting components in the room, such as checking whether a specific light is on or off. Furthermore, one of the fundamental steps in the lighting system commissioning process is to locate and map the installed lighting components. Therefore, the engineer must switch the focus between the commissioning program and the lighting components very frequently. This switching reduces the efficiency of the commissioning process due to the large number of devices to be handled.

[0003] US10512143 B1 discloses a lighting control system, which is provided to reduce time, cost and potential errors during device commissioning. The controller is programmed to obtain a voice command from a user, and to identify and implement a device commissioning mode based at least on the obtained voice command. In a first commissioning mode, the controller configures one or more buttons or equivalent actuators on a control switch installed in association with a lighting area. In a second commissioning mode, the controller assigns device grouping and / or configuration data to a plurality of lighting devices (e.g., lighting fixtures, occupancy sensors, light sensors) operably connected to the control switch. The controller may also identify one or more second lighting devices added to one or more of a plurality of first lighting devices, or one or more second lighting devices exchanged with one or more of a plurality of first lighting devices, in another commissioning mode, and assign device grouping and / or configuration data thereto.

[0004] US10512132B discloses a lighting control system for device debugging, the system having a controller programmed to obtain a voice command from a user and recognize and implement a device debugging mode based on the obtained voice command. In a first debugging mode, the controller configures one or more buttons or equivalent actuators on a control switch installed in association with a lighting area.

[0005] Therefore, it is desirable to provide a device and method of the type mentioned by way of introduction, by means of which switching can be reduced and the efficiency of the debugging process can be improved.

[0006] It would also be desirable to provide an apparatus and method by which focus switching by an engineer or user can be reduced and by which the apparatus and method can further ensure that audio-based feedback is given to the engineer or user more sparsely and in particular only when strictly necessary, which feedback might otherwise be annoying. Summary of the invention

[0007] The object of the present invention is to overcome this problem and to provide a device and a method of the type mentioned by way of introduction, with which the switching can be reduced and the efficiency of the debugging process can be increased.

[0008] A further object of the present invention is to provide such a device and such a method by means of which focus switching of an engineer or user can be reduced and by means of which it can further be ensured that audio-based feedback is given to the engineer or user more sparsely and in particular only when strictly necessary.

[0009] According to a first aspect of the present invention, this object and other objects are achieved by means of a method for selecting a control mode of a user device used in debugging a lighting control system, wherein the user device includes a memory unit configured to store a lighting control system debugging program, a processor configured to run the lighting control system debugging program, and a user interface configured to present the lighting control system debugging program, and wherein during the debugging, a user of the lighting control system debugging program switches between focusing on one or more lighting components of the lighting control system and presenting the user interface of the lighting control system debugging program, and wherein the method includes:

[0010] a) determining, by a detector, the orientation of the head of a user commissioning the lighting control system,

[0011] b) determining, by the processor, whether the user is focusing on the user interface based on the determined head orientation,

[0012] c) if it is determined that the user is focusing on the user interface, the processor automatically switches the lighting control system debugging program to a first control mode, in which the feedback from the lighting control system debugging program and the control of the lighting control system debugging program are at least one of graphical and visual,

[0013] d) if it is determined that the user is not focusing on the user interface, automatically switching the lighting control system debugging program to a second control mode by the processor, in which feedback from the lighting control system debugging program and control of the lighting control system debugging program are based on at least one of audio and tactile, and

[0014] e) Repeat steps a) to d) (continuously) while using the lighting control system commissioning program.

[0015] Therefore, and in particular by virtue of steps b), c), d) and e) above, a method is provided by which it is possible to ensure that audio-based feedback to an engineer or user (which might otherwise be annoying) is given more sparsely and in particular when the user's focus is away from the user device and is therefore only given when strictly necessary.

[0016] In particular by virtue of steps c), d) and e) above, this also reduces focus switching for engineers or users, as it ensures that feedback can be given to the user and the user can provide input to the user device regardless of whether the user's focus is on the user device.

[0017] The lighting control system commissioning program is configured to commission a lighting control system including one or more lighting components.

[0018] Therefore, a method of the type mentioned is provided by means of which the efficiency of the debugging process is increased.

[0019] In one embodiment, switching the lighting control system commissioning program to the first control mode includes switching the lighting control system commissioning program to continuously search for input or only accept input based on at least one of touch, button click, and keyboard typing.

[0020] Therefore ensuring that all relevant inputs are captured and registered while the first control mode is active. This in turn further reduces focus switching for the user and ensures that audio-based feedback can be avoided while the first control mode is active.

[0021] In one embodiment, the first control mode is a graphical interface mode.

[0022] Hereby it is ensured in a particularly simple manner that when the user's focus is on the user device, feedback can be given to the user and the user can provide input to the user device, which in turn further reduces focus switching of the user.

[0023] In one embodiment, the second control mode is an audio control mode, a voice control mode, a vibration control mode, or any combination thereof.

[0024] Thus, when the user's focus is not on the user device, but for example on an optical component in the room, it is ensured in a particularly simple manner that feedback is given to the user and the user can provide input to the user device. This in turn further reduces focus switching for the user and ensures that audio-based feedback can only be given when the second control mode is active. Furthermore, if the debugger only reacts to voice commands in the second control mode, this also reduces the chances of unintentional voice commands in the first control mode, since in the first control mode the debugger does not react to voice commands.

[0025] In one embodiment, switching the lighting control system commissioning program to the second control mode includes switching the lighting control system commissioning program to continuously search for input or to only accept input based on at least one of voice and sound received via the acoustic detector.

[0026] Thus, it is ensured that all relevant inputs are captured and registered while the second control mode is active, which in turn further reduces focus switching for the user.

[0027] In one embodiment, determining the orientation of the head of the user commissioning the lighting control system comprises using a detection method selected from the group consisting of face recognition, gaze detection, and eye detection.

[0028] These methods have proven to be particularly accurate and effective for determining the orientation of the device user's head.

[0029] In one embodiment, switching the lighting control system commissioning program to the first control mode includes controlling the user interface to display one or more of screen buttons and input areas suitable for providing input based on at least one of touch, button click, and keyboard typing.

[0030] In an alternative or additional embodiment, switching the lighting control system commissioning program to the first control mode includes activating one or more of screen buttons and input areas adapted to provide input based on at least one of touch, button click, and keyboard entry.

[0031] Thus, it is ensured in a particularly simple manner that the user can provide input to the user device when the user's focus is on the user device, which in turn further reduces focus switching for the user.

[0032] In one embodiment, switching the lighting control system commissioning program to the second control mode includes controlling the lighting control system commissioning program to analyze voices and sounds received via the acoustic detector.

[0033] Thus, it is ensured in a particularly simple manner that the user can provide input to the user device when the user's focus is not on the user device, but on, for example, an optical component in the room. This in turn further reduces the user's focus switching.

[0034] In one embodiment, the method further comprises, depending on one or more activities related to the commissioning steps to be performed during the commissioning of the lighting control system, performing at least one of switching the lighting control system commissioning program to the first control mode and switching the lighting control system commissioning program to the second control mode. The detection of the activity may be accomplished via a sensor (such as a camera) or via a predefined set of activities.

[0035] It can thus be ensured that the lighting system commissioning program is switched to a mode in which one or more activities can be performed or can even be performed in the most efficient manner.

[0036] In one embodiment, the method further comprises, for a predetermined subset of one or more activities to be performed during commissioning of the lighting control system, switching the lighting control system commissioning program to the first control mode only.

[0037] Hereby it is ensured that for activities which are not suitable to be performed via voice control, the lighting control system commissioning program always switches to the first control mode using user interface control.

[0038] In one embodiment, the lighting control system commissioning program is an application program.

[0039] The present invention also relates to a system for debugging a lighting control system, which system for debugging a lighting control system comprises a user interface, a detector configured to determine the orientation of the head of a user of the lighting control system, a data storage device comprising instructions and a data processing device configured to perform the method according to the present invention when executing the instructions.

[0040] In one embodiment, the detector is configured to perform a detection method selected from the group consisting of face recognition, gaze detection and eye detection.

[0041] The present invention also relates to a system comprising i) a lighting control system comprising one or more lighting components, and ii) a system for debugging the lighting control system, the system for debugging the lighting control system comprising a user interface, a detector configured to determine the direction of the head of a user of the lighting control system, a data storage device comprising instructions and a data processing device configured to perform the method according to the present invention when executing the instructions. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] This and other aspects of the present invention will now be described in more detail, with reference to the appended drawings showing embodiment(s) of the invention.

[0043] Figure 1 A schematic diagram of a system for debugging a lighting control system according to the present invention is shown.

[0044] Figure 2 A schematic diagram showing a user equipment of the system according to the present invention is shown.

[0045] Figure 3 A block diagram illustrating an embodiment of a method according to the present invention for selecting a control mode during commissioning of a lighting control system is shown.

[0046] Figure 4A schematic diagram showing a user interaction with a system according to the present invention is shown, graphically illustrating first and second control modes of a user device of the system according to the present invention.

[0047] Figures 5 to 7 A schematic diagram showing three different exemplary screen images shown by a user interface of a user device according to the present invention presents a lighting control system commissioning procedure of the system.

[0048] As illustrated in the figures, the sizes of layers and regions are exaggerated for illustrative purposes and, therefore, are provided to illustrate the general structure of embodiments of the present invention. Like reference numerals refer to like elements throughout. DETAILED DESCRIPTION

[0049] The present invention will now be described more fully hereinafter with reference to the accompanying drawings, in which currently preferred embodiments of the present invention are shown. However, the present invention may be embodied in many different forms and should not be construed as limited to the embodiments described herein; on the contrary, these embodiments are provided for thoroughness and completeness and to fully convey the scope of the present invention to those skilled in the art.

[0050] Figure 1 A schematic diagram of a system 1 for debugging a lighting control system 2 according to the present invention is shown. The system 1 comprises a user device 4, which is configured to run a lighting control system debugging program. Figure 2 An exemplary user device 4 is schematically shown above. The user device 4 is a mobile device. For example, the user device 4 may be a mobile phone, a tablet computer, or a laptop computer. The lighting control system debugging program may be an application 30 configured to run on the user device 4 (see Figure 4 and Figure 5-7 ).

[0051] Specific reference Figure 2 , the user device 4 includes a data processing device or processor 26. The processor 26 is configured to run the lighting control system debugging program. The user device 4 also includes a data storage or memory 27 on which the lighting control system debugging program is stored. The memory 27 also includes instructions for running the lighting control system debugging program. The processor 26 is configured to execute these instructions.

[0052] The user device 4 also includes a user interface 28, which is configured to present a lighting control system commissioning program. The user interface 28 may include various input components configured to receive input from the user 3 and various output components configured to provide output or feedback to the user 3. The input components may include one or more of a touch screen 20, a button 21, a mouse 29 or similar device, and a microphone 23 for capturing voice and other sounds. The output components may include one or more of a display such as a touch screen 20, a speaker 22, and a haptic unit 25.

[0053] The user device 4 also includes a detector 24. The detector 24 is configured to determine or detect the orientation of the head of the user 3 debugging the system 1. The detector 24 can be configured to perform one or more detection methods of face recognition, gaze detection and eye detection. The detector 24 can be a camera, for example. Additionally, the detector 24 can be configured to determine or detect the eye focus, focus or viewing direction of the user 3.

[0054] like Figure 4 As shown above, during the commissioning of the lighting control system 2, the user 3 or the commissioning engineer focuses on one or more of the lighting components 6, 7, 8 of the lighting control system 2 and focuses on the user interface 28 ( Figure 2 ). In other words, the user 3 will change the head orientation 9, 10 between the user device 4 with the lighting control system commissioning program (the orientation of the head 9) and the array 5 of lighting components 6, 7, 8 of the lighting control system 2 to be commissioned (the orientation of the head 10). The lighting control system commissioning program is usually used to help the user 3, for example, to check whether a specific lighting component 6, 7, 8 is turned on or off, and to locate and map the installed lighting components 6, 7, 8. Typically, the lighting components 6, 7, 8 are lamps or luminaires.

[0055] The user device 4 is configured to perform a method by executing instructions stored in the memory 27 using the data processing device 26, and will now be referred to Figure 3 and Figure 4 Describe the method.

[0056] First reference Figure 3 , the method generally and independently of the embodiment comprises the following steps.

[0057] First, in step 101, the orientation 9, 10 of the head of a user 3 commissioning a lighting control system program is determined.

[0058] Next, in step 102 , it is determined based on the determined orientation 9 , 10 of the head whether the user 3 is focusing on the user interface 28 of the user device 4 .

[0059] If the orientation of the head of the user 3 is determined 9 (see Figure 4 ) on the user interface 28, the method continues to step 103, in which the lighting control system debugging program automatically switches to the first control mode 11. In the first control mode 11, the feedback from the user device 4 and the lighting control system debugging program is at least one of a graphic and a visual. The control of the lighting control system debugging program is also at least one of a graphic and a visual.

[0060] If the orientation 10 of the head of the user 3 is determined (see Figure 4 ) is not on the user interface 28, but on the lighting assembly 5, 6, 7, 8, or for that matter somewhere else, such as on the ceiling 13 or wall 14 of the room 15 ( Figure 1 ), the method continues to step 104. In step 104, the lighting control system debugging program automatically switches to the second control mode 12. In the second control mode 12, the feedback from the user device 4 and the lighting control system debugging program is based on at least one of audio and tactile. In the second control mode 12, the control of the lighting control system debugging program is based on audio.

[0061] Finally, when using the lighting control system commissioning program, the method comprises step 105, in which steps 101 to 104 are continuously repeated. It is thus ensured that the lighting control system commissioning program is always in the mode of the two control modes 11 and 12 that is most suitable for the current conditions. The use of audio-based feedback can thus be reduced.

[0062] Step 101 may be performed using the detector 24. Step 101 may be performed using a detection method selected from the group consisting of face recognition, gaze detection, and eye detection.

[0063] Steps 102 , 103 , and 104 may be performed using processor 26 .

[0064] Step 103 may include switching the lighting control system debugger to continuously search for input or only accept input based on at least one of touch, button click, and keyboard typing. Therefore, the first control mode 11 may be a mode in which the lighting control system debugger searches for or only accepts input based on at least one of touch, button click, and keyboard typing. The first control mode 11 is a graphical interface mode. Therefore, step 103 may include controlling the user interface 28 of the user device 4 to display one or more of the screen buttons and input areas suitable for providing input based on at least one of touch, button click, and keyboard typing. Additionally or alternatively, step 103 may include activating one or more of the screen buttons and input areas suitable for providing input based on at least one of touch, button click, and keyboard typing.

[0065] Step 104 may include switching the lighting control system debugging program to continuously search for input or only accept input based on at least one of voice and sound received via the acoustic detector. Therefore, the second control mode 12 may be a mode in which the lighting control system debugging program searches for or only accepts input based on at least one of voice and sound received via the acoustic detector. The second control mode 12 is an audio control mode, a voice control mode, a vibration control mode, or any combination thereof. Therefore, step 104 may include controlling the lighting control system debugging program to analyze voice and sound received via an acoustic detector (such as microphone 23). Step 104 may also include activating an acoustic detector (such as microphone 23) to prepare to detect and receive sound.

[0066] Table 1 below lists several non-limiting debugging steps that can be performed via at least one of user interface control (first control mode 11) or voice control (second control mode 12). A check mark in a control mode column indicates that the activity can be performed in the corresponding control mode.

[0067] Table 1

[0068]

[0069]

[0070] Example

[0071] The following will refer to Figure 5-7 An example is described. In this example, the task of the user 3 or commissioning engineer is to locate all lights in a room.

[0072] When the user 3 focuses on the user interface 28, the lighting control system debugging program running on the user device 4 will be in the first control mode 11. Then, the user device 4 will display the following on the user interface 28: Figure 5 The screen shown in .

[0073] If the lighting control system commissioning program, and therefore the user device 4, now detects that the user 3 has shifted his or her focus away from the user interface 28, the lighting control system commissioning program running on the user device 4 will shift to the second control mode 12. The lighting control system commissioning program running on the user device 4 may now use voice to speak to the user 3. For example, the lighting control system commissioning program, and therefore the user device 4, may ask the user 3: "Do you want to start discovering the lights in room 1?" The user 3 may then be provided with a limited amount of time (such as, for example, 5 seconds) to answer (typically verbally) "yes" or "no".

[0074] If the user answers "yes", the lighting control system commissioning program running on the user device 4 starts device discovery via voice (second control mode 12) or via button press (first control mode 11). The user device 4 will then display a message on the user interface 28 as shown below: Figure 6 The user device 4 may also flash a light or illuminator 6, 7, 8. Another light may be flashed with a predetermined time interval such as, for example, two seconds.

[0075] During the device discovery process, the orientation 9 or 10 of the user's 3 head is continuously determined.

[0076] If the determination reveals that the user 3 is focused on the user interface 28 or screen, the first control mode 11 is active, voice is not used and the user 3 may provide input by pressing a button 21 provided on the user interface 28 or displayed on the touch screen 20 .

[0077] If the determination reveals that the user 3 is not focused on the user interface 28 or screen, the second control mode 12 is active. The lighting control system debugger running on the user device 4 can use voice to control the device discovery process, such as by asking the user 3: "When the light in room 1 is flashing, please say stop." Whenever another light starts to flash, the lighting control system debugger will cause the user device 4 to use the tactile unit 25 to briefly emit a beep or vibrate so that the user 3 knows that the next light is now flashing. Based on a predetermined signal from the user 3, such as when the user 3 says "stop", the flashing light is added to the room configuration. The lighting control system debugger running on the user device 4 can then use voice to notify the user that the light has been added, for example by telling the user 3: "Light #3 has been added to room 1, do you want to add more lights to this room?" This is displayed as Figure 7 The user 3 may then again be provided with a limited amount of time (such as, for example, 5 seconds) to answer (typically verbally) "yes" or "no".

[0078] Those skilled in the art realize that the present invention is by no means limited to the preferred embodiments described above. On the contrary, many modifications and variations are possible within the scope of the appended claims.

[0079] Additionally, variations to the disclosed embodiments may be understood and effected by those skilled in the art in practicing the claimed invention, based on a study of the drawings, the present disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other elements or steps, and the indefinite article "a" or "an" does not exclude a plurality.

Claims

1. A method for selecting a control mode of a user device (4) used in commissioning a lighting control system (2), The user device (4) comprises a memory unit (27) configured to store a lighting control system debugging program, a processor (26) configured to run the lighting control system debugging program, and a user interface (28) configured to present the lighting system debugging program, wherein the lighting control system debugging program is configured to debug a lighting control system (2) comprising one or more lighting components (5, 6, 7, 8). wherein a user (3) of the lighting control system debugging program switches during the debugging between focusing on one or more lighting components (5, 6, 7, 8) of the lighting control system and focusing on the user interface (28) presenting the lighting control system debugging program, The method comprises: a) determining, by a detector, the orientation of the head of a user of the lighting control system commissioning program (101), b) determining (102), by the processor, based on the determined head orientation, whether the user is focusing on the user interface, c) if it is determined that the user is focusing on the user interface, the processor automatically switches (103) the lighting control system debugging program to a first control mode (11), in which feedback from the lighting control system debugging program and control of the lighting control system debugging program are at least one of graphical and visual, d) if it is determined that the user is not focusing on the user interface, automatically switching (104) the lighting control system debugging program to a second control mode (12) by the processor, in which feedback from and control of the lighting control system debugging program is based on at least one of audio and tactile, and e) Repeating (105) steps a) to d) while using the lighting control system commissioning program.

2. The method of claim 1, wherein switching (103) the lighting control system debugger to the first control mode (11) comprises switching the lighting control system debugger to continuously search for input or only accept input based on at least one of touch, button click, and keyboard typing.

3. Method according to any of the preceding claims, wherein the first control mode (11) is a graphical interface mode.

4. The method according to any of the preceding claims, wherein the second control mode (12) is an audio control mode, a voice control mode, a vibration control mode or any combination thereof.

5. The method of any one of the preceding claims, wherein switching (104) the lighting control system commissioning program to the second control mode (12) comprises switching the lighting control system commissioning program to continuously search for input or to only accept input based on at least one of voice and sound received via an acoustic detector.

6. A method according to any of the preceding claims, wherein determining (101) the orientation of the head of a user (3) of a lighting control system commissioning program comprises using a detection method selected from the group consisting of face recognition, gaze detection and eye detection.

7. The method according to any of the preceding claims, wherein switching (103) the lighting control system commissioning program to the first control mode (11) comprises one or more of the following: controlling the user interface (28) to display one or more of screen buttons and input areas suitable for providing input based on at least one of touch, button click, and keyboard typing, and One or more of screen buttons and input areas suitable for providing input are activated based on at least one of touch, button click, and keyboard typing.

8. The method according to any of the preceding claims, wherein switching (104) the lighting control system commissioning program to the second control mode (12) comprises controlling the lighting control system commissioning program to analyze voices and sounds received via an acoustic detector.

9. A method according to any of the preceding claims, and further comprising, depending on one or more activities related to debugging steps to be performed during debugging of the lighting control system (2), performing at least one of switching (103) the lighting control system debugging program to the first control mode (11) and switching (103) the lighting control system debugging program to the second control mode (12).

10. The method according to claim 9, and further comprising, for a predetermined subset of one or more activities to be performed during commissioning of a lighting control system (2), only switching the lighting control system commissioning program to the first control mode.

11. The method according to any of the preceding claims, wherein the lighting control system commissioning program is an application program (30).

12. A system (1) for debugging a lighting control system (2), comprising: User interface (28), a detector (24) configured to determine the orientation of a head of a user (3) of a lighting control system (2) comprising one or more lighting assemblies (5, 6, 7, 8), a data memory (27) including instructions, and A data processing device (26) configured to perform a method according to any one of the preceding claims when executing the instructions.

13. The system of claim 12, wherein the detector (24) is configured to perform a detection method selected from the group consisting of face recognition, gaze detection, and eye detection.

14. A system comprising: A lighting control system (2) comprising one or more lighting components (5, 6, 7, 8), and System (1) for commissioning a lighting control system according to any one of claims 12 and 13.

15. The system of claim 14, wherein the one or more lighting assemblies (5, 6, 7, 8) comprise luminaires.

Images