Method for Selecting a Control Mode during Commissioning of a Lighting Control System

Abstract

A method for selecting a control mode of a user device (4) used when commissioning an illumination control system (2), the method comprising: a) determining (101) the orientation of the head of a user (3) of an illumination control system commissioning program by means of a detector (24); b) determining (102) by means of a processor (26) whether the user (3) is focusing on a user interface (28) of the user device (4) based on the determined orientation of the head; c) if it is determined that the user (3) is focusing on the user interface (28), automatically switching (103) by means of the processor (26) the illumination control system commissioning program to a first control mode (11) in which feedback from the illumination control system commissioning program and control of the illumination control system commissioning program are at least one of graphical and visual; d) if it is determined that the user (3) is not focusing on the user interface (28), automatically switching (104) by means of the processor (26) the illumination control system commissioning program to a second control mode (12) in which feedback from the illumination control system commissioning program and control of the illumination control system commissioning program are at least one of audio-based and haptic; and e) continuously repeating (105) steps a) to d) while the illumination control system commissioning program is being used.

Description

Technical Field

[0001] The present invention relates to a method for selecting a control mode of a user device used when commissioning an illumination control system, wherein the user device is configured to execute an illumination control system commissioning program, the user device includes a user interface configured to present the illumination control system commissioning program, and during the commissioning, a user of the illumination control system commissioning program switches between focusing on one or more illumination components of the illumination control system and focusing on the user interface presenting the illumination control system commissioning program.

Background Art

[0002] During the commissioning of an illumination control system, a commissioning engineer needs to change the focus between a mobile illumination control system commissioning program and indoor illumination components, for example, to check whether a specific lamp is on or off. Also, one of the essential steps in the commissioning process of an illumination system is to locate and map the installed illumination components. Therefore, the engineer has to switch the focus between the commissioning program and the illumination components very frequently. Due to the large number of devices to be processed, the switching reduces the efficiency of the commissioning process.

[0003] US10,512,143B1 discloses a lighting control system provided to reduce time, cost, and error possibilities during device commissioning. The controller is programmed to obtain voice commands from a user and identify and implement a device commissioning mode based at least on the obtained voice commands. In a first commissioning mode, the controller configures one or more buttons or equivalent actuators on a control switch attached in relation to a lighting zone. In a second commissioning mode, the controller assigns device grouping and / or configuration data to a plurality of lighting devices (e.g., lighting fixtures, occupancy sensors, light sensors) operably connected to the control switch. The controller further, in another commissioning mode, may identify one or more second lighting devices added to or replaced with one or more of the plurality of first lighting devices and assign device grouping and / or configuration data thereto.

[0004] US10512132B discloses a lighting control system for device commissioning comprising a controller programmed to obtain voice commands from a user and identify and implement a device commissioning mode based on the obtained voice commands. In a first commissioning mode, the controller configures one or more buttons or equivalent actuators on a control switch attached in relation to a lighting zone.

[0005] There is a desire to provide a device and method of the type described at the beginning, whereby switching is reduced and the efficiency of the commissioning process is increased.

[0006] Engineer or user focus switching can be reduced, and furthermore, it can be guaranteed that audio-based feedback to the engineer or user (which could otherwise be annoying) is provided more sparsely, particularly only when strictly necessary. There is a further desire to provide such devices and methods.

Summary of the Invention

Problems to be Solved by the Invention

[0007] The object of the present invention is to overcome this problem and provide a device and method of the type described at the beginning, in which switching is reduced and the efficiency of the commissioning process is increased.

[0008] A further object of the present invention is to provide such a device and such a method in which engineer or user focus switching can be reduced, and furthermore, it can be guaranteed that audio-based feedback to the engineer or user is provided more sparsely, particularly only when strictly necessary.

Means for Solving the Problems

[0009] According to a first aspect of the present invention, this and other objects are achieved by a method for selecting a control mode of a user device used when commissioning a lighting control system, the user device including a memory unit configured to store a lighting control system commissioning program, a processor configured to execute the lighting control system commissioning program, and a user interface configured to present the lighting control system commissioning program, and during the commissioning, a user of the lighting control system commissioning program switches between focusing on one or more lighting components of the lighting control system and focusing on the user interface presenting the lighting control system commissioning program, and the method comprises a) Determining, by a detector, the orientation of the head of a user of an illumination control system commissioning program; b) Judging, by a processor, whether the user is focusing on a user interface based on the determined orientation of the head; c) Automatically switching, by the processor, the illumination control system commissioning program to a first control mode in which feedback from the illumination control system commissioning program and control of the illumination control system commissioning program are at least one of graphical and visual, if it is judged that the user is focusing on the user interface; d) Automatically switching, by the processor, the illumination control system commissioning program to a second control mode in which feedback from the illumination control system commissioning program and control of the illumination control system commissioning program are at least one of audio based and haptic, if it is judged that the user is not focusing on the user interface; e) Repeating steps a) to d) continuously while the illumination control system commissioning program is being used; is achieved by a method comprising.

[0010] Thereby, especially thanks to steps b), c), d) and e) above, it is ensured that audio-based feedback to the engineer or user (which might otherwise be annoying) is sparser and is given only when strictly necessary, especially when the user's focus is away from the user device, thus providing a method.

[0011] In particular, thanks to steps c), d), and e) above, this also ensures that feedback can be provided to the user and the user can provide input to the user device regardless of whether the user's focus is directed towards the user device, thus also reducing the switching of the engineer's or user's focus.

[0012] A lighting control system commissioning program is configured to commission a lighting control system including one or more lighting components.

[0013] This provides a method of the type described at the beginning that increases the efficiency of the commissioning process.

[0014] In one embodiment, switching the lighting control system commissioning program to a first control mode includes switching the lighting control system commissioning program to continuously search for or accept only inputs based on at least one of touch, button clicks, and keyboard typing.

[0015] This ensures that all relevant inputs are captured and registered while the first control mode is active. Consequently, this further reduces the switching of the user's focus and ensures that audio-based feedback can be avoided while the first control mode is active.

[0016] In one embodiment, the first control mode is a graphical interface mode.

[0017] This ensures that, especially in a simple manner, feedback can be provided to the user and the user can provide input to the user device when the user's focus is directed towards the user device, thus further reducing the switching of the user's focus.

[0018] In one embodiment, the second control mode is an audio-controlled mode, a speech-controlled mode, a vibration-controlled mode, or any combination thereof.

[0019] This ensures that, in a particularly simple manner, feedback can be provided to the user and the user can provide input to the user device when the user's focus is directed not at the user device but, for example, at indoor optical components. As a result, this further reduces the switching of the user's focus and ensures that only audio-based feedback can be provided while the second control mode is active. Further, if the commissioning program responds to voice commands only in the second control mode, this also reduces the likelihood of unintentional voice commands in the first control mode, as the commissioning program does not respond to voice commands in the first control mode.

[0020] In one embodiment, switching the lighting control system commissioning program to the second control mode involves switching the lighting control system commissioning program to continuously search for or accept only input based on at least one of speech and sound received via an acoustic detector.

[0021] This ensures that all relevant inputs are captured and registered while the second control mode is active, thereby further reducing the switching of the user's focus.

[0022] In one embodiment, determining the orientation of the user's head of the lighting control system commissioning program includes using a detection method selected from the group including face recognition, stare detection, and eye detection.

[0023] These are methods that have proven to be particularly accurate and efficient for determining the orientation of the user's head of the device.

[0024] In one embodiment, switching the lighting control system commissioning program to the first control mode includes controlling the user interface to show one or more of the screen buttons and input fields appropriate for providing an input based on at least one of touch, button click, and keyboard typing.

[0025] In an alternative or additional embodiment, switching the lighting control system commissioning program to the first control mode includes activating one or more of the screen buttons and input fields appropriate for providing an input based on at least one of touch, button click, and keyboard typing.

[0026] This ensures that the user can provide an input to the user device, especially in a simple manner, when the user's focus is directed to the user device, and thus further reduces the switching of the user's focus.

[0027] In one embodiment, switching the lighting control system commissioning program to the second control mode includes controlling the lighting control system commissioning program to analyze speech and sounds received via an acoustic detector.

[0028] This ensures that, in a particularly simple manner, when the user's focus is on, for example, indoor optical components rather than the user device, the user can provide input to the user device. Consequently, this further reduces the switching of the user's focus.

[0029] In one embodiment, the method further includes switching the lighting control system commissioning program to a first control mode and / or switching the lighting control system commissioning program to a second control mode, depending on one or more activities to be performed during the commissioning of the lighting control system. Detection of the activity may be performed via a sensor such as a camera or via a predefined set of activities.

[0030] This ensures that the lighting system commissioning program can be switched to a mode in which one or more activities can be performed, and indeed in the most efficient manner possible.

[0031] In one embodiment, the method further includes only switching the lighting control system commissioning program to a first control mode for a predetermined subgroup of one or more activities to be performed during the commissioning of the lighting control system.

[0032] This ensures that the lighting control system commissioning program is always switched to a first control mode in which user interface control is used for activities not suitable for execution via voice control.

[0033] In one embodiment, the lighting control system commissioning program is an application.

[0034] The present invention also relates to a system for commissioning an illumination control system, the system for commissioning an illumination control system comprising a user interface, a detector configured to determine the orientation of the head of a user of the illumination control system, a data storage containing instructions, and a data processing device configured to execute the method according to the present invention when executing the instructions.

[0035] In one embodiment, the detector is configured to execute a detection method selected from the group including face recognition, gaze detection, and eye detection.

[0036] The present invention also relates to a system comprising: i) an illumination control system including one or more illumination components; and ii) a system for commissioning the illumination control system, the system for commissioning the illumination control system comprising a user interface, a detector configured to determine the orientation of the head of a user of the illumination control system, a data storage containing instructions, and a data processing device configured to execute the method according to the present invention when executing the instructions.

Brief Description of the Drawings

[0037] This and other aspects of the present invention will be described in more detail with reference to the accompanying drawings showing embodiments of the present invention. As shown in the figures, the sizes of the layers and regions may be exaggerated for illustrative purposes and are thus provided to illustrate the general structure of embodiments of the present invention. Like reference numerals refer to like elements throughout.

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

[0038] The present invention will be described more fully hereinafter with reference to the accompanying drawings, in which presently preferred embodiments of the invention are shown. However, the invention may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided for thoroughness and completeness and to fully convey the scope of the disclosure to those skilled in the art.

[0039] FIG. 1 shows a schematic diagram of a system 1 according to the present invention for commissioning a lighting control system 2. The system 1 includes a user device 4 configured to execute a lighting control system commissioning program. An exemplary user device 4 is schematically shown in FIG. 2. The user device 4 is a mobile device. The user device 4 may be, for example, a mobile phone, a tablet computer, or a laptop computer. The lighting control system commissioning program may be an application 30 (see FIGS. 4 and 5 - 7) configured to operate on the user device 4.

[0040] Referring particularly to FIG. 2, the user device 4 includes a data processing device (processor) 26. The processor 26 is configured to execute a lighting control system commissioning program. The user device 4 further includes a data storage (memory) 27 in which the lighting control system commissioning program is stored. The memory 27 further includes instructions for executing the lighting control system commissioning program. The processor 26 is configured to execute these instructions.

[0041] The user device 4 further includes a user interface 28 configured to present the lighting control system commissioning program. The user interface 28 may include various input components configured to receive input from the user 3 and various output components configured to provide output or feedback to the user 3. The input components may include one or more of a touch screen 20, buttons 21, a mouse 29, or similar devices and a microphone 23 for capturing speech and other sounds. The output components may include one or more of a touch screen 20, a display, a speaker 22, and a haptic unit 25.

[0042] The user device 4 further includes a detector 24. The detector 24 is configured to determine (detect) the orientation of the head of the user 3 of the commissioning system 1. The detector 24 may be configured to perform a detection method that is one or more of face recognition, gaze detection, and eye detection. The detector 24 may be, for example, a camera. Further, the detector 24 may be configured to determine (detect) the focus, focus, or line of sight direction of the eyes of the user 3.

[0043] As shown in FIG. 4, during the commissioning of the lighting control system 2, the user 3 (commissioning engineer) switches between focusing on one or more lighting components 6, 7, 8 of the lighting control system 2 and focusing on the user interface 28 (FIG. 2) of the user device 4 that presents the lighting control system commissioning program. In other words, the user 3 changes the head orientations 9, 10 between the user device 4 (head orientation 9) with the lighting control system commissioning program and the array 5 (head orientation 10) of the lighting components 6, 7, 8 of the lighting control system 2 to be commissioned. The lighting control system commissioning program generally serves to assist the user 3, for example, in checking whether specific lighting components 6, 7, 8 are in the on state or the off state, and in locating and mapping the installed lighting components 6, 7, 8. Typically, the lighting components 6, 7, 8 are lamps or luminaires.

[0044] The user device 4 is configured to execute the method described with reference to FIGS. 3 and 4 by executing instructions stored in the memory 27 using the data processing device 26.

[0045] Referring first to FIG. 3, the method generally includes the following steps, regardless of the embodiment.

[0046] First, in step 101, the head orientations 9, 10 of the user 3 of the lighting control system commissioning program are determined.

[0047] Next, in step 102, based on the determined directions 9 and 10 of the head, it is determined whether the user 3 is focusing on the user interface 28 of the user device 4.

[0048] If it is determined that the direction 9 (see FIG. 4) of the head of the user 3 is facing the user interface 28, the method proceeds to step 103, where the lighting control system commissioning program is automatically switched to the first control mode 11. In the first control mode 11, the feedback from the user device 4 and the lighting control system commissioning program is at least one of graphical and visual. Similarly, the control of the lighting control system commissioning program is also at least one of graphical and visual.

[0049] If it is determined that the direction 10 (see FIG. 4) of the head of the user 3 is not facing the user interface 28 but is facing the lighting components 5, 6, 7, 8, or more specifically, other locations such as the ceiling 13 or the wall 14 of the room 15 (FIG. 1), the method proceeds to step 104. In step 104, the lighting control system commissioning program is automatically switched to the second control mode 12. In the second control mode 12, the feedback from the user device 4 and the lighting control system commissioning program is at least one of audio-based and haptic. The control of the lighting control system commissioning program is audio-based in the second control mode 12.

[0050] Finally, while the lighting control system commissioning program is being used, the method includes step 105, in which steps 101 to 104 are continuously repeated. Thereby, it is ensured that the lighting control system commissioning program is always in the one that is most suitable for the current situation among the two control modes 11 and 12. Thereby, the use of audio-based feedback can be reduced.

[0051] Step 101 may be executed using the detector 24. Step 101 may be executed using a detection method selected from the group including face recognition, gaze detection, and eye detection.

[0052] Steps 102, 103, and 104 may be performed using the processor 26.

[0053] Step 103 may include continuously searching for an input based on at least one of touch, button click, and keyboard typing or switching to accept only such input in the lighting control system commissioning program. Thus, the first control mode 11 may be a mode in which the lighting control system commissioning program searches for an input based on at least one of touch, button click, and keyboard typing or accepts only such input. The first control mode 11 is a graphical interface mode. Therefore, step 103 may include controlling the user interface 28 of the user device 4 to show one or more of the screen buttons and input fields appropriate for providing an input based on at least one of touch, button click, and keyboard typing. Additionally, or alternatively, step 103 may include activating one or more of the screen buttons and input fields appropriate for providing an input based on at least one of touch, button click, and keyboard typing.

[0054] Step 104 may include continuously searching for an input based on at least one of speech and sound received via the acoustic detector or switching to only accept such an input for the lighting control system commissioning program. Thus, the second control mode 12 may be a mode in which the lighting control system commissioning program searches for an input based on at least one of speech and sound received via the acoustic detector or only accepts such an input. The second control mode 12 is an audio control mode, a speech control mode, a vibration control mode, or any combination thereof. Therefore, step 104 may include controlling the lighting control system commissioning program to analyze speech and sound received via an acoustic detector such as the microphone 23. Also, step 104 may include activating an acoustic detector such as the microphone 23 so as to be ready to detect and receive sound.

[0055] Table 1 below lists a number of non-limiting commissioning steps that can be performed via at least one of user interface control (first control mode 11) or voice control (second control mode 12). The checkmark in the control mode column indicates that the activity can be performed in the corresponding control mode. TIFF2025517150000002.tif130116

[0056] Example An example will be described below with reference to FIGS. 5 to 7. In this example, the task of user 3 (commissioning engineer) is to localize all the lamps in the room.

[0057] When user 3 focuses on the user interface 28, the lighting control system commissioning program operating on the user device 4 enters the first control mode 11. In this case, the user device 4 displays a screen as shown in FIG. 5 on the user interface 28.

[0058] When the lighting control system commissioning program, i.e., the user device 4, detects that the user 3 has released the focus from the user interface 28, the lighting control system commissioning program operating on the user device 4 transitions to the second control mode 12. Here, the lighting control system commissioning program operating on the user device 4 may use speech to address the user 3. For example, the lighting control system commissioning program, i.e., the user device 4, may ask the user 3, "Would you like to start lamp discovery for Room One?" Then, the user 3 may be given a limited time, such as 5 seconds, etc., to typically verbally respond with either "Yes" or "No".

[0059] If the user responds with "Yes", the lighting control system commissioning program operating on the user device 4 starts device discovery via voice (the second control mode 12) or via button pressing (the first control mode 11). In this case, the user device 4 shows a screen as shown in FIG. 6 on the user interface 28. Also, the user device 4 may flash the lamps or luminaires 6, 7, 8. Another lamp may be flashed at a predetermined time interval, such as every 2 seconds, etc.

[0060] During the device discovery process, the orientation of the head 9 or 10 of the user 3 is continuously determined.

[0061] If, as a result of the determination, User 3 has focus on the user interface 28 (screen), the first control mode 11 becomes active, speech is not used, and User 3 can provide input by pressing a button 21 provided on the user interface 28 or shown on the touch screen 20.

[0062] If, as a result of the determination, User 3 does not have focus on the user interface 28 (screen), the second control mode 12 becomes active. The lighting control system commissioning program running on the user device 4 may use speech, for example, to control the device discovery process by asking User 3 "Please say STOP when a lamp in Room One is flashing". Each time another lamp starts flashing, the lighting control system commissioning program causes the haptic unit 25 to be used on the user device 4 to briefly beep or vibrate so that User 3 knows that the next lamp is flashing. When there is a predetermined signal from User 3, such as when User 3 says "STOP", the flashing lamp is added to the room configuration. Thereafter, the lighting control system commissioning program running on the user device 4 may use speech, for example, to inform the user that a lamp has been added by telling User 3 "Lamp #3 is added to Room One, would you like to add more lamps to this room?". This is indicated by the user interface 28 showing a screen as shown in FIG. 7. Thereafter, User 3 may again be given a limited time, for example 5 seconds, to typically respond verbally with either "Yes" or "No".

[0063] Those skilled in the art will recognize that the present invention is in no way limited to the above preferred embodiments. On the contrary, many modifications and variations are possible within the scope of the appended claims.

[0064] Furthermore, by considering the drawings, the present disclosure, and the appended claims, variations to the disclosed embodiments can be understood by those skilled in the art and can be carried out when implementing the claimed invention. In the claims, the word "comprising" does not exclude other elements or steps, and the indefinite article "a" or "an" does not exclude a plurality.

Claims

1. A method for selecting a control mode of a user device used when commissioning a lighting control system, wherein the user device includes a memory unit configured to store a lighting control system commissioning program, a processor configured to execute the lighting control system commissioning program, and a user interface configured to present the lighting control system commissioning program, and the lighting control system commissioning program is configured to commission a lighting control system including one or more lighting components, during the commissioning, the user of the lighting control system commissioning program switches between focusing on one or more lighting components of the lighting control system and focusing on the user interface presenting the lighting control system commissioning program, the method comprising: a) determining, by a detector, the orientation of the head of the user of the lighting control system commissioning program; b) judging, by the processor based on the determined orientation of the head, whether the user is focusing on the user interface; c) when it is judged that the user is focusing on the user interface, automatically switching, by the processor, the lighting control system commissioning program to a first control mode in which feedback from the lighting control system commissioning program and control of the lighting control system commissioning program are at least one of graphical and visual; d) when it is judged that the user is not focusing on the user interface, automatically switching, by the processor, the lighting control system commissioning program to a second control mode in which feedback from the lighting control system commissioning program and control of the lighting control system commissioning program are at least one of audio-based and haptic; e) repeating steps a) to d) while the lighting control system commissioning program is in use. A method as described above.

2. The method according to claim 1, wherein switching the lighting control system commissioning program to the first control mode includes switching the lighting control system commissioning program to continuously search for an input based on at least one of touch, button click, and keyboard typing or to accept only the input.

3. The method according to claim 1 or 2, wherein the first control mode is a graphical interface mode.

4. The method according to any one of claims 1 to 3, wherein the second control mode is an audio control mode, a speech control mode, a vibration control mode, or any combination thereof.

5. The method according to any one of claims 1 to 4, wherein switching the lighting control system commissioning program to the second control mode includes switching the lighting control system commissioning program to continuously search for an input based on at least one of speech and sound received via an acoustic detector or to accept only the input.

6. The method according to any one of claims 1 to 5, wherein determining the orientation of the user's head with respect to the lighting control system commissioning program includes using a detection method selected from the group including face recognition, gaze detection, and eye detection.

7. Switching the lighting control system commissioning program to the first control mode includes controlling the user interface to display one or more of a screen button and an input field suitable for providing an input based on at least one of touch, button click, and keyboard typing, and activating one or more of a screen button and an input field suitable for providing an input based on at least one of touch, button click, and keyboard typing, The method according to any one of claims 1 to 6, including one or more of the above.

8. The method according to any one of claims 1 to 7, wherein switching the lighting control system commissioning program to the second control mode includes controlling the lighting control system commissioning program to analyze speech and sound received via an acoustic detector.

9. The method according to any one of claims 1 to 8, comprising performing at least one of switching the lighting control system commissioning program to the first control mode and switching the lighting control system commissioning program to the second control mode, depending on one or more activities to be performed during commissioning of the lighting control system.

10. The method according to claim 9, comprising only switching the lighting control system commissioning program to the first control mode for a predetermined subgroup of one or more activities to be performed during commissioning of the lighting control system.

11. The lighting control system commissioning program is an application, the method according to any one of claims 1 to 10.

12. A system for commissioning a lighting control system, comprising: a user interface; a detector configured to determine the orientation of the head of a user of a lighting control system including one or more lighting components; a data storage including instructions; a data processing device configured to perform the method according to any one of claims 1 to 11 when executing the instructions. A system comprising.

13. The system according to claim 12, wherein the detector is configured to perform a detection method selected from the group including face recognition, gaze detection, and eye detection.

14. A lighting control system including one or more lighting components; A system for commissioning the lighting control system according to claim 12 or 13. A system comprising.

15. The system according to claim 14, wherein the one or more lighting components include lighting fixtures.

Images