Method for selecting a control mode during commissioning of a lighting control system - Patent Application 20070122997
By dynamically switching between graphical and audio/haptic feedback modes based on user focus, the method addresses inefficiencies in lighting control system commissioning, reducing focus switching and audio feedback, thus optimizing the commissioning process.
Patent Information
- Application Number
- JP2024566194
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2022-05-10
- Filing Date
- 2023-05-09
- Publication Date
- 2025-11-11
- Estimated Expiration
- 2043-05-09
AI Technical Summary
The inefficiency of the commissioning process in lighting control systems due to frequent switching between focusing on lighting components and the user interface, along with the annoyance of unnecessary audio-based feedback, necessitates a method to reduce focus switching and ensure audio feedback is given only when necessary.
A method that determines the user's head orientation to automatically switch between graphical and audio/haptic feedback modes, allowing input through touch/keyboard in graphical mode and voice/sound in audio mode, thereby reducing focus switching and ensuring audio feedback is sparse.
This approach enhances the efficiency of the commissioning process by minimizing user focus switching and reducing unnecessary audio feedback, ensuring relevant inputs are captured while maintaining user interaction efficiency.
Smart Images

Figure 0007767650000002 
Figure 0007767650000003 
Figure 0007767650000004
Abstract
Description
[Technical Field]
[0001] The present invention relates to a method for selecting a control mode of a user device for use in commissioning a lighting control system, the user device being configured to run a lighting control system commissioning program, the user device including a user interface configured to present the lighting control system commissioning program, and during commissioning a user of the lighting control system commissioning program switching between focusing on one or more lighting components of the lighting control system and focusing on the user interface presenting the lighting control system commissioning program. [Background technology]
[0002] During the commissioning of a lighting control system, a commissioning engineer needs to change focus between the mobile lighting control system commissioning program and the lighting components in the room, for example, to check whether a particular lamp is on or off. Also, one of the essential steps in the commissioning process of a lighting system is to locate and map the installed lighting components. Therefore, the engineer must switch focus between the commissioning program and the lighting components very frequently. Due to the large number of devices to be handled, switching reduces the efficiency of the commissioning process.
[0003] US 10,512,143 B1 discloses a lighting control system provided to reduce time, cost, and the possibility of errors during device commissioning. A controller is programmed to receive voice commands from a user and identify and implement a device commissioning mode based at least on the received voice commands. In a first commissioning mode, the controller configures one or more buttons or equivalent actuators on a control switch associated with a lighting zone. In a second commissioning mode, the controller assigns device grouping and / or configuration data to a plurality of lighting devices (e.g., lighting fixtures, occupancy sensors, light sensors) operably connected to the control switch. In another commissioning mode, the controller may further identify and assign device grouping and / or configuration data to one or more second lighting devices to be added to or to replace one or more of the plurality of first lighting devices.
[0004] US10512132B discloses a lighting control system for device commissioning comprising a controller programmed to receive voice commands from a user and to identify and implement a device commissioning mode based on the received voice commands: In a first commissioning mode, the controller configures one or more buttons or equivalent actuators on a control switch mounted in association with a lighting zone.
[0005] Thus, there is a need to provide a device and method of the type mentioned in the introduction, in which changeovers are reduced and the efficiency of the commissioning process is increased.
[0006] There is a further desire to provide such a device and method in which focus switching of the engineer or user can be reduced and in which audio-based feedback to the engineer or user (which feedback may otherwise be annoying) can be ensured to be given more sparsely, and in particular only when strictly necessary. Summary of the Invention [Problem to be solved by the invention]
[0007] The object of the present invention is to overcome this problem and to provide a device and method of the type mentioned in the introduction, in which changeovers are reduced and the efficiency of the commissioning process is increased.
[0008] It is a further object of the present invention to provide such a device and such a method in which focus switching of the engineer or user can be reduced and in addition it can be ensured that audio-based feedback to the engineer or user is given more sparsely, and in particular only when strictly necessary. [Means for solving the problem]
[0009] According to a first aspect of the present invention, this and other objects are provided by a method for selecting a control mode of a user device for use in commissioning a lighting control system, the user device comprising: a memory unit configured to store a lighting control system commissioning program; a processor configured to execute the lighting control system commissioning program; and a user interface configured to present the lighting control system commissioning program, wherein during commissioning a user of the lighting control system commissioning program switches between focusing on one or more lighting components of the lighting control system and focusing on the user interface presenting the lighting control system commissioning program, the method comprising: a) determining, by a detector, the orientation of the head of a user of the lighting control system commissioning program; b) determining, by a processor, whether the user is focusing on a user interface based on the determined head orientation; c) when it is determined that the user is focusing on the user interface, automatically switching, by the processor, the lighting control system commissioning program to a first control mode, wherein feedback from and control of the lighting control system commissioning program is at least one of graphical and visual; d) if it is determined that the user is not focusing on the user interface, automatically switching, by the processor, the lighting control system commissioning program to a second control mode, wherein feedback from and control of the lighting control system commissioning program is at least one of audio based and haptic; e) repeating steps a) to d) (continuously) while the lighting control system commissioning program is in use; and This is achieved by a method comprising:
[0010] This provides a method that, thanks to, among other things, steps b), c), d) and e) above, ensures that audio-based feedback to the engineer or user (which may otherwise be annoying) is given more sparsely, in particular only when the user's focus is away from the user device, and thus only when strictly necessary.
[0011] In particular, thanks to steps c), d) and e) above, this also reduces focus switching for the engineer or user, as it ensures that feedback can be given to the user and that the user can provide input to the user device regardless of whether the user's focus is on the user device or not.
[0012] The lighting control system commissioning program is configured for commissioning a lighting control system including one or more lighting components.
[0013] This provides a method of the type mentioned at the outset, which increases the efficiency of the commissioning process.
[0014] In one embodiment, switching the lighting control system commissioning program to the first control mode includes switching the lighting control system commissioning program to continuously search for or only accept input based on at least one of touch, button click, and keyboard typing.
[0015] This ensures that all relevant inputs are captured and registered while the first control mode is active, which in turn further reduces user focus switching and ensures that audio-based feedback can be avoided while the first control mode is active.
[0016] In one embodiment, the first control mode is a graphical interface mode.
[0017] This ensures that, in a particularly simple manner, feedback can be given to the user and the user can provide input to the user device when the user's focus is directed at the user device, thus further reducing user focus switching.
[0018] In one embodiment, the second control mode is an audio-controlled mode, a speech-controlled mode, a vibration-controlled mode, or any combination thereof.
[0019] This ensures, in a particularly simple manner, that feedback can be given to the user and that the user can provide input to the user device when the user's focus is not on the user device but, for example, on optical components in the room. This in turn further reduces user focus switching and ensures that only audio-based feedback can be given while the second control mode is active. Furthermore, if the commissioning program only responds to voice commands in the second control mode, this also reduces the possibility of unintended voice commands in the first control mode, since the commissioning program does not respond to voice commands in the first control mode.
[0020] In one embodiment, switching the lighting control system commissioning program to the second control mode includes switching the lighting control system commissioning program to continuously search for or only accept input based on at least one of speech and sound received via an acoustic detector.
[0021] This ensures that all relevant inputs are captured and registered while the second control mode is active, thus further reducing user focus switching.
[0022] In one embodiment, determining the head orientation of the user of the lighting control system commissioning program comprises using a detection method selected from the group comprising face recognition, stare detection and eye detection.
[0023] These are proven to be particularly accurate and efficient methods for determining the head orientation of a device user.
[0024] In one embodiment, switching the lighting control system commissioning program to the first control mode includes controlling the user interface to present one or more of screen buttons and input fields suitable for providing input based on at least one of touch, button clicking, and keyboard typing.
[0025] In alternative or additional embodiments, switching the lighting control system commissioning program to the first control mode includes activating one or more of a screen button and an input field appropriate to provide input based on at least one of touch, button clicking, and keyboard typing.
[0026] This ensures that the user can provide input to the user device when the user's focus is directed at the user device in a particularly simple manner, thus further reducing user focus switching.
[0027] In one embodiment, switching the lighting control system commissioning program to the second control mode includes controlling the lighting control system commissioning program to analyze speech and sound received via an acoustic detector.
[0028] This ensures, in a particularly simple manner, that a user can provide input to a user device when their focus is not on the user device but, for example, on optical components in a room, which in turn further reduces user focus switching.
[0029] In one embodiment, the method further includes performing at least one of switching the lighting control system commissioning program to a first control mode and switching the lighting control system commissioning program to a second control mode depending on one or more activities related to a commissioning step to be performed during commissioning of the lighting control system. Detection of the activities may be via a sensor, such as a camera, or via a predefined set of activities.
[0030] This can ensure that the lighting system commissioning program is switched into a mode in which one or more activities can be performed, and even more so in the most efficient manner.
[0031] In one embodiment, the method further includes only switching the lighting control system commissioning program to the first control mode for a predetermined subgroup of one or more activities to be performed during commissioning of the lighting control system.
[0032] This ensures that for activities that are not suitable to be carried out via voice control, the lighting control system commissioning program always switches to the first control mode, in which user interface control is used.
[0033] In one embodiment, the lighting control system commissioning program is an app.
[0034] The present invention also relates to a system for commissioning a lighting control system, the system for commissioning a lighting control system comprising a user interface, a detector configured to determine a head orientation of a user of the lighting control system, a data storage containing instructions, and a data processing device configured to perform a method according to the present invention when the instructions are executed.
[0035] In one embodiment, the detector is configured to perform a detection method selected from the group comprising face recognition, gaze detection and eye detection.
[0036] The present invention also relates to a system comprising: i) a lighting control system including one or more lighting components; and ii) a system for commissioning the lighting control system, the system for commissioning the lighting control system comprising a user interface, a detector configured to determine a head orientation of a user of the lighting control system, a data storage including instructions, and a data processing device configured to perform a method according to the present invention when the instructions are executed. [Brief explanation of the drawings]
[0037] This and other aspects of the present invention will be described in more detail with reference to the accompanying drawings, which illustrate embodiments of the present invention. As shown in the figures, the sizes of layers and regions may be exaggerated for illustrative purposes and are thus provided to illustrate the general structure of embodiments of the present invention. Like reference numerals refer to like elements throughout. [Figure 1] 1 shows a schematic diagram of a system according to the invention for commissioning a lighting control system; [Figure 2] 1 shows a schematic diagram of a user device of a system according to the invention; [Figure 3] 1 shows a block diagram illustrating an embodiment of a method according to the present invention for selecting a control mode during commissioning of a lighting control system; [Figure 4] 1 shows a schematic diagram of user interaction with a system according to the invention, graphically illustrating first and second control modes of a user device of the system according to the invention; [Figure 5] 1 shows a schematic diagram of three different exemplary screen images shown by a user interface of a user device presenting a lighting control system commissioning program of a system according to the invention; [Figure 6] 1 shows a schematic diagram of three different exemplary screen images shown by a user interface of a user device presenting a lighting control system commissioning program of a system according to the invention; [Figure 7] 1 shows a schematic diagram of three different exemplary screen images shown by a user interface of a user device presenting a lighting control system commissioning program of a system according to the invention; DETAILED DESCRIPTION OF THE INVENTION
[0038] The present invention is described more fully hereinafter with reference to the accompanying drawings, in which presently preferred embodiments of the invention are shown. However, the present invention may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided for thoroughness and completeness, so that the scope of the disclosure will be fully conveyed to those skilled in the art.
[0039] Figure 1 shows a schematic diagram of a system 1 according to the invention for commissioning a lighting control system 2. The system 1 includes a user device 4 configured to run a lighting control system commissioning program. An exemplary user device 4 is shown schematically in Figure 2. The user device 4 is a mobile device. The user device 4 may be, for example, a mobile phone, a tablet computer or a laptop computer. The lighting control system commissioning program may be an app 30 (see Figures 4 and 5-7) configured to run on the user device 4.
[0040] 2, the user device 4 includes a data processing device (processor) 26. The processor 26 is configured to execute a lighting control system commissioning program. The user device 4 further includes a data storage (memory) 27 in which the lighting control system commissioning program is stored. The memory 27 further includes instructions for executing the lighting control system commissioning program. The processor 26 is configured to execute these instructions.
[0041] The user device 4 further includes a user interface 28 configured to present the lighting control system commissioning program. The user interface 28 may include various input components configured to receive input from the user 3 and various output components configured to provide output or feedback to the user 3. The input components may include one or more of a touchscreen 20, buttons 21, a mouse 29 or similar device, and a microphone 23 for capturing speech and other sounds. The output components may include one or more of a display, such as the touchscreen 20, a speaker 22, and a haptic unit 25.
[0042] The user device 4 further includes a detector 24. The detector 24 is configured to determine (detect) the head orientation of the user 3 of the commissioning system 1. The detector 24 may be configured to perform a detection method that is one or more of face recognition, gaze detection, and eye detection. The detector 24 may, for example, be a camera. Furthermore, the detector 24 may be configured to determine (detect) the focus, focus, or gaze direction of the eyes of the user 3.
[0043] As shown in FIG. 4 , during commissioning of the lighting control system 2, the user 3 (a commissioning engineer) switches between focusing on one or more lighting components 6, 7, 8 of the lighting control system 2 and focusing on the user interface 28 ( FIG. 2 ) of the user device 4, which presents the lighting control system commissioning program. In other words, the user 3 changes head orientation 9, 10 between the user device 4 (head orientation 9) with the lighting control system commissioning program and the array 5 (head orientation 10) of lighting components 6, 7, 8 of the lighting control system 2 that are to be commissioned. The lighting control system commissioning program generally serves to assist the user 3, for example, in checking whether a particular lighting component 6, 7, 8 is in an on or off state and in locating and mapping the installed lighting components 6, 7, 8. Typically, the lighting components 6, 7, 8 are lamps or luminaires.
[0044] The user device 4 is configured to carry out the methods described with reference to FIGS. 3 and 4 by executing instructions stored in memory 27 using the data processing device 26 .
[0045] Referring first to FIG. 3, the method generally and regardless of embodiment includes the following steps.
[0046] First, in step 101, the head orientation 9, 10 of the user 3 of the lighting control system commissioning program is determined.
[0047] Next, in step 102 it is determined whether the user 3 is focusing on the user interface 28 of the user device 4 based on the determined head orientation 9,10.
[0048] If it is determined that the head orientation 9 of the user 3 (see Figure 4) is towards the user interface 28, the method proceeds to step 103 where the lighting control system commissioning program automatically switches to a first control mode 11. In the first control mode 11, feedback from the user device 4 and the lighting control system commissioning program is graphical and / or visual. Control of the lighting control system commissioning program is similarly graphical and / or visual.
[0049] If it is determined that the user 3's head orientation 10 (see FIG. 4 ) is directed not toward the user interface 28 but toward the lighting components 5, 6, 7, 8, or for that matter toward another location ( FIG. 1 ), such as the ceiling 13 or wall 14 of the room 15, the method proceeds to step 104. In step 104, the lighting control system commissioning program automatically switches to a second control mode 12. In the second control mode 12, feedback from the user device 4 and the lighting control system commissioning program is at least one of audio-based and haptic. Control of the lighting control system commissioning program is audio-based in the second control mode 12.
[0050] Finally, the method includes step 105 in which steps 101 to 104 are continually repeated while the lighting control system commissioning program is in use, thereby ensuring that the lighting control system commissioning program is always in one of the two control modes 11 and 12 which is most appropriate for the current situation, which may reduce the use of audio-based feedback.
[0051] Step 101 may be performed using detector 24. Step 101 may be performed using a detection method selected from the group including face recognition, gaze detection and eye detection.
[0052] Steps 102, 103 and 104 may be performed using processor 26.
[0053] Step 103 may include switching the lighting control system commissioning program to continuously search for or only accept input based on at least one of touch, button click, and keyboard typing. Thus, the first control mode 11 may be a mode in which the lighting control system commissioning program searches for or only accepts input based on at least one of touch, button click, and keyboard typing. The first control mode 11 is a graphical interface mode. Thus, step 103 may include controlling the user interface 28 of the user device 4 to present one or more screen buttons and input fields appropriate for providing input based on at least one of touch, button click, and keyboard typing. Additionally or alternatively, step 103 may include activating one or more screen buttons and input fields appropriate for providing input based on at least one of touch, button click, and keyboard typing.
[0054] Step 104 may include switching the lighting control system commissioning program to continuously search for or only accept input based on at least one of speech and sound received via an acoustic detector. Thus, second control mode 12 may be a mode in which the lighting control system commissioning program searches for or only accepts input based on at least one of speech and sound received via an acoustic detector. Second control mode 12 may be an audio control mode, a speech control mode, a vibration control mode, or any combination thereof. Thus, step 104 may include controlling the lighting control system commissioning program to analyze speech and sound received via an acoustic detector, such as microphone 23. Step 104 may also include activating an acoustic detector, such as microphone 23, so that the acoustic detector is ready to detect and receive sound.
[0055] Table 1 below lists a number of non-limiting commissioning steps that can be performed via user interface control (first control mode 11) or voice control (second control mode 12). A check mark in the control mode column indicates that the activity can be performed in the corresponding control mode. TIFF0007767650000001.tif130116
[0056] example An example will now be described with reference to Figures 5 to 7. In this example, the task of User 3 (the commissioning engineer) is to localize all the lamps in a room.
[0057] When the user 3 looks at the user interface 28, the lighting control system commissioning program running on the user device 4 goes into the first control mode 11. In this case, the user device 4 shows on the user interface 28 a screen such as that shown in Figure 5.
[0058] When the lighting control system commissioning program, and thus the user device 4, detects that the user 3 has taken focus away from the user interface 28, the lighting control system commissioning program running on the user device 4 transitions to the second control mode 12. Here, the lighting control system commissioning program running on the user device 4 may use speech to address the user 3. For example, the lighting control system commissioning program, and thus the user device 4, may ask the user 3, "Would you like to start lamp discovery for Room One?" The user 3 may then be given a limited time, such as five seconds, to reply, typically verbally, with either "Yes" or "No."
[0059] If the user replies "yes", the lighting control system commissioning program running on the user device 4 initiates device discovery via voice (second control mode 12) or via button press (first control mode 11). In this case, the user device 4 shows a screen such as that shown in Figure 6 on the user interface 28. The user device 4 may also flash lamps or luminaires 6, 7, 8. After a predetermined time interval, for example 2 seconds, another lamp may be flashed.
[0060] During the device discovery process, the orientation of the user's 3 head 9 or 10 is continuously determined.
[0061] If the determination is that the user 3 has focus on the user interface 28 (screen), the first control mode 11 is active, speech is not used, and the user 3 can provide input by pressing buttons 21 provided on the user interface 28 or shown on the touch screen 20.
[0062] If it is determined that the user 3 is not focusing on the user interface 28 (screen), the second control mode 12 is activated. The lighting control system commissioning program running on the user device 4 may use speech to control the device discovery process, for example, by asking the user 3, "Please say STOP when a lamp in Room One is flashing." Each time another lamp starts flashing, the lighting control system commissioning program causes the user device 4 to use the haptic unit 25 to briefly beep or vibrate so that the user 3 knows that the next lamp is flashing. Upon a predetermined signal from the user 3, for example, when the user 3 says "STOP," a flashing lamp is added to the room configuration. The lighting control system commissioning program running on the user device 4 may then use speech to notify the user 3 that the lamp has been added, for example, by telling the user 3, "Lamp #3 is added to Room One, would you like to add more lamps to this room?" This is indicated by the user interface 28 showing a screen such as that shown in FIG. 7. The user 3 may then again be given a limited time, such as five seconds, to reply, typically verbally, with either "yes" or "no."
[0063] Those skilled in the art will recognize that the present invention is by no means limited to the preferred embodiments described above: on the contrary, many modifications and variations are possible within the scope of the appended claims.
[0064] Furthermore, variations to the disclosed embodiments can be understood by those skilled in the art, from a study of the drawings, the disclosure, and the appended claims, and can be implemented in practicing the claimed invention. In the claims, the word "comprising" does not exclude other elements or steps, and the indefinite article "a" or "an" does not exclude a plurality.
Claims
1. 1. A method for selecting a control mode of a user device for use in commissioning a lighting control system, comprising: the user device comprises: a memory unit configured to store a lighting control system commissioning program; a processor configured to execute the lighting control system commissioning program; and a user interface configured to present the lighting control system commissioning program, the lighting control system commissioning program configured for commissioning a lighting control system including one or more lighting components; during the commissioning, a user of the lighting control system commissioning program switches between focusing on one or more lighting components of the lighting control system and focusing on the user interface presenting the lighting control system commissioning program; The method comprises: a) determining, by a detector, a head orientation of a user of said lighting control system commissioning program; b) determining, by the processor, whether the user is focusing on the user interface based on the determined orientation of the head; c) if it is determined that the user is focusing on the user interface, automatically switching, by the processor, the lighting control system commissioning program to a first control mode in which feedback from the lighting control system commissioning program is at least one of graphical and visual and the lighting control system commissioning program is at least one of graphical and visually controlled; d) if it is determined that the user is not focusing on the user interface, automatically switching, by the processor, the lighting control system commissioning program to a second control mode, wherein feedback from the lighting control system commissioning program is at least one of audio-based and haptic, and the lighting control system commissioning program is at least one of audio-based and haptic controlled; e) repeating steps a) to d) while said lighting control system commissioning program is in use; and A method comprising:
2. 10. The method of claim 1, wherein switching the lighting control system commissioning program to the first control mode comprises switching the lighting control system commissioning program to continuously search for or only accept input based on at least one of touch, button click, and keyboard typing.
3. The method of claim 1 or 2, wherein the first control mode is a graphical interface mode.
4. The method of claim 1 or 2, wherein the second control mode is an audio control mode, a speech control mode, a vibration control mode, or any combination thereof.
5. 3. The method of claim 1 or 2, wherein switching the lighting control system commissioning program to the second control mode comprises switching the lighting control system commissioning program to continuously search for or only accept input based on at least one of speech and sound received via an acoustic detector.
6. 3. The method of claim 1 or 2, wherein determining the head orientation of the user of the lighting control system commissioning program comprises using a detection method selected from the group comprising face recognition, gaze detection and eye detection.
7. switching the lighting control system commissioning program to the first control mode includes: controlling the user interface to present one or more of screen buttons and input fields suitable for providing input based on at least one of touch, button clicking, and keyboard typing; and activating one or more of screen buttons and input fields appropriate to provide input based on at least one of touch, button clicking, and keyboard typing; The method of claim 1 or 2, comprising one or more of:
8. 3. The method of claim 1 or 2, wherein switching the lighting control system commissioning program to the second control mode comprises controlling the lighting control system commissioning program to analyze speech and sound received via an acoustic detector.
9. 3. The method of claim 1, comprising performing at least one of switching the lighting control system commissioning program to the first control mode and switching the lighting control system commissioning program to the second control mode in dependence on one or more activities related to a commissioning step to be performed during commissioning of a lighting control system.
10. 10. The method of claim 9, wherein the method only comprises switching the lighting control system commissioning program to the first control mode for a predetermined subgroup of one or more activities to be performed during commissioning of a lighting control system.
11. The method according to claim 1 or 2, wherein the lighting control system commissioning program is an app.
12. 1. A system for commissioning a lighting control system, comprising: A user interface; a detector configured to determine a head orientation of a user of a lighting control system including one or more lighting components; a data storage containing instructions; a data processing device configured to perform the method according to claim 1 or 2 when executing said instructions; Including, the system.
13. The system of claim 12 , wherein the detector is configured to perform a detection method selected from the group comprising face recognition, gaze detection, and eye detection.
14. a lighting control system including one or more lighting components; A system for commissioning a lighting control system according to claim 12; Including, the system.
15. The system of claim 14 , wherein the one or more lighting components include a lighting fixture.
Citation Information
Patent Citations
Illumination setting support device, illumination setting support program and illumination system
JP2017142964A
Control device, control method, and program
JP2018088119A
Digital assistant user interfaces and response modes
US20210365161A1