Method for determining the location of at least one lighting device, control unit, and lighting system

Abstract

The method includes: sending (25) at least one lighting command and / or command sequence to a plurality of lighting devices (2) located in a physical environment to instruct at least one of the lighting devices (2) how to react; and capturing (30) the physical environment to provide camera data representing the lighting responses of the plurality of lighting devices (2) and including location data representing the positions of the plurality of lighting devices (2) in the physical environment. The method also includes processing (35) the camera data to identify at least one lighting device (2) based on its contribution to the lighting response, and mapping (40) at least one identified lighting device (2) to its position in the physical environment, at least partially based on the location data. Furthermore, a control unit and a lighting system are provided.

Description

Technical Field

[0001] The technical field of this disclosure generally relates to lighting systems. In particular, this disclosure relates to methods for determining the location of at least one lighting device, as well as control units and lighting systems. Background Technology

[0002] In lighting systems, particularly when lighting devices are connected to a lighting network, there is no straightforward way to directly bind or map their physical locations to a list of devices—that is, to establish a correspondence between lighting devices and their physical locations. Some approaches present a simple list of devices, making it difficult to associate them with their actual locations in the real world.

[0003] In some lighting systems, users can drag and drop lighting devices or their corresponding icons onto a floor plan or similar background on the user interface, manually identifying and assigning their positions through an "identify" operation. This is the most direct method, but users need to manually confirm the position of each device one by one, making the process cumbersome and time-consuming.

[0004] In other systems, the shape of the lighting equipment can be mapped by capturing photos or recording videos of it, allowing for more intuitive control. This method has already been used in some light strip products. Compared to previous methods, this method allows for easier and more accurate mapping of the final arrangement of light strips and light bars. It also provides users with a more convenient setup experience, eliminating the need for them to manually draw the shape of the lighting equipment. However, this method is primarily designed for single light strips and does not consider multiple lighting devices. Summary of the Invention

[0005] The purpose of this application is to provide a particularly user-friendly and convenient method for determining the location of lighting equipment, so as to allow the establishment and control of lighting systems with multiple lighting equipment.

[0006] To address the aforementioned problems, a method is provided for determining the location of at least one lighting device. The method includes sending at least one lighting command or instruction and / or command sequence to a plurality of lighting devices located in a physical environment to instruct at least one of the lighting devices how to react.

[0007] In particular, lighting commands can be sent by a control unit or control device (typically a mobile application) that is configured to control multiple lighting devices, for example, via wired and / or wireless communication interfaces.

[0008] Multiple lighting devices may specifically include one or more controllable lighting devices (e.g., lighting modules or luminaires) having at least one adjustable light parameter (e.g., color, color temperature, brightness, etc.).

[0009] Lighting equipment may include one or more light sources, such as LED light sources, communication interfaces (wired and / or wireless), controllers and drivers for driving the light sources. Lighting equipment may be specifically configured to receive and execute lighting commands received from a control unit.

[0010] According to instructions sent by the control unit, the lighting response of multiple lighting devices to at least one lighting command can be to activate, deactivate, and / or adjust the corresponding lighting devices.

[0011] The method also includes capturing the physical environment specifically via one or more cameras to provide camera data representing the illumination response of multiple lighting devices and including location data representing the positions of the multiple lighting devices in the physical environment. Capturing the physical environment may include taking photographs and / or videos of the physical environment, such that the camera data may include image and / or video data.

[0012] The method also includes processing camera data to identify at least one lighting device based at least in part on the contribution of at least one lighting device to the lighting response, and mapping at least one identified lighting device to its location in the physical environment or physical location based at least in part on location data.

[0013] The processing can be at least partially based on AI (artificial intelligence) and image processing technologies, enabling the control device to recognize patterns and automatically locate the corresponding lighting equipment. The location determination of the lighting equipment can additionally and at least partially rely on crowdsourced location determination, particularly by using additional information sources or reference systems. This can be particularly helpful if not all equipment can be captured by the camera simultaneously.

[0014] By automatically identifying and mapping lighting devices, the method allows for rapid and simple calibration of control units used to control lighting devices. Specifically, the process may include displaying the physical environment with the lighting devices on a user interface (UI). In particular, mapping may include binding the display location of the lighting devices to a virtual device identifier (ID) used in the application, such as being stored in the memory unit of the control unit.

[0015] After identifying and mapping the lighting equipment, the control unit can be used to control the lighting equipment in a targeted manner based on the actual physical location mapping of the lighting equipment, thereby providing a more intuitive user interaction by aligning with the real-world layout and proximity of the equipment.

[0016] Furthermore, communication between lighting devices is not necessary in order to control even a large number of lighting devices through a control unit. Therefore, the hardware of the lighting devices and the entire system can be simplified.

[0017] In some embodiments, sending a lighting command includes sending a lighting pattern command to elicit a pattern-based response from a plurality of lighting devices. Specifically, the lighting command may include instructions to generate a lighting pattern, particularly a static or dynamic lighting pattern, such as flashing, followed by a color change to a specific color, such as red. By introducing and recognizing specific lighting patterns, the confidence level of the identification of lighting devices and the reliability of the method can be increased.

[0018] Multiple lighting devices may include one or more groups of lighting devices, wherein sending lighting commands may include sending lighting commands with different modes to different (e.g., all) devices and / or different groups of devices substantially simultaneously.

[0019] In particular, the method may include substantially simultaneous pattern recognition, enabling the simultaneous identification and mapping of multiple devices, making the setup or calibration process particularly fast and efficient.

[0020] In some embodiments, alternatively or additionally, the method includes individually addressing lighting devices, such that the devices can be individually identified, mapped, and / or adjusted one by one. This embodiment is particularly reliable and inexpensive in terms of the required hardware and software.

[0021] Sending different lighting modes can include sending a unique mode to each lighting device. By sending a unique mode, such as a unique color or a unique hue, to each device, the error rate in identifying lighting devices can be reduced.

[0022] In some embodiments, the method includes detecting whether a new lighting device has been added to a plurality of lighting devices, and if a new lighting device is detected, initiating an identification or calibration process by sending a lighting command to the new device. Subsequently, the aforementioned identification and mapping can be applied to the newly added device based on its response to the lighting command. Specifically, the physical environment and the newly added device can be captured, and camera data can be analyzed to identify the newly added device and map it to its physical location.

[0023] When adding only one lighting device at a time, simple lighting commands such as "turn on", "turn off", or "turn on / off" may be sufficient to reliably identify the newly added device.

[0024] If more new devices are to be added to the system, the method may include repeatedly applying the detection, identification, and mapping steps described above for each newly added lighting device, specifically until all lighting devices are identified and mapped to their locations. Once all lighting devices have been identified and mapped, the calibration process can be concluded.

[0025] The method may also include displaying a physical environment or a model of the physical environment using an image of at least one lighting device on a user interface (UI) such as a touchscreen, and creating at least one control icon based on the image of the at least one identified lighting device displayed on the UI. Creating the control icon may include drawing a circle or otherwise marking the image of the identified lighting device to form an activatable button. In some embodiments, once the button is activated, for example, by a finger or mouse cursor, a configuration menu pops up for configuring the identified lighting device.

[0026] In some embodiments, at least one lighting device is identified based at least in part on its shape and / or category. The use of the shape, category, and / or type of lighting devices can facilitate and accelerate the identification calibration process, especially if at least some lighting devices can be identified and mapped even without waiting for their lighting response.

[0027] According to some embodiments, at least one lighting device includes a set of lighting devices configured to reproduce an image, wherein the method further includes providing or selecting an image for reproduction, such as one captured by a camera and / or stored in a memory unit of a control unit. The method may include reproducing the image in a physical environment by generating a command or set of commands based at least in part on the locations of multiple identified and mapped lighting devices in the physical environment and sending them to the multiple identified and mapped lighting devices. Thus, a fast and easy method can be provided for reproducing images, such as those used to display flags with national colors or symbols for special events.

[0028] According to a second aspect, a control unit for determining the location of at least one lighting device is provided. The control unit includes: a processor; a memory unit for storing data and machine-readable instructions for the processor; and an interface. The interface is configured to send at least one lighting command or instruction and / or command sequence to a plurality of lighting devices positioned in a physical environment to instruct at least one of the lighting devices how to behave. The interface is also configured to receive camera data, such as from one or more cameras, representing the lighting responses of the plurality of lighting devices and including location data representing the locations of the plurality of lighting devices in the physical environment.

[0029] The memory unit contains instructions to cause the processor to process camera data, identify at least one lighting device based on the contribution of at least one lighting device to the lighting response, and map at least one identified lighting device to its location in the physical environment based at least in part on location data.

[0030] The control unit can be a single component or implemented in a single device, such as a mobile application, or it can be distributed across two or more physical devices, such as a cloud server for stereoscopic images of the physical environment or multiple cameras.

[0031] The control unit enables quick and easy calibration of the configuration of lighting systems and lighting equipment. Once the lighting equipment is identified and mapped, the control unit can be used to control the lighting equipment to create different lighting scenes according to the user's wishes.

[0032] According to a third aspect, a lighting system is provided. The lighting system includes multiple controllable lighting devices that can be deployed in a physical environment and a controller according to a second aspect, the controller being configured to identify the multiple lighting devices and map the multiple lighting devices to their locations in the physical environment. Due to the automatic identification and mapping of the lighting devices, the system is particularly user-friendly and allows for quick and simple calibration of the control unit used to control the lighting devices.

[0033] In the following description, details are provided to describe embodiments of this specification. However, it will be apparent to those skilled in the art that embodiments can be practiced without these details.

[0034] Some components in the embodiments have similar components. Similar components may have the same name or similar component numbers. Where appropriate, the description of one component is applied to another similar component by reference, thereby reducing textual duplication without limiting this disclosure. Attached Figure Description

[0035] Figure 1 A schematic block diagram of a lighting system according to an embodiment is shown.

[0036] Figure 2 The calibration process of the lighting system according to an embodiment is illustrated schematically.

[0037] Figure 3 A flowchart of the process according to an embodiment is shown.

[0038] Figure 4 The workflow of the calibration process for the lighting system according to an embodiment is shown.

[0039] Figure 5 An example of a lighting system according to an embodiment is shown, and

[0040] Figure 6 An example of another system according to another embodiment is shown. Detailed Implementation

[0041] Figure 1 A schematic block diagram of a lighting system according to an embodiment is shown. In the illustrated embodiment, the lighting system 1 includes a plurality of (e.g., 1 to N) lighting devices 2 and a control unit 2 for controlling the lighting devices 2.

[0042] The lighting device 2 is configured as a controllable lighting device, which includes at least one controllable light source 4 having at least one controllable light parameter and a controller (not shown). In some embodiments, the light source is configured to generate light with adjustable light parameters (such as color, color temperature, brightness, etc.).

[0043] Figure 1 The lighting device 2 shown also includes a communication interface 5, which is configured to receive instructions from the control unit 3 to control the light source 4.

[0044] The arrow pointing to the right indicates the information flow from control unit 3 to lighting device 2, while the arrow pointing to the left indicates the information flow from lighting device 2 to control unit 3.

[0045] Specifically, the control unit 3 may include a processor, a memory unit, and an interface for issuing commands or instructions (indicated by the right arrow) to the corresponding interface 5 of the lighting device 2. For simplicity, the processor, memory unit, and processor interface are not shown.

[0046] The lighting device 2 can also send digital information, such as handshake or confirmation signals, to the control unit 3 through the corresponding interface 5.

[0047] Communication between the control unit and multiple lighting devices can be based on one or more wireless or wired communication protocols, such as Bluetooth (a registered trademark of the Bluetooth Special Interest Group), Zigbee (a registered trademark of the Connectivity Standards Alliance), DALI (a registered trademark of the DALI Alliance), LoRa (a registered trademark of Semtech Corporation), etc.

[0048] Furthermore, the lighting device 2 can execute the command received from the control unit 3 by adjusting the light output in response to the lighting command received from the control unit 3.

[0049] In this embodiment, the control unit 3 is configured as a mobile device, such as a mobile phone or tablet PC, on which application software for performing this method and for controlling the lighting device 2 is installed.

[0050] Figure 2 The calibration process of a lighting system according to an embodiment is illustrated schematically. In the illustrated embodiment, multiple lighting devices 2 are shown in the physical environment, which is a living space. Some lighting devices may be pre-installed, while others may be newly added to the lighting system.

[0051] In particular, for newly added lighting equipment, calibration can be performed according to one of the embodiments of the above method.

[0052] In particular, Figure 2In the upper part, the right arrow indicates that the control unit 3 sends lighting commands to multiple lighting devices 2 (lamp fixtures) in the physical environment (living space). The lighting commands may specifically include mode instructions or mode-based instructions, such as causing at least one lighting device to flash or turn at least one lighting device on / off.

[0053] Upon receiving a lighting command, lighting devices 2 execute the command and adjust their light output accordingly. The left arrow pointing to the hand holding the mobile device indicates capturing the physical environment by taking photos or videos of it.

[0054] Based on image data provided by the mobile device's camera, data processing can begin to identify and map lighting devices. Figure 2 The downward arrow in the middle indicates this.

[0055] Figure 2 The lower part shows the process of identifying and mapping camera data based on the lighting response of the lighting device 2 and including the location data of the lighting device 2.

[0056] exist Figure 2 In the lower middle section, the mobile device's display shows an image of the captured physical environment and an image 2' of the lighting equipment 2 distributed in the physical environment.

[0057] Based on the lighting response and location data, the control unit 3 explicitly assigns each lighting device to the corresponding image 2' displayed on the user interface and the corresponding lighting device 2 in the real world.

[0058] This is shown by bidirectional arrows connecting the lighting devices 2 to their corresponding images 2' on one side, and bidirectional arrows connecting images 2' to items in the device list stored in the control unit (see the left side of the screen below).

[0059] Depending on the implementation, lighting devices may be identified additionally or alternatively based on their shape and / or type.

[0060] In some embodiments, the control unit 3 sends mode instructions to several or all lighting devices. Each device can receive a different or unique mode that can be identified, such as a different color. Therefore, based on their responses, multiple devices can be identified and mapped essentially at once.

[0061] In the case of identifying lighting devices one by one, this process can be repeated until all lighting devices have been identified and mapped.

[0062] Information about the identified and mapped lighting devices (such as device IDs and their locations) can be stored in the memory of the control unit 3, allowing the lighting system to be controlled without further calibration unless new lighting devices are added to the system.

[0063] Figure 3 A flowchart of a process according to an embodiment is shown. According to this embodiment, the method includes sending (step 25) a lighting command to a plurality of lighting devices located in a physical environment to induce an lighting response from the plurality of lighting devices, and capturing (step 30) the physical environment to provide camera data representing the lighting response of the plurality of lighting devices, and including location data representing the location of the plurality of lighting devices in the physical environment.

[0064] Method 20 further includes processing (step 35) camera data to identify at least one lighting device based on its contribution to the lighting response, and mapping (step 40) the at least one identified lighting device to its location in the physical environment based at least in part on location data.

[0065] Figure 4 The workflow of the calibration process for the lighting system according to an embodiment is shown. The calibration process 50 or the quick mapping process can be performed, in particular, by means of the control unit 3 as described above or a mobile application.

[0066] To better illustrate the process, the process steps are arranged in three columns, depending on the functions involved in performing a particular step.

[0067] The steps performed by the control unit 3 are arranged in the first (leftmost) column, the steps involving the communication interface 5 are arranged in the middle column, and the steps performed by the lighting device 2 are arranged in the third column.

[0068] according to Figure 4 In the illustrated embodiment, in the first step 55, the control unit 3 sends a device networking command. The device networking command may include any command associated with establishing wired or wireless communication between the control unit 3 and the lighting device 3. Step 60 indicates that the networking command is sent from the control unit 3 to the newly added lighting device 2. The networking command may specifically include an inquiry as to whether to add any new device to the system or to a group of already installed and mapped lighting devices.

[0069] In the case of adding a new lighting device 2 (step 65), in step 70, when the addition has been successfully completed, the new lighting device 2 can be returned via callback. In transmission step 75, the callback or acknowledgment can be transmitted back to the control unit 3.

[0070] In step 80, upon receiving a callback from the newly added lighting device 2, the control unit 3 generates a lighting command and activates a camera to capture a real-time scene using the lighting response of the lighting device.

[0071] The transmission of a lighting command from the control unit to the lighting device is shown as step 85, and the lighting executed by the lighting device is shown as step 90. This may include turning on the lights, gradually increasing the brightness, or playing a lighting scene so that the newly added device can be recognized by the control unit 3.

[0072] In step 95, the signal from the lighting equipment to the control unit is verified to confirm that the lighting command has been received and successfully executed.

[0073] After successfully identifying and mapping the newly added device, as described above, in steps 55 to 100, the method may include sequentially repeating the above steps for any additional lighting devices newly added to the system. Once identification and mapping are complete, the method may include steps for configuring the newly added device.

[0074] In step 100, based on the image of the newly added lighting device, control icons for configuring the lighting device can be created. In some embodiments, a grayscale image of the scene or physical environment can be displayed on the user interface to achieve better contrast. For example, if only the newly added lighting device is turned on according to a lighting instruction, a bright spot can be identified as the newly added lighting device. In this case, it can be marked, for example, a circle can be drawn around the bright spot, and a control icon can be created at the location of the bright spot on the UI.

[0075] Clicking the circular marker or control icon will bring up a settings menu and / or control panel for configuring and / or controlling newly added lighting equipment, allowing users to configure and control the lighting equipment by operating the control panel.

[0076] In some embodiments, the control panel may include a palette or slider for selecting colors or adjusting any light parameters of the lighting equipment. User input received via the UI can be translated into lighting commands and sent to control newly added lighting equipment; the transmission of lighting commands is illustrated as step 110.

[0077] In step 115, the lighting device executes a control command by correspondingly changing at least one light parameter (e.g., color, brightness, color temperature, etc.).

[0078] Figure 5 An example of a system according to an embodiment is shown. In the illustrated embodiment, the lighting system 1 includes a plurality of lighting devices 2 configured as color-adjustable point light sources arranged in a planar bulb-shaped pattern.

[0079] Control unit 3 is a mobile device on which an application for executing the method is installed.

[0080] The physical environment model, along with the image 2' of the lighting equipment 2, is displayed on the mobile device's UI.

[0081] As described above, the method allows for the identification and mapping of lighting device 2, enabling the establishment of a correspondence between image 2' and physical device 2, as indicated by the double arrows.

[0082] In some embodiments, once the newly added lighting device 2 is identified and mapped, the image 2' of the device is highlighted (e.g., by a circle or marker). Simultaneously, or after a prompt via clicking the marker, a control panel, such as one with a color palette and / or slider, may be displayed. Figure 5 The lower part of the display of the control unit 3 is shown.

[0083] This example demonstrates that lighting systems can be easily expanded by adding and automatically mapping new devices, and can also be controlled in a user-friendly and convenient manner.

[0084] Figure 6 An example of another system according to another embodiment is shown. Specifically, Figure 6 Implementation methods and systems for copying images are shown.

[0085] In this embodiment, the lighting device 2 is configured as a color-adjustable point light source arranged in a 3×5 matrix in a plane. Similar to... Figure 5 Control unit 3 is a mobile device with an application for implementing the above methods.

[0086] Specifically, the control unit 3 is configured to send lighting commands and capture the lighting responses of multiple lighting devices 2, as indicated by the downward-pointing arrows.

[0087] Once the location of the light is detected, those locations and IDs can also be displayed in the application, making it easier to perform various operations.

[0088] In this embodiment of the method, an image 6 is provided for copying. Image 6 can be captured by the camera of the control unit 3, downloaded from the cloud, or retrieved from the storage unit of the control unit 3. In the present case, an image of the Ghanaian flag with colored bars (green, yellow, and red) and an asterisk in the center is used.

[0089] Based on the identification and mapping of the lighting devices performed in the preceding steps, the image can be processed by the control unit, specifically by the processing unit of the control unit, and converted into lighting commands for controlling the lighting devices. The control unit can then send the lighting commands to each lighting device to generate light with colors corresponding to the image and location.

[0090] In this way, virtually any image can be automatically reproduced by a set of lighting devices, provided the lighting devices have been identified and mapped as described above. Therefore, by simply selecting an image, the lights can automatically adjust their colors based on the image, thus allowing for more dynamic effects.

[0091] Seamless control of multiple lighting devices is possible because of the option to send a unique command to multiple devices simultaneously.

[0092] Furthermore, the system can operate completely autonomously, eliminating the need for manual intervention during setup or control, thus enhancing user convenience. Based on predetermined patterns, such as flashing or color changes, it automatically identifies and adjusts lighting equipment without requiring manual intervention.

[0093] Furthermore, once devices are mapped or bound to their respective locations, users can easily control them through the application with intuitive management and minimal effort.

[0094] While at least one exemplary embodiment has been given in the foregoing detailed description, it should be understood that numerous variations exist. It should also be understood that the one or more exemplary embodiments are merely examples and are not intended to limit the scope, applicability, or configuration of this disclosure in any way. Rather, the foregoing detailed description will provide those skilled in the art with a convenient roadmap for implementing one or more exemplary embodiments.

[0095] Reference symbols and numbers

[0096] 1 system

[0097] 2 Lighting equipment

[0098] 3 control units

[0099] 4 light sources

[0100] 5 Communication Interfaces

[0101] 6 images

[0102] 20 methods

[0103] 25 methods and steps 30 methods and steps 35 methods and steps 40 methods and steps 50 methods

[0104] 55 Method Steps 60 Method Steps

[0105] 65 Methods and Steps

[0106] 70 Methods and Steps

[0107] 75 Methods and Steps

[0108] 80 Methods and Steps

[0109] 85 Methods and Steps

[0110] 90 Methods and Steps

[0111] 95 Methods and Steps

[0112] 100 methods and steps

[0113] 105 Methods and Steps

[0114] 110 Method Steps

[0115] 115 Methods and Steps

Claims

1. A method for determining the location of at least one lighting device, comprising: At least one lighting command and / or command sequence is sent (25) to a plurality of lighting devices (2) located in the physical environment to instruct at least one of the lighting devices (2) on how to react. The physical environment is captured (30) to provide camera data representing the lighting response of the plurality of lighting devices (2) and includes location data representing the positions of the plurality of lighting devices (2) in the physical environment. Processing (35) the camera data to identify the at least one lighting device (2) based on its contribution to the lighting response, and At least in part based on the location data, at least one identified lighting device (2) is mapped (40) to the location of the at least one identified lighting device (2) in the physical environment.

2. The method according to claim 1, wherein, Sending the lighting command (25) includes sending a lighting mode command to elicit a mode-based response from the plurality of lighting devices.

3. The method according to claim 2, wherein, The plurality of lighting devices (2) includes one or more groups of lighting devices (2), and wherein sending the lighting command includes sending lighting mode commands with different modes to different devices and / or different groups of devices substantially simultaneously.

4. The method according to claim 3, wherein, Sending the different lighting mode commands includes sending a unique mode to each lighting device.

5. The method according to any one of the preceding claims, the method further comprising detecting whether a new lighting device has been added to the plurality of lighting devices, and if the new lighting device is detected, initiating the identification process by sending a lighting command to the new device.

6. The method according to any one of the preceding claims, wherein, The method further includes displaying the physical environment having an image of the at least one lighting device on a user interface, and creating at least one control icon based on the image of the at least one identified lighting device displayed on the user interface.

7. The method according to any one of the preceding claims, wherein, The at least one lighting device is identified at least in part based on its shape and / or category.

8. The method according to any one of the preceding claims, wherein, The at least one lighting device includes a set of lighting devices configured to reproduce an image, wherein the method further includes: Provide an image for copying. The image is reproduced in the physical environment by generating a command or set of commands based at least in part on the locations of multiple identified and mapped lighting devices in the physical environment and sending the command or set of commands to the multiple identified and mapped lighting devices.

9. A control unit for determining the position of at least one lighting device, comprising: processor, A memory unit for storing data and machine-readable instructions for the processor, and An interface configured to send at least one lighting command and / or command sequence to a plurality of lighting devices positioned in a physical environment to instruct at least one of the lighting devices on how to behave, and configured to receive camera data representing the lighting responses of the plurality of lighting devices and including location data representing the positions of the plurality of lighting devices in the physical environment. The memory unit contains instructions to cause the processor to process the camera data, identify the at least one lighting device based on its contribution to the lighting response, and map the at least one identified lighting device to its location in the physical environment, at least in part, based on location data.

10. A lighting system comprising a plurality of controllable lighting devices deployable in a physical environment, and a control unit of claim 9, the control unit being configured to identify the plurality of lighting devices, map the plurality of lighting devices to their locations in the physical environment, and control the plurality of lighting devices.

Images