System and method for selecting an ambient illuminance threshold
Patent Information
- Application Number
- PCT/EP2025/054613
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-03-05
- Filing Date
- 2025-02-20
- Publication Date
- 2025-10-02
AI Technical Summary
Setting ambient illuminance thresholds for sensor devices, such as motion sensors, is often challenging and typically done through a trial-and-error method, leading to inefficient energy use or delayed activation of downstream processes due to unsuitable threshold settings.
A system and method that utilizes a camera, display, and control system to iteratively adjust ambient illuminance thresholds by visual recording, allowing users to adjust brightness levels until a suitable threshold is reached, facilitated by augmented reality simulations of light sources and motion events.
Enables precise and efficient setting of ambient illuminance thresholds within minutes, optimizing sensor device operations and reducing energy waste or delayed activations by providing a visual and interactive process.
Smart Images

Figure EP2025054613_02102025_PF_FP_ABST
Abstract
Description
[0001] System and method for selecting an ambient illuminance threshold
[0002] FIELD OF THE INVENTION
[0003] The invention relates to a system for selecting an ambient illuminance threshold for a sensor device. The invention further relates to a method for selecting an ambient illuminance threshold for a sensor device.
[0004] BACKGROUND OF THE INVENTION
[0005] Systems for adjusting threshold parameters of sensor devices are known in the art. For instance, US2018308328A1 describes an audio / video (A / V) recording and communication device including a camera, a passive infrared (PIR) sensor, and a light sensor. A method receives a PIR sensor output signal from the PIR sensor, receives image data from the camera, and receives a light sensor output signal from the light sensor. The method determines, using the light sensor output signal and at least one of the PIR sensor output signal and the image data whether to activate recording of the image data, and upon determining to activate recording of the image data, generates an alert. The method transmits the alert to a client device associated with the ATM recording and communication device.
[0006] SUMMARY OF THE INVENTION
[0007] When using sensor devices, e.g., passive infrared sensors (PIR sensors), a user often needs to set thresholds, such as of motion, ambient lighting intensity and / or time, above (or below) which a sensor device sends a signal. For instance, in the context of motion sensing, the user may need to set thresholds for motion, ambient lighting intensity and time to define when a trigger of motion would be valid to turn on the lights or to set a certain (lighting) scene. The threshold for motion may typically be easily tested by the user by moving their hands or posture. However, setting a threshold for the amount of ambient lighting may typically be challenging to test and may in general be done in a trial-and-error way, which means that a user takes a generic threshold and will adapt the threshold when noticing that the threshold was unsuitable. In particular, a user may consider a present threshold too low (or too high) and may thus adjust it, but can only determine the suitability of the new value once ambient illuminance has shifted from the present value, which may be hours later, resulting in long (or “slow”) and cumbersome iterations.
[0008] Such trial-and-error approach may lead to a waste of energy if the threshold is set too low and downstream processes are started prematurely, and may lead to late or absent activation of downstream processes if the thresholds are set too high. For instance, in the context of lighting, a too low threshold may lead to lighting devices being turned on unnecessarily (and potentially detrimentally to the lighting experience). Further, a too high threshold may lead to lighting devices being turned on too late, which may, for instance, lead to poor illumination of an outside area where lighting is motion-controlled. The latter example could be particularly problematic if there is uneven footing or objects someone could move into.
[0009] Hence, it is an aspect of the invention to provide an alternative system and method for selecting an ambient illuminance threshold for a sensor device, which preferably further at least partly obviates one or more of above-described drawbacks. The present invention may have as object to overcome or ameliorate at least one of the disadvantages of the prior art, or to provide a useful alternative.
[0010] According to a first aspect, the invention provides a system for selecting an ambient illuminance threshold (value) for a sensor device, especially for a sensor device having an adaptable ambient illuminance threshold. The system may comprise or be functionally coupled to the sensor device. The system may (further) comprise one or more of a camera, a display, and a control system, especially (each ol) the camera, the display, and the control system. The control system may comprise a user interface for receiving user input. The system, especially the control system, may have an operational mode, especially for selecting and setting the ambient illuminance threshold of the sensor device. In the operational mode, the camera may (be configured to) make a visual recording, such as of an indoor space, or such as of an outdoor space, and to provide a related camera signal to the control system. Further, in the operational mode, the control system may be configured (a) to determine a camera-derived ambient illuminance (or an ambient intensity) based on the related camera signal and (b) to provide an image to the display based on the related camera signal. The operational mode may further comprise an iterative cycle, especially wherein an image is displayed to a user, wherein the user adjusts the brightness of the image, such as via brightness adjustment input, till a suitable brightness is reached. After the iterative cycle, the threshold may be set based on the brightness adjustments made during the iterative cycle. Hence, in the iterative cycle, the display may be configured to display the image (to a user). Further, in the iterative cycle, the control system may be configured to receive user input via the user interface. The control system may be further configured to (a) determine a brightness offset (based on the user input), and (b) to update the image based on the brightness offset, especially based on the related camera signal and the brightness offset. The control system may especially be configured to update the image by one or more of (I) controlling a camera setting of the camera and (II) digital image processing.
[0011] In specific embodiments, the invention may provide a system for selecting an ambient illuminance threshold for a sensor device, wherein the system comprises or is functionally coupled to the sensor device, and wherein the system comprises a camera, a control system, and a display, wherein the control system comprises a user interface, wherein the system has an operational mode wherein: the camera is configured to make a visual recording and to provide a related camera signal to the control system; the control system is configured (a) to determine a camera-derived ambient illuminance based on the related camera signal and (b) to provide an image to the display based on the related camera signal; in an iterative cycle: (I) the display is configured to display the image; (II) the control system is configured to (a) receive user input via the user interface (b) determine or update a brightness offset, and (c) update the image based on the brightness offset; and the control system is configured to set the ambient illuminance threshold based on the camera-derived ambient illuminance and the brightness offset. In particular, in embodiments, the invention may provide a system for selecting an ambient illuminance threshold for a sensor device, wherein the system comprises or is functionally coupled to the sensor device, and wherein the system comprises a camera, a control system, and a display, wherein the control system comprises a user interface, wherein the system has an operational mode wherein: the camera makes a visual recording and provides a related camera signal to the control system; the control system (a) determines a camera-derived ambient illuminance based on the related camera signal and (b) provides an image to the display based on the related camera signal; in an iterative cycle: (I) the display displays the image; (II) the control system (a) receives user input via the user interface (b) determines or updates a brightness offset, and (c) updates the image based on the brightness offset; and the control system sets the ambient illuminance threshold based on the camera-derived ambient illuminance and the brightness offset.
[0012] With such system, a user can precisely set a suitable ambient illuminance threshold (value) within minutes. In particular, the user can visualize how the space looks with different amounts of ambient illuminance (or “with different brightness”) and visually determine the illuminance level that corresponds to the desired threshold value. In particular, with the system of the invention a user can use the camera, e.g., their smartphone camera, to scan the environment where the sensor is placed in. Scanning can be done by real-time enabling the camera and showing the visual recording on the display, or by taking a picture of the environment and showing the picture on the display. The system may, for instance, be configured to change the camera exposure to change the brightness / darkness of video / picture shown on the display in dependence of user input. Further, by changing exposure compensation, the system may facilitate setting the level of darkness at which a sensor device, e.g., a motion sensor, should activate.
[0013] Further, the system may facilitate placing a light in Augmented Reality (AR) in the view (also see further below). Placing a light in AR may provide a more authentic representation of different ambient lighting situations in the space. E.g., the light may be placed spatially overlapping with an actual light source, e.g., a street lantern, to account for lighting, e.g., time-controlled lighting, by that light source. The light may also be placed to simulate the sun. For instance, the AR light may allow visualizing the ambient illuminance due to sunlight at different times of day, optionally taking into account the current day arc or the day arc of a different time of year. Further, the AR light may, for instance, also visualize motion sensor events by turning on or off and showing an effect thereof, e.g., a lighting effect. This is helpful, as in case the sensor would trigger a physical light already, it will influence the measurements.
[0014] Hence, the invention may provide a system for selecting an ambient illuminance threshold (value) for a sensor device.
[0015] The term “ambient illuminance threshold” (or “ambient illuminance threshold value”) herein refers to a (threshold) value for a sensor device, wherein an operation of the sensor device is influenced by the value of ambient illuminance in relation to the ambient illuminance threshold. A typical example would be a motion sensor that is configured to activate a lighting device when sensing motion, wherein the motion sensor is configured to only detect motion and / or to only activate the lighting device when sensing motion if the ambient lighting is below an ambient illuminance threshold, e.g., the motion sensor may be configured not to activate an outdoor lighting device on a sunny afternoon. However, the sensor device may also be configured only to detect and / or act on a detected value if the ambient lighting exceeds an ambient illuminance threshold. For instance, the sensor device may be configured to close curtains or blinds when the ambient illuminance is above an ambient illuminance threshold. Typically, the operation of the sensor device may depend on whether the ambient illuminance is above or below the ambient illuminance threshold. However, in embodiments, the operation of the sensor device may (also) depend on the difference between the ambient illuminance and the ambient illuminance threshold, such as wherein a sensitivity for a sensed parameter scales depending on the ambient illuminance threshold.
[0016] Hence, in embodiments, the sensor device may comprise an illuminance sensor and a motion sensor. In such embodiments, the illuminance sensor may be configured to detect the ambient illuminance (in the space) to provide a sensor-derived ambient illuminance (or “sensor-based ambient illuminance value”). Further, especially in a sensing mode (of the sensor device), the motion sensor may be configured to detect motion. In particular, the motion sensor may be configured to (only) detect motion when the sensor- derived ambient illuminance is below the ambient illuminance threshold. In further embodiments, the motion sensor may be configured to detect motion (irrespective of the sensor-derived ambient illumination relative to the threshold), and (only) to act upon detected motion if the sensor-derived ambient illuminance is below the ambient illuminance threshold.
[0017] In further embodiments, the sensor device may be comprised by or functionally coupled to a lighting device, wherein the lighting device is configured to provide lighting device light when the motion sensor detects motion, especially when the motion sensor detects motion while the sensor-derived ambient illuminance is below the ambient illuminance threshold.
[0018] The sensor device may especially have an adaptable ambient illuminance threshold, i.e., the ambient illuminance threshold of the sensor device may be adjusted (physically or digitally). For instance, in embodiments, the sensor device may be configured to receive adjustment input and to adjust the ambient illuminance threshold when receiving the adjustment input. In further embodiments, the control system (of the system) may be configured to adjust the ambient illuminance threshold of the sensor device, especially by providing the adjustment input to the sensor device.
[0019] The term “sensor device” may herein refer to any device configured to sense a parameter, including a plurality of parameters. The sensor device may, for instance, comprise a visual sensor, an auditive sensor, a temperature sensor, a pressure sensor, a radio frequency (RF) sensor, a motion sensor, such as a (passive) infrared sensor (or “PIR sensor”), or such as a gyroscope, etc. In embodiments, the sensor device may comprise (at least) a motion sensor, such as a PIR sensor. In further embodiments, the sensor device may comprise (at least) an RF sensor. The sensor device may (further) especially be configured to sense or obtain an ambient illuminance (value) and to (physically or digitally) compare the value to an ambient illuminance threshold. Hence, in embodiments, the sensor device may comprise (at least) an illuminance sensor. In further embodiments, the sensor device may be configured to obtain the ambient illuminance (value) from a second device, wherein the sensor device is functionally coupled to the second device. For instance, the sensor device may be functionally coupled to the control system and be configured to receive (or “obtain”) the ambient illuminance (value) from the control system. In further embodiments, the sensor device may be functionally coupled to a dedicated illuminance sensor and be configured to receive (or “obtain”) the ambient illuminance (value) from the dedicated illuminance sensor.
[0020] In embodiments, the system may be functionally coupled to the sensor device, especially (at least) during the operational mode. For instance, the system and the sensor device may be connected via a wire, e.g., for data transfer. Alternatively or additionally, the system and the sensor device may be connected wirelessly, such as on the basis of one or more of Bluetooth, Thread, WIFI, LiFi, ZigBee, BLE and WiMAX. In specific embodiments, the sensor device or packaging thereof may comprise a scannable code, e.g., a QR code, wherein the scannable code is scannable by the system, especially by the camera, and wherein scanning of the scannable code by the system results (directly or indirectly) in a functional coupling between the system and the sensor device. The system and the sensor device may especially be temporarily functionally coupled for setting the ambient illuminance threshold.
[0021] In embodiments, the system may comprise the sensor device, i.e., the sensor device may be part of the system. In embodiments, the sensor device may be physically separated from other components of the system, e.g., from the camera, the display and / or the control system. In further embodiments, the sensor device may be integrated in a common structure with other system components, such as in the handheld device (see below).
[0022] The system may further comprise a camera. The camera may especially be configured to make a visual recording, such as a photo or a video. In particular, the camera may be configured for recording (or “imaging”) in the visible wavelength range, e.g., in the range of about 400 to about 700 nm. The camera may, in embodiments, be selected from the group comprising a (digital) photo camera, a (digital) video camera, a smartphone camera, a tablet camera, and a (built-in) webcam.
[0023] In embodiments, the visual recording may comprise a (single) photo.
[0024] In further embodiments, the visual recording may comprise a video recording. In such embodiments, the image may especially comprise a plurality of frames successively arranged in time (also see below). In particular, the camera may be configured for making a visual recording and for providing a related camera signal to the control system. The camera may especially be configured to make a visual recording in or of a space, especially an indoor space, or especially an outdoor space, and may especially provide raw and / or processed data corresponding to the visual recording to the control system.
[0025] The term “related camera signal” may herein refer to a signal that is related to the visual recording. In particular, the related camera signal may comprise raw and / or processed data related to the visual recording. The related camera signal may especially comprise raw and / or processed data relating to a recorded image, e.g., a photo or a video, particularly wherein the data is suitable for reproducing the image digitally.
[0026] The space may essentially be any space where a illuminance-dependent sensor device may be used. The space may, for instance, be an indoor space, such as a (storage) room, a hallway, a cabinet, or a fuse box, especially a room. Alternatively, the space may be an outdoor space, such as a garden, a courtyard, a balcony, a gallery walkway, a road, a park, or a path.
[0027] The system may, in further embodiments, comprise a display. The display may be configured for displaying an image, such as for displaying a photo, and / or such as for displaying a video. The display may, for instance, be selected from the group comprising a monitor, a TV-screen, a laptop screen, a tablet screen, a smartphone screen, and a digital picture frame.
[0028] In embodiments, one or more of the camera, the display, the control system, and the user interface may be integrated in a handheld device. Especially, the display, the control system, and the user interface may be integrated in the handheld device. Such embodiments may facilitate moving in or around the space in order to evaluate the brightness offset in different viewpoints. The handheld device may be a dedicated handheld device, i.e., a device specifically designed to execute the operational mode. However, the handheld device may also be multi-purpose handheld device, such as a smartphone. Hence, in further embodiments, the handheld device may especially be selected from the group comprising a tablet and a smartphone. In further embodiments, the handheld device may comprise a smartphone.
[0029] The system may, in embodiments, further comprise a control system. The control system may be configured to control one or more other elements of the system, such as the camera and / or the display. In embodiments, the control system may be configured to set an ambient illuminance threshold for the sensor device. In further embodiments, the control system may be configured to control the sensor device.
[0030] The term “controlling” and similar terms especially refer at least to determining the behavior or supervising the running of an element. Hence, herein “controlling” and similar terms may e.g. refer to imposing behavior to the element (determining the behavior or supervising the running of an element), etc., such as e.g. measuring, displaying, actuating, opening, shifting, changing temperature, etc.. Beyond that, the term “controlling” and similar terms may additionally include monitoring. Hence, the term “controlling” and similar terms may include imposing behavior on an element and also imposing behavior on an element and monitoring the element. The controlling of the element can be done with a control system, which may also be indicated as “controller”. The control system and the element may thus at least temporarily, or permanently, functionally be coupled. The element may comprise the control system. In embodiments, the control system and element may not be physically coupled. Control can be done via wired and / or wireless control. The term “control system” may also refer to a plurality of different control systems, which especially are functionally coupled, and of which e.g. one control system may be a master control system and one or more others may be slave control systems. A control system may comprise or may be functionally coupled to a user interface.
[0031] The control system may, in embodiments, thus comprise a user interface. The user interface may be configured for receiving input from a user. Generally, the user interface may comprise a keyboard or touchscreen for receiving tactile input. Alternatively, the user interface may comprise a microphone for receiving audio input, such as for receiving speech input. Yet further, the user interface may comprise a (second) camera for receiving visual input. The user interface may be arranged remote from a primary location of the control system.
[0032] Hence, in embodiments, the system may comprise a camera, a control system, and a display, wherein the control system comprises a user interface, and especially wherein the control system is configured to control the camera and the display.
[0033] The control system may also be configured to receive and execute instructions from a remote control. In embodiments, the control system may be controlled via an App on a device, such as a portable device, like a Smartphone or I-phone, a tablet, etc..
[0034] The system, especially the control system, may be configured for executing an operational mode. In particular, the operational mode may comprise a series of steps for selecting an ambient illuminance threshold for a sensor device. Hence, the system, or apparatus, or device may execute an action in a “mode” or “operation mode” or “mode of operation” or “operational mode”. The term “operational mode may also be indicated as “controlling mode”. Likewise, in a method an action or stage, or step may be executed in a “mode” or “operation mode” or “mode of operation” or “operational mode”. This does not exclude that the system, or apparatus, or device may also be adapted for providing another controlling mode, or a plurality of other controlling modes. Likewise, this may not exclude that before executing the mode and / or after executing the mode one or more other modes may be executed.
[0035] However, in embodiments a control system may be available, that is adapted to provide at least the operational mode. Would other modes be available, the choice of such modes may especially be executed via a user interface, though other options, like executing a mode in dependence of a sensor signal or a (time) scheme, may also be possible. The operational mode may in embodiments also refer to a system, or apparatus, or device, that can only operate in a single operational mode (i.e. “on”, without further tunability).
[0036] The operational mode may especially comprise a recording stage, a (first) processing stage, an iterating stage, and a threshold setting stage. In the recording stage, the camera may make a visual recording and may provide related camera signal to the control system. In the processing stage, the control system may derive a (camera-derived) ambient illuminance from the related camera signal, especially from the visual recording, and may, based on the recording, provide an image to the display. In the iterating stage, a user may iteratively provide input on whether the brightness threshold should be higher or lower than what the user sees in the presented image, whereupon the control system adjusts the image based on the user input. Finally, in the threshold setting stage, e.g., reached when the user is content with the brightness level in the image, the control system may set the ambient illuminance threshold in the sensor device.
[0037] The term “stage” and similar terms used herein may refer to a (time) period (also “phase”) of a method and / or an operational mode. The different stages may (partially) overlap (in time). For example, the recording stage may, in general, be initiated prior to the processing stage, but may partially overlap in time therewith. However, for example, the iterating stage may typically (though not necessarily) be completed prior to the threshold setting stage. It will be clear to the person skilled in the art how the stages may be beneficially arranged in time. For example, the recording stage may occur simultaneously with the processing stage and the iterating such that the image may be based on a live recording while modified based on the brightness offset. In the operational mode, especially in the recording stage, the camera may (be configured to) make a visual recording and to provide a related camera signal to the control system.
[0038] Further, in the operational mode, especially in the processing stage, the control system may (be configured to) determine a camera-derived ambient illuminance or a camera- derived ambient intensity based on the related camera signal, especially based on the visual recording. In further embodiments, the control system may (be configured to) determine the camera-derived ambient illuminance based on the related camera signal. In further embodiments, the control system may (be configured to) determine the camera-derived ambient intensity based on the related camera signal.
[0039] The term “camera-derived ambient illuminance” (or “camera-derived ambient illuminance value”) may herein refer to a value for the ambient illuminance at the time of the visual recording and as recorded by the camera. In particular, the camera-derived ambient illuminance may essentially be the lux incident on a camera surface, e.g., a lens surface, of the camera as the camera makes the visual recording. The camera-derived ambient illuminance may be indicative of the ambient illuminance in the space.
[0040] Yet further, in the operational mode, especially in the processing stage, the control system may (be configured to) provide an image to the display based on the visual recording. Generally, the image may essentially correspond to the visual recording. However, (post-)processing of the related camera signal is not excluded. For instance, the control system may be configured to straighten a skew or shaky recording (e.g., by cropping or video stabilization) and / or to digitally suppress glare or reflections.
[0041] The processing stage may especially comprise providing an initial image to the display.
[0042] In embodiments, the camera may, especially during the operational mode, be configured to (essentially) continuously make the visual recording and to (essentially continuously) provide the related camera signal to the control system. In such embodiments, the control system may (be configured to) (essentially) continuously update the image based on the related camera signal, and especially also based on the brightness offset (see below).
[0043] In further embodiments, the camera may, especially during the operational mode, be configured to (essentially) intermittently make the visual recording and to (intermittently) provide the related camera signal to the control system. In such embodiments, the control system may (be configured to) update the image based upon receiving a (new) related camera signal, and especially also based on the brightness offset (see below). The operational mode, especially the iterating stage, may further comprise an iterative cycle. During the iterative cycle, a user may iteratively (or repeatedly) change a brightness level of the image on the display until the brightness level of the displayed image matches the ambient illuminance threshold desired by the user.
[0044] The term “iterative cycle” may herein especially refer to a multi-step process occurring in iterations. For instance, in a first iteration, the display may display an (initial) image, and, based on the user input, the control system may determine a brightness offset and provide an updated (second) image to the display. In the second iteration, the display may then display the updated (second) image, and, based on the user input, the control system may update the brightness offset and provide an updated (third) image to the display. Et cetera. The iterative cycle may continue (essentially) indefinitely or may be actively or passively terminated by the user. For instance, the user interface may be configured for receiving completion input (or “finalization input”) via which the user can indicate that the iterative process is to be terminated. Alternatively or additionally, the system may be configured to terminate the iterative cycle after a (predetermined) duration without user input, e.g., for 10 minutes. Alternatively or additionally, the system may be configured to terminate the iterative cycle when the system is switched off, especially when the handheld device (see below) is switched off, or when a computer program product, such as an App, for executing the operational mode is terminated.
[0045] Although there may generally be multiple iterations, it will be clear to the person skilled in the art that the system may also allow a user to directly approve of the brightness level in the initial image or, e.g., in the second image (i.e., during the second iteration).
[0046] In the iterative stage, especially in the iterative cycle, the display may (be configured to) display the image (to a user).
[0047] Further, in the iterative stage, especially in the iterative cycle, the control system may (be configured to) (a) receive user input via the user interface, (b) determine or update a brightness offset based on the user input, and (c) update the image based on the brightness offset.
[0048] In particular, the control system may, during the iterative stage, especially in the iterative cycle, (be configured to) receive user input (from a user) related to image brightness. For instance, the user interface may be configured to receive the ambient illuminance threshold should be placed at a higher level or at a lower level than what the user presently sees in the image, .i.e., at a higher or lower image brightness, respectively. The user interface may comprise a user interface element for receiving the user input, especially a digital user interface element. The user interface element may comprise a (digital) button, such as a plurality of (digital) buttons. For instance, a first button could be used to provide user input indicating that the ambient illuminance threshold should be placed at a higher level and a second button could be used to provide user input indicating that the ambient illuminance threshold should be placed at a lower level. In further embodiments, there could be multiple buttons for increasing and decreasing the brightness offset (also see below), wherein the different buttons correspond to different step sizes. In further embodiments, the user interface element may comprise numerical values and may be configured to allow the user to provide a desired numerical value for the brightness offset. Such embodiments may allow precise control over the exact value that is set by the user. In further embodiments, the user interface element may comprise a (digital) brightness slider, especially spanning from a substantial negative brightness offset at one side of the slider and a substantial positive brightness offset at the other side of the slider. Such slider may be particularly convenient as it provides an intuitive interface for the user. It will be clear to the person skilled in the art that many more possibilities exist for the user interface element.
[0049] Further, the control system may, during the iterative stage, especially in the iterative cycle, be configured to determine or update a brightness offset based on the user input. If the user indicates that the ambient illuminance threshold should be higher, the control system may determine that the brightness offset should be positive or, if a brightness offset was already set (in a previous iteration of the iterative cycle), the control system may increase the value of the brightness offset. Analogously, if the user indicates that the ambient illuminance threshold should be lower, the control system may determine that the brightness offset should be negative or, if a brightness offset was already set (in a previous iteration of the iterative cycle), the control system may decrease the value of the brightness offset.
[0050] Yet further, the control system may, during the iterative stage, especially in the iterative cycle, be configured to update the image based on (at least) the brightness offset. In particular, the control system may be configured to update the image by one or more of (I) controlling a camera setting of the camera and (II) digital image processing, especially by controlling a camera setting, or especially be digital image processing.
[0051] Hence, in embodiments, the control system may be configured to update the image by controlling a camera setting of the camera. In such embodiments, the camera may make a new visual recording and provide a (new) related camera signal to the control system, which provides an updated image to the display based on the (new) related camera signal. Such embodiments may be particularly suitable in the context of (live) video recordings, i.e., the camera may, during the operational mode, continuously make the visual recording and provide the related camera signal to the control system, wherein the control system is configured to (essentially) continuously provide an (updated) image to the display based on the related camera signal and the brightness offset. Such embodiments may facilitate quickly assessing the suitability of different brightness levels (or “brightness offsets”) at different spots and / or views of the space.
[0052] In embodiments, the control system may be configured to implement the brightness offset by modifying a camera setting of the camera, especially a camera setting selected from the group comprising shutter speed, aperture, and ISO sensitivity. In particular, in further embodiments, the camera setting may comprise an exposure setting, especially an exposure setting selected from the group comprising shutter speed and aperture. The term “exposure” may herein refer to the amount of light that reaches the camera, especially during a visual recording. The exposure of a camera may primarily be influenced by the shutter speed (the amount of time taken to record an image) and the aperture (the size of the opening of the aperture blades of a camera lens).
[0053] Alternatively or additionally, the control system may be configured to update the image by (digital) image processing. It will be clear to the person skilled in the art that modifying an image to increase (or decrease) a brightness of the image can be done in a multitude of ways and that the present invention is not limited to a specific implementation thereof. For instance, the control system may implement the brightness offset by increasing or decreasing the brightness of individual pixels in the image. Such increasing (or decreasing) of the brightness may e.g., be done by multiplying RGB values of each pixel with a constant k, wherein k > 0 and k 1, and especially wherein after multiplication RGB values exceeding 255 are reduced to 255. Alternatively, for example, the increasing (or decreasing) of the brightness may e.g., be done by adding a constant m to RGB values of each pixel, wherein m 0, and wherein m is selected from the range of -255 - 255, such as from the range of -200 - 200, especially from the range of -100 - 100, such as from the range of -50 - 50. After the addition with m, RGB values below 0 may especially be increased to 0 and RGB values above 255 may especially be reduced to 255.
[0054] In principle, the control system may continue digitally adjusting the image directly. For instance, with respect to a (single) photo, the control system may first multiply the RGB values with a value of k=1.3 and subsequently with a value of k=0.9, which would effectively result in a multiplication of 1.17. However, as RGB values may typically be restricted to the range of 0-255, some of the color differences in the image may get lost through such successive multiplication: initial values of 200, 230 and 255 all become 255 after multiplication with k=1.3 and all become 230 after the subsequent multiplication with k=0.9.
[0055] Hence, rather than providing an updated image based on the image and the brightness offset, the control system may be configured to provide the updated image based on the related camera signal, especially the visual recording, and the brightness offset. Thereby, the image quality does not deteriorate through successive changes in the iterative cycle.
[0056] An iteration of the iterative cycle may typically end with the control system providing an updated image, especially based on (at least) the brightness offset and the related camera signal. Subsequently, in the next iteration of the iterative cycle, the display may (be configured to) display the updated image.
[0057] In embodiments, in the operational mode, the control system may (further) (be configured to) set the ambient illuminance threshold (in the sensor device), especially based on the camera-derived ambient illuminance and the brightness offset. In embodiments, the control system may (be configured to) set the ambient illuminance threshold as part of the iterative cycle, e.g., whenever the brightness offset is updated. Such embodiments may provide a convenient operation as the user may not need to actively confirm the setting, and may ensure that a brightness offset determined via one or more iterations is not inadvertently lost by, for instance, switching off the system or a computer program product running thereon. Alternatively, the control system may (be configured to) set the ambient illuminance threshold once the user indicates the image has a suitable brightness. The user interface may, for instance, be configured to receive completion input (also see above) from the user when the user is ready to finalize the process (or “operational mode”).
[0058] The control system may be configured to directly set the ambient illuminance threshold, i.e., the control system may directly control the settings of the sensor device. Alternatively, the control system may be configured to indirectly set the ambient illuminance threshold, i.e., the control system may be configured to provide the ambient illuminance threshold to the sensor device, wherein the sensor device sets the ambient illuminance threshold, optionally after requesting a confirmation. Hence, in embodiments, the control system may be functionally coupled to the sensor device and may be configured to provide the ambient illuminance threshold to the sensor device and, in such embodiments, the sensor device may be configured to receive an ambient illuminance threshold (value), and especially to set the ambient illuminance threshold based on the received value.
[0059] The control system may thus be configured to determine the ambient illuminance threshold based on the camera-derived ambient illuminance and the brightness offset. In particular, the camera-derived ambient illuminance provides an indication of the ambient illuminance in the space during the operational mode, and the brightness offset provides an indication where the threshold should he relative to the ambient illuminance in the space during the operational mode. Together, these parameters thus in principle facilitate setting a suitable threshold for the sensor device.
[0060] However, depending on the locations of the sensor device and the camera, the illuminance experienced by the sensor device and the camera may (substantially) differ. This could in principle be tackled by the user by making the image from the location where the sensor device is located, but this location could be inconvenient to reach (e.g., high on a wall), and the viewpoint from this location may not be representative of the experience of the user in the space. Hence, in embodiments, the control system may further obtain the ambient illuminance as detected (or “experienced”) by the sensor device, and may set the ambient illuminance threshold (also) based on this value.
[0061] In further embodiments, as also described above, the sensor device may comprise an illuminance sensor. The illuminance sensor may be configured to detect the ambient illuminance to provide a sensor-derived ambient illuminance. In such embodiments, the control system may be configured to set, especially in the operational mode, the ambient illuminance threshold based on the camera-derived ambient illuminance, the brightness offset, and the sensor-derived ambient illuminance. Such embodiments may facilitate more accurately setting the appropriate ambient illuminance threshold in the sensor device.
[0062] For instance, the control system may be configured to obtain the sensor- derived ambient illuminance from the sensor device. Especially, the sensor device may be configured to provide the sensor-derived ambient illuminance to the control system. In such embodiments, the control system may determine a suitable ambient illuminance threshold by taking into account the (relative) values of the camera-derived ambient illuminance and the camera-derived ambient illuminance (and the brightness offset). For instance, if the sensor- derived ambient illuminance and the camera-derived ambient illuminance are essentially the same, the brightness offset may be essentially directly applicable as an (absolute or relative) adjustment factor for setting the ambient illuminance threshold, e.g.: ambient illuminance threshold = sensor-derived ambient illuminance + brightness offset. If, however, the sensor- derived ambient illuminance is substantially higher (or lower) than the camera-derived ambient illuminance, the ambient illuminance threshold may be selected such that a difference between the sensor-derived ambient illuminance and the ambient illuminance threshold is larger (or smaller) than the brightness offset, e.g.: (ambient illuminance threshold - sensor-derived ambient illuminancel > brightness offset.
[0063] Hence, the system, especially the camera and the control system, can measure the amount of brightness under the conditions of the camera making the visual recording. Further, the system, especially the control system, may be configured to obtain information from the sensor device on how much lumen that has measured as a reference. Thereby, when the user visually sets the suitable brightness threshold, the control system may calculate the corresponding ambient illuminance threshold for the sensor device.
[0064] As described above, the control system may further be configured for placing a light generating device in augmented reality. The term “augmented reality” may herein refer to a combination of real-world and computer-generated content. In particular, the control system may provide the image on the basis of the (real-world) visual recording but may ‘augment’ the image with computer-generated components, such as objects that may block lighting, or such as additional source of (ambient) light.
[0065] The use of augmented reality may facilitate further exploring the effects of a specific brightness offset (or of an ambient illuminance threshold). For instance, if other light generating devices with respective ambient illuminance thresholds are present, such light generating devices may activate prior to the sensor device, which may further influence what a suitable ambient illuminance threshold for the sensor device would be. Further, the use of augmented reality may facilitate exploring the effects of other light sources, such as timedependent light sources, e.g., the sun and street lighting, and such as light generating devices in other (adjoining) spaces or in the (same) space, e.g., a television.
[0066] For instance, in embodiments, the control system 300 may be configured to simulate virtual sunlight entering through a window, especially at different times of day, and / or especially at different times of year.
[0067] In further embodiments, the control system may be configured to simulate virtual device light (in an augmented reality simulation), wherein the image comprises (at least part ol) the virtual device light. Especially, in the operational mode, such as in the processing stage, the control system may (be configured to) provide the image based on the related camera data, especially the visual recording, and the virtual device light. The control system may especially be configured to simulate a virtual light generating device, especially wherein the virtual light generating device is configured to generate virtual device light. The term “virtual light generating device” may also refer to a plurality of (different) virtual light generating devices, i.e., the control system may be configured to simulate a plurality of virtual light generating device, especially wherein the virtual light generating devices are arranged at different (augmented reality) locations, such as at different locations in the 3D space (see below).
[0068] Hence, in further embodiments, the control system may be configured to simulate a virtual light generating device and virtual device light (from that virtual light generating device), especially in an augmented reality simulation. In particular, the control system may be configured to simulate a virtual light generating device providing virtual device light (in an augmented reality simulation). In such embodiments, the image may (also) comprises (at least part ol) the virtual device light. Further, in such embodiments, the image may (also) comprise (at least part ol) the virtual light generating device
[0069] As described above, simulating a light generating device in AR may facilitate taking into account how (real-world) light generating devices are configured to operate at different ambient illuminance values.
[0070] Hence, in embodiments, the control system may be configured to simulate (a virtual light generating device providing) virtual device light (in an augmented reality simulation). The virtual light generating device may especially be configured to switch between a first lighting mode and a second lighting mode based on a virtual ambient illuminance threshold, wherein the first lighting mode and the second lighting mode differ in one or more of intensity, color point, direction (or “orientation”), and spatial distribution of the virtual device light, especially in one or more of intensity, color point and direction (or “orientation”). In such embodiments, in the operational mode, the control system may (be configured to) provide the (initial) image based on the visual recording, the camera-derived ambient illuminance and the virtual ambient illuminance threshold. In further embodiments, in the operational mode, especially in the iterating stage, the control system may be configured to update the image based on the visual recording, the brightness offset, and the virtual ambient illuminance threshold.
[0071] As atypical example, the first lighting mode may be ‘off and the second lighting mode may be ‘on’, i.e., the virtual light generating device may be configured to provide virtual device light in the second lighting mode but not in the first lighting mode (i.e., intensity=O during the first lighting mode). Alternatively, the virtual light generating device may be configured to provide virtual device light in both the second lighting mode and in the first lighting mode, but the virtual device light differs between the first lighting mode and the second lighting mode.
[0072] In particular, in embodiments, the control system may be configured to generate a 3D map based on the visual recording, especially a 3D map of the space, such as a 3D map of the indoor space. In such embodiments, the control system may be configured to simulate the virtual light generating device at a location in the 3D map. Especially, the control system may (further) be configured to simulate the virtual light generating device providing virtual device light from the location. In such embodiments, the control system may be configured to provide the image (at least partially) based on the 3D map, such as based on the location of the virtual light generating device in the 3D map and on a recording location of the visual recording in the 3D map.
[0073] In a further aspect, the invention may provide a lighting device selected from the group of a lamp and a luminaire. The lighting device may, in embodiments, especially comprise the system of the invention. In further embodiments, the lighting device may comprise or be functionally coupled to the sensor device, especially comprise (at least) the sensor device, or especially be functionally coupled to the sensor device. In embodiments, the lighting device may be configured to provide lighting device light in dependence of the sensor device, such as when a motion sensor (comprised by the sensor device) detects motion, especially when the sensor-derived ambient illuminance is below the ambient illuminance threshold.
[0074] The luminaire may further comprise a housing, optical elements, louvres, etc. etc... The lamp or luminaire may further comprise a housing enclosing the light generating system. The lamp or luminaire may comprise a light window in the housing or a housing opening, through which the system light may escape from the housing. In yet a further aspect, the invention also provides a projection device comprising the light generating system as defined herein. Especially, a projection device or “projector” or “image projector” may be an optical device that projects an image (or moving images) onto a surface, such as e.g. a projection screen. The projection device may include one or more light generating systems such as described herein. Hence, in an aspect the invention also provides a lighting device selected from the group of a lamp, a luminaire, a projector device, a disinfection device, a photochemical reactor, and an optical wireless communication device, comprising the light generating system as defined herein. The lighting device may comprise a housing or a carrier, configured to house or support, one or more elements of the light generating system. The lighting device may be part of or may be applied in e.g. office lighting systems, household application systems, shop lighting systems, home lighting systems, accent lighting systems, spot lighting systems, theater lighting systems, fiber-optics application systems, projection systems, self-lit display systems, pixelated display systems, segmented display systems, warning sign systems, medical lighting application systems, indicator sign systems, decorative lighting systems, portable systems, automotive applications, (outdoor) road lighting systems, urban lighting systems, green house lighting systems, horticulture lighting, digital projection, or LCD backlighting. The light generating system (or luminaire) may be part of or may be applied in e.g. optical communication systems or disinfection systems.
[0075] The lighting device may comprise a Hue-based light generating device, such as available from Philips, or similar type lighting devices.
[0076] In a further aspect, the invention may provide a method for selecting an ambient illuminance threshold for a sensor device. The method may comprise making a visual recording with a camera and providing a related camera signal. The method may further comprise determining a camera-derived ambient illuminance based on the related camera signal, especially based on the visual recording. In embodiments, the method may comprise providing an image based on the related camera signal, especially based on the visual recording. The method may especially comprise (executing) an iterative cycle comprising (a) displaying the image, (b) receiving user input, (c) determining or updating a brightness offset based on the user input, and (d) updating the image based on the brightness offset. In further embodiments, the method may comprise setting the ambient illuminance threshold based on the camera-derived ambient illuminance and the brightness offset.
[0077] In specific embodiments, the invention may provide a method for selecting an ambient illuminance threshold for a sensor device, wherein the method comprises making a visual recording with a camera and providing a related camera signal; determining a camera- derived ambient illuminance based on the visual recording; providing an image based on the related camera signal; and in an iterative cycle: (a) displaying the image; (b) receiving user input; (c) determining or updating a brightness offset based on the user input; and (d) updating the image based on the brightness offset; and setting the ambient illuminance threshold based on the camera-derived ambient illuminance and the brightness offset.
[0078] Hence, the method may comprise making a visual recording (of a space) with a camera, and may further comprise providing a related camera signal. In embodiments, the visual recording may comprise a (single) photo. In further embodiments, the visual recording may comprise a video recording. The related camera signal may comprise raw and / or processed data related to the visual recording.
[0079] The method may especially comprise a recording stage, a (first) processing stage, an iterating stage, and a threshold setting stage.
[0080] The method, especially the recording stage, may further comprise determining a camera-derived ambient illuminance based on the related camera signal, especially based on the visual recording.
[0081] The method, especially the (first) processing stage, may further comprise providing an image based on the related camera signal, especially based on the visual recording. In embodiments, the image may be a (static) photo. In further embodiments, the image may comprise a plurality of frames successively arranged in time, i.e., the image may be a (live) video.
[0082] The method, especially the iterative stage, may comprise (executing) an iterative cycle. In particular, the iteractive cycle may comprise (iteratively) (a) displaying the image, especially on a (digital) display, such as on a smartphone screen; (b) receiving user input, especially via a user interface, such as via a keyboard or a touchscreen; (c) determining or updating a brightness offset based on the user input; and (d) updating the image based on the brightness offset, especially by one or more of adjusting a camera setting of the camera and (II) digital image processing. Hence, a first iteration of the iterative cycle may comprise steps a-d resulting in an updated image, which may be shown in step a of a second iteration of the iterative cycle.
[0083] In embodiments, the method may comprise updating the image by adjusting a camera setting, such as an exposure setting. Hence, the method may comprise implementing the brightness offset by adjusting a camera setting, such as one or more of shutter speed, aperture and ISO sensitivity, especially an exposure setting selected from the group comprising shutter speed and aperture.
[0084] In further embodiments, the method may comprise updating the image by digital image processing. Hence, the method may comprise implementing the brightness offset by digitally adjusting the brightness in the image, such as by changing RGB values of pixels in the image.
[0085] In embodiments, the method may further comprise setting the ambient illuminance threshold based on the camera-derived ambient illuminance and the brightness offset, especially during the iterative stage, such as when determining the brightness offset, or especially after the iterative stage. In further embodiments, the method may comprise acquiring a sensor-derived ambient illuminance from the sensor device (see above). In such embodiments, the method may especially comprise setting the ambient illuminance threshold based on the sensor- derived ambient illuminance, the camera-derived ambient illuminance and the brightness offset.
[0086] In further embodiments, the method may comprise acquiring a plurality of sensor-derived ambient illuminance (values) from the sensor device (see above) at different levels of ambient illuminance. In such embodiments, the method may comprise setting the ambient illuminance threshold based on the plurality of sensor-derived ambient illuminances, the camera-derived ambient illuminance and the brightness offset. Having access to a plurality of sensor-derived ambient illuminance (values) at different levels of ambient illuminance may facilitate (the control system to) more accurately determining a suitable threshold value as the (e.g., linear) relationship between ambient illuminance and sensor- derived ambient illuminance may be estimated more accurately.
[0087] The method may, in embodiments, further comprise simulating virtual device light (in an augmented reality simulation), and providing an image comprising (at least part of) the virtual device light. Hence, in embodiments, the image may comprise (at least part ol) the virtual device light.
[0088] In further embodiments, the method may comprise simulating a virtual light generating device and virtual device light (in an augmented reality simulation), and providing an image comprising (at least part ol) the virtual device light.
[0089] As described above, the simulating of a virtual light generating device may be particularly convenient when the space includes a light generating device with an activity depending on time and / or illuminance. Hence, in embodiments, the method may comprise simulating (a virtual light generating device providing) virtual device light (in an augmented reality simulation). Especially, in the simulation, the virtual light generating device may be configured to switch between a first lighting mode and a second lighting mode based on a virtual ambient illuminance threshold, especially wherein the first lighting mode and the second lighting mode differ in one or more of intensity, color point and orientation of the virtual device light. In such embodiments, the method may comprise providing the (initial) image based on the visual recording, the camera-derived ambient illuminance and the virtual ambient illuminance threshold. Further, in such embodiments, the method may comprise updating the image based on the visual recording, the brightness offset, and the virtual ambient illuminance threshold. In a further aspect, the invention may provide a kit of parts. The kit of parts may especially comprise a handheld device and a sensor device. In embodiments, the handheld device may comprise the system of the invention. In further embodiments, the handheld device may especially comprise a smartphone, e.g., a smartphone running a (dedicated) computer program product (or “app”) for executing the method of the invention. In further embodiments, the handheld device, especially the system, may be configured for selecting an ambient illuminance threshold for the sensor device. Hence, the handheld device, especially the system, may be configured for (temporarily) functionally coupling with the sensor device.
[0090] In a further aspect, the invention may provide a computer program product comprising instructions for execution on a control system functionally coupled to a system of the invention, such as for execution on a control system of the handheld device of the kit of parts. The instructions, when executed by the control system, may especially cause the system to carry out the method of the invention.
[0091] In a further aspect, the invention may provide a data carrier, carrying thereupon program instructions which, when executed by a control system functionally coupled to a system of the invention, such as by a control system of the handheld device of the kit of parts, cause the control system to carry out the method of the invention.
[0092] In yet a further aspect, the invention (thus) provides a software product, which, when running on a control system, e.g., of a computer or a smartphone, is capable of bringing about (one or more embodiments of) the method as described herein.
[0093] Instead of the terms “lighting device” or “lighting system”, and similar terms, also the terms “light generating device” or “light generating system”, (and similar terms), may be applied. A lighting device or a lighting system may be configured to generate device light (or “lighting device light”) or system light (“or lighting system light”).
[0094] BRIEF DESCRIPTION OF THE DRAWINGS
[0095] Embodiments of the invention will now be described, by way of example only, with reference to the accompanying schematic drawings in which corresponding reference symbols indicate corresponding parts, and in which:
[0096] Fig. 1A-B schematically depict embodiments of the system of the invention; Fig. 2 schematically depicts an embodiment of the method of the invention. The schematic drawings are not necessarily to scale. DETAILED DESCRIPTION OF THE EMBODIMENTS
[0097] Fig. 1A schematically depicts an embodiment of a system 1000 for selecting an ambient illuminance threshold for a sensor device 20, especially wherein the system 1000 comprises or is functionally coupled to the sensor device 20. In the depicted embodiment, the system 1000 comprises a camera 210, a control system 300, and a display 230, wherein the control system 300 comprises a user interface 301.
[0098] In the depicted embodiment, the system 1000 is arranged in a space 1300, especially in an indoor space. The space 1300 comprises a floor 1305, a wall 1307 comprising a window 1308, and a ceiling 1310. The space 1300 may be illuminated via the window 1308, as well as via one or more lighting devices 1200. Although the lighting devices 1200 may, in principle, be controlled to explore a few different illuminance levels in the space 1300 for determining a parameter for the ambient illuminance threshold. However, the effect of light coming in through the window 1308 can typically not be accounted for, except by waiting for the time of day and / or time of year to change. The system 1000 of the invention may, however, facilitate conveniently accounting for such variations.
[0099] In particular, the system 1000, especially the control system, may have an operational mode for selecting an ambient illuminance threshold for a sensor device 20. The operational mode may especially comprise a recording stage, a (first) processing stage, an iterating stage, and a threshold setting stage.
[0100] In the operational mode, especially in the recording stage, the camera 210 may be configured to make a visual recording and to provide a related camera signal to the control system 300. The visual recording may, in embodiments, comprise a (single) photo. In further embodiments, the visual recording may comprise a video recording.
[0101] Further, in the operational mode, especially in the processing stage, the control system 300 may be configured to determine a camera-derived ambient illuminance based on the related camera signal, especially based on the visual recording. In addition, in the operational mode, especially in the processing stage, the control system 300 may be configured to provide an image 30 based on the related camera signal, especially based on the visual recording, and to provide the image 30 to the display 230. The image 30 may, in embodiments, comprise a single frame. In further embodiments, the image 30 may comprise a plurality of frames, successively arranged in time.
[0102] The operational mode, especially the iterative stage, may further comprise an iterative cycle. The iterative cycle may comprise one or more iterations, wherein in each iteration: the display 230 is configured to display the image 30; and the control system 300 is configured (a) to receive user input via the user interface 301, (b) to determine or update a brightness offset based on the user input, and (c) to update the image 30 based on the brightness offset.
[0103] In further embodiments, the control system 300 may be configured to set the ambient illuminance threshold based on the camera-derived ambient illuminance and the brightness offset.
[0104] In the depicted embodiment, the sensor device 20 may especially be functionally coupled to one of the lighting devices 1200. The lighting device 1200 (functionally coupled to the sensor device 20) may be configured to provide lighting device light 1201 in dependence of a sensor signal from the sensor device 20, e.g., when a motion sensor 22 of the sensor device detects motion and the sensor-derived ambient illuminance is below the ambient illuminance threshold.
[0105] Fig. 1 A further schematically depicts a lighting device 1200 selected from the group of a lamp 1 and a luminaire 2, comprising the system 1000 of the invention. The lighting device 1200 may especially be configured to provide lighting device light 1201 in dependence of a signal from the sensor device 20, e.g., when a sensor-derived ambient illuminance is below the ambient illuminance threshold.
[0106] Fig. IB schematically depicts a further embodiment of the system 1000. In particular, Fig. IB schematically depicts a handheld device 200 comprising the system 1000. In the depicted embodiment, the handheld device 200 may especially be a smartphone running a computer program product for executing the operational mode of the system. Analogously, the smartphone may run a computer program product for executing the method of the invention.
[0107] In particular, the camera 210, the control system 300, and the display 230 may be integrated in the handheld device 200. For visualizational purposes only, the control system and the camera 210 are not depicted in Fig. IB; the control system 300 may be inside of the handheld device 200 and the camera 210 may be arranged at the backside (opposite of the display 230) of the handheld device 200. The display 230 is depicted, and schematically depicts a (part ol) the space 1300 shown in Fig. 1A. In particular, the camera 210 may have made a visual recording of part of the space 1300, and the control system 300 has provided a corresponding image 30 to the display 230.
[0108] In the depicted embodiment, the user interface comprises a (digital) user interface element 303 for receiving the user input, especially wherein the user interface element 303 comprises a (digital) brightness slider. As schematically depicted by the color gradient, the user may decrease the brightness offset by sliding the brightness slider left and may increase the brightness offset by sliding the slider right.
[0109] Fig. IB further schematically depicts an image 30 comprising a virtual light generating device 150 and virtual device light 151. In particular, the virtual light generating device 150 is configured overlapping with a lighting device 1200 (see Fig. 1A) and may be used to simulate the generation of lighting device light 1201 by the lighting device 1200. In the depicted embodiment, the control system 300 is configured to simulate a virtual light generating device 150 and virtual device light 151, wherein the image 30 comprises (at least part of) the virtual device light 151.
[0110] In further embodiments, the control system 300 may be configured to simulate the virtual light generating device 150 and the virtual device light 151, wherein the virtual light generating device 150 is configured to switch between a first lighting mode and a second lighting mode based on a virtual ambient illuminance threshold. The first lighting mode and the second lighting mode may especially differ in one or more of intensity, color point and orientation of the virtual device light 151. Further, in the operational mode, especially in the iterative stage, the control system 300 may be configured to update the image 30 based on the visual recording, the brightness offset and the second ambient illuminance threshold.
[0111] The control system 300 may, in embodiments, further be configured to generate a 3D map (of the space 1300), especially based on the related camera signal, such as based on the visual recording. Additionally or alternatively, the control system 300 may be configured to generate the 3D map (of the space 1300) using one or more of a stereo camera and LiDAR (or “Light Detection And Ranging”). In further embodiments, the control system 300 may especially be configured to simulate the virtual light generating device 150 at a location in the 3D map, wherein the control system 300 is configured to provide the image 30 (at least partially) based on the 3D map (and the location of the virtual light generating device 150 therein).
[0112] In a yet further embodiment, the control system 300 may be configured to simulate virtual sunlight entering through the window 1308, especially at different times of day, and / or especially at different times of year.
[0113] In embodiments, the camera 210 may (be configured to) continuously make the visual recording and provide the related camera signal to the control system 300. In such embodiments, the control system 300 may (be configured to) continuously update the image 30 based on the related camera signal, the brightness offset, and optionally also based on the second ambient lighting threshold. Although the camera 210 may be held in place during the making of the visual recording, the camera 210 may also be moved around to inspect the effect of the brightness offset on different views of the space 1300. As the virtual light generating device 150 may be assigned to a specific location, the control system 300 may be configured to account for movement and / or rotation relative to the virtual light generating device 150, e.g., to have the virtual light generating device 150 depicted in Fig. IB illuminate from the back if the user would turn around.
[0114] Fig. IB further schematically depicts an embodiment wherein the system comprises the sensor device 20. In particular, in the depicted embodiment, the sensor device 20 comprises an illuminance sensor 21 and a motion sensor 22. The illuminance sensor 21 may be configured to detect the ambient illuminance to provide a sensor-derived ambient illuminance. Further, in a sensing mode (of the sensor device) the motion sensor 22 may (be configured to) detect motion (only) when a condition of the sensor-derived ambient illuminance relative to the ambient illuminance threshold is met, e.g., when the sensor- derived ambient illuminance is below the ambient illuminance threshold.
[0115] Fig. IB further schematically depicts an embodiment of a kit of parts comprising a handheld device 200 and a sensor device 20. In the depicted embodiment, the handheld device 200 comprises the system 1000 of the invention, wherein the system 1000 is configured for selecting an ambient illuminance threshold for the sensor device 20.
[0116] Fig. 2 schematically depicts an embodiment of the system 1000. The hyphened arrows schematically represent the (directional) flow of information between the camera 210, the display 230, the control system 300, the user interface 301 (connected to the control system 300), and the sensor device 20. In particular, in the depicted embodiment, the control system 300 may: (a) receive a related camera signal from the camera 210, (b) adjust a camera setting of the camera 210, (c) provide an image to the display 230, (d) receive user input via the user interface 301, (e) receive a sensor-derived ambient illuminance from the sensor device 20, and (1) provide the ambient illuminance threshold to the sensor device 20.
[0117] Fig. 2 further schematically depicts an embodiment of the method of the invention. In the depicted embodiment, the method comprises making a visual recording with a camera 210 and providing a related camera signal. The method further comprises determining a camera-derived ambient illuminance based on the related camera signal, especially based on the visual recording, as well as providing providing an image 30 based on the related camera signal, especially based on the visual recording. The method further comprises an iterative cycle including the steps: (a) displaying the image 30, especially on a display 230; (b) receiving user input, especially via a user interface 301; (c) determining or updating a brightness offset based on the user input; and (d) updating the image 30 based on the brightness offset. The method may further comprise setting the ambient illuminance threshold (in / for the sensor device 20) based on the camera-derived ambient illuminance and the brightness offset.
[0118] The method is further schematically depicted in Fig. IB.
[0119] In particular, in the depicted embodiment, the method further comprises simulating a virtual light generating device 150 and virtual device light 151 (in an augmented reality simulation), wherein the image 30 comprises (at least part ol) the virtual device light 151.
[0120] In further embodiments, the method may comprise simulating a virtual light generating device 150 and virtual device light 151 (in an augmented reality simulation), wherein the virtual light generating device 150 is configured to switch between a first lighting mode and a second lighting mode based on a virtual ambient illuminance threshold, wherein the first lighting mode and the second lighting mode differ in one or more of intensity, color point and orientation of the virtual device light 151. In particular, in such embodiments, the method may comprise updating the image 30 based on the visual recording, the brightness offset, and the virtual ambient illuminance threshold.
[0121] The term “plurality” refers to two or more.
[0122] The terms “substantially” or “essentially” herein, and similar terms, will be understood by the person skilled in the art. The terms “substantially” or “essentially” may also include embodiments with “entirely”, “completely”, “all”, etc. Hence, in embodiments the adjective substantially or essentially may also be removed. Where applicable, the term “substantially” or the term “essentially” may also relate to 90% or higher, such as 95% or higher, especially 99% or higher, even more especially 99.5% or higher, including 100%.
[0123] The term “comprise” also includes embodiments wherein the term “comprises” means “consists of’.
[0124] The term “and / or” especially relates to one or more of the items mentioned before and after “and / or”. For instance, a phrase “item 1 and / or item 2” and similar phrases may relate to one or more of item 1 and item 2. The term "comprising" may in an embodiment refer to "consisting of' but may in another embodiment also refer to "containing at least the defined species and optionally one or more other species".
[0125] Furthermore, the terms first, second, third and the like in the description and in the claims, are used for distinguishing between similar elements and not necessarily for describing a sequential or chronological order. It is to be understood that the terms so used are interchangeable under appropriate circumstances and that the embodiments of the invention described herein are capable of operation in other sequences than described or illustrated herein.
[0126] The devices, apparatus, or systems may herein amongst others be described during operation. As will be clear to the person skilled in the art, the invention is not limited to methods of operation, or devices, apparatus, or systems in operation.
[0127] It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design many alternative embodiments without departing from the scope of the appended claims.
[0128] In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim.
[0129] Use of the verb "to comprise" and its conjugations does not exclude the presence of elements or steps other than those stated in a claim. Unless the context clearly requires otherwise, throughout the description and the claims, the words “comprise”, “comprising”, and the like are to be construed in an inclusive sense as opposed to an exclusive or exhaustive sense; that is to say, in the sense of “including, but not limited to”.
[0130] The article "a" or "an" preceding an element does not exclude the presence of a plurality of such elements.
[0131] The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In a device claim, or an apparatus claim, or a system claim, enumerating several means, several of these means may be embodied by one and the same item of hardware. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage. In yet a further aspect, the invention (thus) provides a software product, which, when running on a computer is capable of bringing about (one or more embodiments ol) the method as described herein.
[0132] The invention also provides a control system that may control the device, apparatus, or system, or that may execute the herein described method or process. Yet further, the invention also provides a computer program product, when running on a computer which is functionally coupled to or comprised by the device, apparatus, or system, controls one or more controllable elements of such device, apparatus, or system.
[0133] The invention further applies to a device, apparatus, or system comprising one or more of the characterizing features described in the description and / or shown in the attached drawings. The invention further pertains to a method or process comprising one or more of the characterizing features described in the description and / or shown in the attached drawings.
[0134] The various aspects discussed in this patent can be combined in order to provide additional advantages. Further, the person skilled in the art will understand that embodiments can be combined, and that also more than two embodiments can be combined. Furthermore, some of the features can form the basis for one or more divisional applications.
Claims
CLAIMS:
1. A system (1000) for selecting an ambient illuminance threshold for a sensor device (20), wherein the system (1000) comprises a camera (210), a control system (300), and a display (230), wherein the control system (300) comprises a user interface (301), wherein the system (1000) has an operational mode wherein: the camera (210) is configured to make a visual recording and to provide a related camera signal to the control system (300); the control system (300) is configured (a) to determine a camera-derived ambient illuminance based on the related camera signal and (b) to provide an image (30) to the display (230) based on the related camera signal; in an iterative cycle: the display (230) is configured to display the image (30); and the control system (300) is configured (a) to receive user input via the user interface (301), (b) to determine or update a brightness offset based on the user input, and (c) to update the image (30) based on the brightness offset; and the control system (300) is configured to set the ambient illuminance threshold based on the camera-derived ambient illuminance and the brightness offset.
2. The system (1000) according to claim 1, wherein the control system (300) is configured to simulate a virtual light generating device (150) and virtual device light (151), wherein the image (30) comprises the virtual device light (151).
3. The system (1000) according to claim 1, wherein the control system (300) is configured to simulate a virtual light generating device (150) providing virtual device light (151), wherein the virtual light generating device (150) is configured to switch between a first lighting mode and a second lighting mode based on a virtual ambient illuminance threshold, wherein the first lighting mode and the second lighting mode differ in one or more of intensity, color point, and direction of the virtual device light (151), and wherein the control system (300) is configured to update the image (30) based on the related camera signal, the brightness offset, and the virtual ambient illuminance threshold.
4. The system (1000) according to any one of the preceding claims, wherein the visual recording comprises a photo.
5. The system (1000) according to any one of the preceding claims 1-3, wherein the visual recording comprises a video recording, and wherein the image (30) comprises a plurality of frames successively arranged in time.
6. The system (1000) according to claim 5, wherein during the operational mode: the camera (210) is continuously making the visual recording and providing the related camera signal to the control system (300); and the control system (300) is continuously updating the image (30) based on the related camera signal.
7. The system (1000) according to claim 6, wherein the control system (300) is configured to implement the brightness offset by modifying a camera setting of the camera (210), wherein the camera setting comprises an exposure setting.
8. The system (1000) according to any one of the preceding claims 1-6, wherein the control system (300) is configured to implement the brightness offset by digitally modifying brightness in the image.
9. The system (1000) according to any one of the preceding claims, wherein the system comprises the sensor device (20), wherein the sensor device (20) comprises an illuminance sensor (21) and a motion sensor (22), wherein the illuminance sensor (21) is configured to detect the ambient illuminance to provide a sensor-derived ambient illuminance, and wherein in a sensing mode the motion sensor (22) is configured to detect motion when the sensor-derived ambient illuminance is below the ambient illuminance threshold.
10. The system (1000) according to claim 9, wherein the motion sensor (22) comprises a passive infrared sensor, and wherein in the operational mode the control system (300) is configured to set the ambient illuminance threshold based on the camera-derived ambient illuminance, the brightness offset, and the sensor-derived ambient illuminance.
11. A lighting device (1200) selected from the group of a lamp (1) and a luminaire (2), comprising the system (1000) according to any one of the preceding claims 1-10, wherein the lighting device (1200) is configured to provide lighting device light (1201) in dependence of a sensor signal from the sensor device (20).
12. A method for selecting an ambient illuminance threshold for a sensor device (20), wherein the method comprises: making a visual recording with a camera (210) and providing a related camera signal; determining a camera-derived ambient illuminance based on the related camera signal; providing an image (30) based on the related camera signal; in an iterative cycle: displaying the image (30); receiving user input; determining or updating a brightness offset based on the user input; and updating the image (30) based on the brightness offset; and setting the ambient illuminance threshold based on the camera-derived ambient illuminance and the brightness offset.
13. The method according to claim 12, wherein the method comprises simulating a virtual light generating device (150) providing virtual device light (151), wherein the image (30) comprises the virtual device light (151).
14. The method according to claim 12, wherein the method comprises: simulating a virtual light generating device (150) and virtual device light(151), wherein the virtual light generating device (150) is configured to switch between a first lighting mode and a second lighting mode based on a virtual ambient illuminance threshold, wherein the first lighting mode and the second lighting mode differ in one or more of intensity, color point and direction of the virtual device light (151); and updating the image (30) based on the related camera signal, the brightness offset, and the virtual ambient illuminance threshold.
15. A kit of parts comprising a handheld device (200) and a sensor device (20), wherein the handheld device (200) comprises the system (1000) according to any one of the preceding claims 1-10, wherein the system (1000) is configured for selecting an ambient illuminance threshold for the sensor device (20).