Determining vertical illuminance data

A system using personal device cameras to estimate vertical illuminance by capturing calibration images and calculating a calibration factor addresses the need for cost-effective and efficient lighting optimization in office spaces, enhancing energy efficiency and comfort.

WO2026233860A1PCT designated stage Publication Date: 2026-11-12SIGNIFY HOLDING BV
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
PCT/EP2026/062594
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2025-05-21
Filing Date
2026-04-30
Publication Date
2026-11-12

AI Technical Summary

Technical Problem

Existing methods for determining vertical illuminance data in office spaces require expensive dedicated measurement equipment and recalibration after furniture rearrangement, failing to provide a cost-effective and efficient solution for optimizing lighting conditions.

Method used

A system and method using personal device cameras to capture calibration images at different screen luminance levels, calculating a calibration factor to estimate vertical illuminance based on brightness differences, enabling cost-effective determination and optimization of lighting conditions without dedicated equipment.

Benefits of technology

Enables accurate determination of vertical illuminance data using personal device cameras, reducing costs and allowing for informed lighting adjustments to enhance energy efficiency, comfort, and compliance with lighting standards.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure EP2026062594_12112026_PF_FP_ABST
    Figure EP2026062594_12112026_PF_FP_ABST
Patent Text Reader

Abstract

A system (21) for enabling determination of vertical illuminance data is configured to obtain first and second calibration images depicting a user (61) of a personal device (21) captured of a location by a camera (28) of the personal device while a display (29) of the personal device is at low and high luminance screen output, respectively, determine first and second brightness values of the user's face (62) in the first and second calibration images, determine a difference in average brightness of at least one part of the user's face, estimate a display contribution to the vertical illuminance of the user's face based on differences in luminance between the display at low and high luminance screen output and further based on an optical model, and calculate a calibration factor of the camera of the personal device based on the difference in average brightness and the display contribution.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] 2024PF80312

[0002] 1

[0003] DETERMINING VERTICAL ILLUMINANCE DATA

[0004] FIELD OF THE INVENTION

[0005] The invention relates to a system for enabling determination of vertical illuminance data.

[0006] The invention further relates to a method of enabling determination of vertical illuminance data.

[0007] The invention also relates to a computer program product enabling a computer system to perform such a method.

[0008] BACKGROUND OF THE INVENTION

[0009] Vertical illuminance data is important information for building managers. Vertical illuminance refers to the amount of light falling on a vertical surface. It is typically measured in lux (lx) and is a key consideration in lighting design for spaces where vertical surfaces (like walls or displays) need to be well lit. Vertical illuminance data can be used in several ways to optimize the lighting conditions within a building. For example, by understanding the vertical illuminance levels, the building manager can identify areas where lighting might be excessive or insufficient. This information can help in optimizing energy usage by adjusting or replacing light fixtures to provide the necessary illumination without wasting energy.

[0010] Furthermore, proper vertical illuminance contributes to the overall comfort and productivity of occupants. For example, in office settings, well-lit vertical surfaces can reduce eye strain and improve the visibility of documents or screens placed on walls.

[0011] Moreover, many buildings need to comply with specific lighting standards and regulations. Measuring vertical illuminance helps ensure that the building meets these requirements, which can be important for obtaining certifications or passing inspections.

[0012] Proper vertical illuminance also ensures that a user’s face is illuminated properly. This specifically refers to the amount of light directed towards a person's face. It is crucial in videoconferencing to ensure that the participant's face is clearly visible and well-lit for the camera.2024PF80312

[0013] 2

[0014] To prevent shadows on people’s faces (leading to unattractive appearance) and to properly facilitate people working in offices (mostly sitting down), it is important to administer appropriate vertical illuminance at desks, meeting tables, and sit-down areas. As it is hard to model vertical illumination precisely, with furniture and natural light influencing these vertical light levels, there are companies that have proposed calibrating the vertical illuminance in office spaces with elaborate visits utilizing dedicated measurement equipment. However, those visits are very expensive and re-calibration of the vertical illumination in the office space is required after each reconfiguration of the office furniture.

[0015] While dedicated solutions are known that consider the illumination of a user’s face as one of the parameters when adjusting the room lighting during videoconference, they do not enable the determination of vertical illuminance data, e.g., for use by a building manager.

[0016] For example, US 2012 / 0200660 Al describes techniques for active lighting control in video teleconferencing (VTC) systems. A video teleconferencing device receives lighting data from cameras in a room where a VTC is taking place and accesses lighting profiles for the lights in the room from a lighting control system. The lighting profiles are created during a calibration process, where the effect of each light on the lighting parameters is measured by turning each light source off and on individually. The VTC device compares the current lighting conditions to a target model and uses the lighting profiles to select lights to turn on or off via the lighting control system to improve the lighting. The VTC device monitors the lighting conditions during the conference and re-adjusts the lights if a large change occurs.

[0017] SUMMARY OF THE INVENTION

[0018] It is advantageous to provide a system and method, which enable determination of vertical illuminance data which can be used by a building manager without requiring the utilization of dedicated measurement equipment.

[0019] In a first aspect, a system for enabling determination of vertical illuminance data comprises at least one input interface and at least one processor configured to obtain, via the at least one input interface, one or more first calibration images captured of a location by a camera of a personal device while a display of the personal device is at low luminance screen output and one or more second calibration images captured of the location by the camera of the personal device while the display of the personal device is at high luminance screen output, the calibration images depicting a user of the personal device, determine first2024PF80312

[0020] 3

[0021] brightness values of the user’s face in the one or more first calibration images and second brightness values of the user’s face in the one or more second calibration images, and determine a difference in average brightness of at least one part of the user’s face between the first brightness values and the second brightness values.

[0022] The at least one processor is further configured to estimate a display contribution to the vertical illuminance of the user’s face based on differences in luminance between the display at low luminance screen output and the display at high luminance screen output and further based on an optical model, the display contribution indicating how much light from the display is estimated to contribute to the vertical illuminance of the user’s face, and calculate a calibration factor of the camera of the personal device based on the difference in average brightness and the display contribution, the calibration factor allowing another average brightness of the at least one part of the user’s face in one or more other images to be translated to an estimate of vertical illuminance of the user’s face.

[0023] Thus, this calibration factor enables vertical illuminance data to be determined, e.g., at a height of four feet. With this vertical illuminance data, a building manager may make informed decisions to enhance the lighting environment, improve energy efficiency, and ensure the safety and comfort of the building's occupants. For example, the high-quality cameras integrated into laptops may be used to monitor the lighting conditions in the workplace. The calibration images may be captured during one or more video conferencing sessions using the personal device, for example. The camera of a laptop, which is typically on during video calls, is well suited to monitor the quality and amount of light received at the user’s face, from the environment and from the display.

[0024] Calibration is important, because each office space has different vertical illumination depending on which task lights, ceiling lights and large luminous surfaces are present and the location relative to windows and (colored) walls also plays a role in the vertical illuminance. There is hence a need for a calibration factor to map brightness values extracted from captured images to the vertical illumination for this specific office / location.

[0025] By using a calibration which determines based on a vertical illumination difference created with a display of a personal device, the correlation between the vertical illumination difference and a difference in average brightness in images capturing this vertical illumination difference, it becomes possible to determine vertical illuminance estimates from further images captured by the cameras of the personal devices after the calibration. By using camera images captured by personal devices to determine the vertical illuminance data, no dedicated measurement equipment is required, and cost may be reduced.2024PF80312

[0026] 4

[0027] With a crowd-sourced approach, vertical illumination may be optimized in a space using cameras from multiple personal devices in the space providing images across multiple time periods of the day or across multiple usages of the space. This cost-effective crowd-sourcing approach may involve the analysis of the appearance of people's faces on video conferencing images to map the vertical illumination at four feet height. This can be used to improve the vertical illuminance at various locations in the workplace, e.g., towards generally accepted / standardized targets. This improves the quality of the workplace.

[0028] The system may further comprise at least one output interface and the at least one processor may be further configured to obtain, via the at least one input interface, one or more further images captured of the location by the camera of the personal device, the one or more further images depicting the user of the personal device, determine further brightness values based on the one or more further images, determine a further average brightness of at least one part of the user’s face from the further brightness values, determine an estimate of vertical illuminance of the user’s face by applying the calibration factor to the further average brightness, and output the vertical illuminance estimate via the at least one output interface.

[0029] The at least one processor may be configured to determine whether a change has occurred in a furniture arrangement at the location and / or in a field of view of the camera of the personal device between a moment the calibration images were captured and a moment the one or more further images are captured, and if a change has occurred in the furniture arrangement and / or in the field of view, obtain new calibration images and recalculate the calibration factor before determining the vertical illuminance estimate.

[0030] The at least one processor may be configured to determine one or more of a current time of day, a current date, one or more current positions of one or more window blinds, and one or more current settings of one or more lighting devices, and output one or more of the current time of day, the current date, the one or more current positions of one or more window blinds, and the one or more current settings of one or more lighting devices as metadata to the vertical illuminance estimate via the at least one output interface.

[0031] The at least one processor may be configured to determine a distribution of the one or more further brightness values across the user’s face, identify one or more lighting devices that contribute to the illumination of the user’s face, based on the determined distribution, and adjust, via the at least one output interface, light settings of the one or more lighting devices based on the distribution of the one or more further brightness values across the user’s face to minimize differences in brightness values across the distribution.2024PF80312

[0032] 5

[0033] The at least one processor may be configured to identify the one or more lighting devices by identifying shadows from the determined distribution of brightness values across the user’s face, obtaining information indicative of locations, orientations, and light distributions of a plurality of lighting devices in a space, and identifying the one or more lighting devices based on the shadows and the locations, orientations, and light distributions of the plurality of lighting devices.

[0034] The at least one processor may be further configured to obtain further information specifying details related to how natural daylight interacts with the space throughout the day, the details comprising at least a directionality of the natural daylight entering the space and identifying the one or more lighting devices further based on the details related to the natural daylight.

[0035] The at least one processor may be configured to obtain, via the at least one input interface, one or more third calibration images captured of the location by a further camera not included in the personal device while the display of the personal device is at low luminance screen output and one or more fourth calibration images captured of the location by the further camera while the display of the personal device is at high luminance screen output, the third and fourth calibration images depicting the user of the personal device and being synchronized with the first and second calibration images, and determine the first brightness values of the user’s face in the first and third calibration images and the second brightness values of the user’s face in the second and fourth calibration images.

[0036] In a second aspect, a method of enabling determination of vertical illuminance data comprises obtaining one or more first calibration images captured of a location by a camera of a personal device while a display of the personal device is at low luminance screen output and one or more second calibration images captured of the location by the camera of the personal device while the display of the personal device is at high luminance screen output, the calibration images depicting a user of the personal device, determining first brightness values of the user’s face in the one or more first calibration images and second brightness values of the user’s face in the one or more second calibration images, and determining a difference in average brightness of at least one part of the user’s face between the first brightness values and the second brightness values.

[0037] The method further comprises estimating a display contribution to the illuminance of the user’s face based on differences in luminance between the display at low luminance screen output and the display at high luminance screen output and further based on an optical model, the display contribution indicating how much light from the display is2024PF80312

[0038] 6

[0039] estimated to reach the user’s face and contribute to the vertical illuminance of the user’s face, and calculating a calibration factor of the camera of the personal device based on the difference in average brightness and the display contribution, the calibration factor allowing another average brightness of the at least one part of the user’s face in one or more other images to be translated to an estimate of vertical illuminance of the user’s face. The method may be performed by software running on a programmable device. This software may be provided as a computer program product.

[0040] Moreover, a computer program for carrying out the methods described herein, as well as a non-transitory computer readable storage-medium storing the computer program are provided. A computer program may, for example, be downloaded by or uploaded to an existing device or be stored upon manufacturing of these systems.

[0041] In another aspect, a non-transitory computer-readable storage medium stores a software code portion, the software code portion, when executed or processed by a computer, being configured to perform the method described above.

[0042] As will be appreciated by one skilled in the art, aspects of the present invention may take the form of a device, a method or a computer program product. Accordingly, aspects of the present invention may take the form of an entirely hardware implementation, an entirely software implementation (including firmware, resident software, micro-code, etc.) or an implementation combining software and hardware aspects that may all generally be referred to herein as a "circuit", "module" or "system." Functions described in this disclosure may be implemented as an algorithm executed by a processor / microprocessor of a computer.

[0043] Furthermore, aspects of the present invention may take the form of a computer program product in one or more computer readable medium(s) having computer readable program code stored thereon.

[0044] Any combination of one or more computer readable medium(s) may be utilized. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a computer readable storage medium may include, but are not limited to, the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable readonly memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable2024PF80312

[0045] 7

[0046] combination of the foregoing. In the context of the present invention, a computer readable storage medium may be any tangible medium that can contain, or store, a program for use by or in connection with an instruction execution system, apparatus, or device.

[0047] A computer readable signal medium may include a propagated data signal with computer readable program code included therein, for example, in baseband or as part of a carrier wave. Such a propagated signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.

[0048] Program code on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber, cable, RF, etc., or any suitable combination of the foregoing. Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java(TM), Swift, Dart, Python, Go, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).

[0049] Aspects of the present invention are described below with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to implementations of the present invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor, in particular a microprocessor or a central processing unit (CPU), of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer, other programmable data processing apparatus, or other devices create means for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.2024PF80312

[0050] 8

[0051] These computer program instructions may also be stored in a computer readable medium that can direct a computer, other programmable data processing apparatus, or other devices to function in a particular manner, such that the instructions stored in the computer readable medium produce an article of manufacture including instructions which implement the function / act specified in the flowchart and / or block diagram block or blocks.

[0052] The computer program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0053] The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of devices, methods and computer program products according to various implementations of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and / or flowchart illustrations, and combinations of blocks in the block diagrams and / or flowchart illustrations, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

[0054] BRIEF DESCRIPTION OF THE DRAWINGS

[0055] These and other aspects of the invention are apparent from and will be further elucidated, by way of example, with reference to the drawings, in which:

[0056] Fig. l is a block diagram of an implementation of the system;

[0057] Fig. 2 is a flow chart of a first implementation of the method;

[0058] Fig. 3 shows an example of a space in which the system of Fig. 1 may be used; Fig. 4 is a flow chart of a second implementation of the method;

[0059] Fig. 5 is a flow chart of a third implementation of the method;

[0060] Fig. 6 is a flow chart of a fourth implementation of the method;2024PF80312

[0061] 9

[0062] Fig. 7 is a flow chart of a fifth implementation of the method;

[0063] Fig. 8 is a flow chart of a sixth implementation of the method;

[0064] Fig. 9 is a flow chart of a seventh implementation of the method; and Fig. 10 is a block diagram of an exemplary data processing system for performing the methods of the invention.

[0065] Corresponding elements in the drawings are denoted by the same reference numeral.

[0066] DETAILED DESCRIPTION

[0067] Fig. 1 shows an implementation of the system for enabling determination of vertical illuminance data. In the implementation of Fig. 1, the system is a personal computer 21. The personal computer 21, a central local computer 45, a light controller 43, and a security camera 49 are connected to a wireless LAN access point 41. The wireless LAN access point 41 is connected to the Internet 31. The security camera 49 may be a Hue Secure camera, for example.

[0068] The personal computer 21, e.g., a laptop, may be used, for example, for video conferencing, e.g., with another person connected to the Internet 31. In the example of Fig. 1, only one personal device is shown, personal computer 21, but many personal devices may be connected to the same wireless LAN access point and many personal devices may be connected to the network to which the wireless LAN access point(s) belong.

[0069] In the example of Fig. 1, lighting devices 51-54 are connected to the light controller 43, e.g., via Zigbee. The light controller 43 may control the lighting devices 51-54 based on a schedule, based on input received from one or more sensors, and / or based on input received from one or more connected light switches (not shown in Fig. 1), for example.

[0070] Alternatively, an Internet server 33 may control the lighting devices 51-54 via the light controller 51-54 or may control the lighting devices 51-54 directly.

[0071] The personal computer 21 comprises a receiver 23, a transmitter 24, a processor 25, a memory 27, an embedded camera 28, and a display 29. The processor 25 is configured to obtain one or more first calibration images captured of a location by the camera 28 while the display 29 is at low luminance screen output and one or more second calibration images captured of the location by the camera 28 while the display 29 is at high luminance screen output. The calibration images depict a user of the personal computer 21.

[0072] The processor 25 is further configured to determine first brightness values of the user’s face in the one or more first calibration images and second brightness values of the2024PF80312

[0073] 10

[0074] user’s face in the one or more second calibration images and determine a difference in average brightness of at least one part of the user’s face between the first brightness values and the second brightness values.

[0075] The processor 25 is further configured to estimate a display contribution to the vertical illuminance of the user’s face based on differences in luminance between the display at low luminance screen output and the display at high luminance screen output and further based on an optical model. This display contribution indicates how much light from the display is estimated to contribute to the vertical illuminance of the user’s face.

[0076] The processor 25 is further configured to calculate a calibration factor of the camera of the personal device based on the difference in average brightness and the display contribution. This calibration factor allows another average brightness of the at least one part of the user’s face in one or more other images to be translated to an estimate of vertical illuminance of the user’s face.

[0077] In the implementation of Fig. 1, the processor 25 is further configured to obtain one or more further images captured of the location by the camera 28, determine further brightness values based on the one or more further images, and determine a further average brightness of at least one part of the user’s face from the further brightness values. The one or more further images depict the user of the personal computer 21.

[0078] The processor 25 is further configured to determine an estimate of vertical illuminance of the user’s face by applying the calibration factor to the further average brightness and transmit the vertical illuminance estimate via the transmitter 24 to the central local computer 45 or to a cloud server. The calibration images and / or the further images may be captured during one or more video conferencing, e.g., Teams, sessions using the personal computer 21.

[0079] The central local computer 45 is connected to a display 47. A building manager can use central local computer 45 to view the collected vertical illumination data, which may be stored on the central local computer 45 or on the cloud server. In the implementation of Fig. 1, vertical illuminance data are communicated to a cloud server or a central local computer, e.g., a building management system, but processing is local at the personal device. In a first alternative implementation the images are processed centrally, e.g., by the central local computer 45 or the cloud server. In a second alternative implementation, the processing is local at the (connected) camera.

[0080] Fig. 3 shows an example of a space in which the system of Fig. 1 may be used. A user 61 uses his laptop 21 for video conferencing. During this video conferencing, the display2024PF80312

[0081] 11

[0082] 29 displays images of another user received via the internet and the embedded camera 28 captures images of the user transmitted via the internet. During calibration, the display 29 generates high luminance screen output at a first moment and low luminance screen output at a second moment. The embedded camera 28 captures images of the user 61 at these moments.

[0083] For example, power metering performed by a smart receptacle may determine whether the laptop 21 has high luminance screen output, e.g., a white screen, or low luminance screen output, e.g., a black screen, or the laptop 21 may cause, for the purpose of the calibration, the display 29 to generate high luminance screen output and then low luminance screen output, or vice versa. In the example of Fig. 3, an external USB webcam 65 has been mounted on the laptop 21. This external USB webcam 65 may also capture images of the user 61 at the first and second moments.

[0084] After the calibration, the brightness values of any subsequent camera image from camera 28 depicting user 61 can be approximated to a vertical illuminance value. At that point, it does not matter what light sources contributed to the brightness of the captured image.

[0085] Vertical illuminance intrinsically includes all types of light, including the light of lighting devices 51 and 52.

[0086] The connections depicted in Fig. 1 are only schematical representations. For example, it is not required that each lighting device communicates directly with light controller 43. The devices of the lighting system may form a mesh network and physical communication may be routed over multiple nodes in order to keep the distances of each radio connection short. Instead of one light controller, multiple light controllers may be used or lights may be controlled without a light controller.

[0087] In the implementation of the personal computer 21 shown in Fig. 1, the personal computer 21 comprises one processor 25. In an alternative implementation, the personal computer 21 comprises multiple processors. The processor 25 of the personal computer 21 may be a general -purpose processor, e.g. from Intel or AMD, or an applicationspecific processor. The processor 25 of the personal computer 21 may run a Windows or Unix-based operating system for example. The storage means 27 may comprise one or more memory units. The memory 27 may comprise one or more hard disks and / or solid-state memory, for example. The memory 27 may be used to store an operating system, applications and application data, for example.

[0088] The receiver 23 and the transmitter 24 may use one or more wired and / or wireless communication technologies such as Ethernet and / or Wi-Fi (IEEE 802.11) to communicate with the wireless LAN access point 41, for example. In an alternative2024PF80312

[0089] 12

[0090] implementation, multiple receivers and / or multiple transmitters are used instead of a single receiver and a single transmitter. In the implementation shown in Fig. 1, a separate receiver and a separate transmitter are used. In an alternative implementation, the receiver 23 and the transmitter 24 are combined into a transceiver. The personal computer 21 may comprise other components typical for a computer such as a power connector. The invention may be implemented using a computer program running on one or more processors.

[0091] In the implementation of Fig. 1, the system of the invention comprises a personal device. In an alternative implementation, the system of the invention alternatively or additionally comprises a different device, e.g. a central local computer or a cloud server. In the implementation of Fig. 1, the system comprises a single device. In an alternative implementation, the system comprises a plurality of devices.

[0092] A first implementation of the method of enabling determination of vertical illuminance data is shown in Fig. 2. The method may be performed by the personal computer 21 of Fig. 1, for example.

[0093] A step 101 comprises obtaining one or more first calibration images captured of a location by a camera of a personal device while a display of the personal device is at low luminance screen output and one or more second calibration images captured of the location by the camera of the personal device while the display of the personal device is at high luminance screen output. For example, as part of the calibration, two different sets of one or more camera images may be captured by the camera in two different situations:

[0094] • At full output of the screen (e.g., maximum white content)

[0095] • With the screen full black

[0096] For example, a quantified light modulation may briefly be generated by the display, to determine its effect on what the screen camera sees as delta in facial brightness. Alternatively, power metering performed by a smart receptacle may determine whether a display is producing a black screen or a white screen, for example. The first and second calibration images depict a user of the personal device. The calibration images may be captured during one or more video conferencing sessions using the personal device.

[0097] A step 103 comprises determining first brightness values of the user’s face in the one or more first calibration images, e.g., a black screen camera image, obtained in step 101 and second brightness values of the user’s face in the one or more second calibration images, e.g., a white screen camera image, obtained in step 101. Brightness (luminance) values may be determined from the RGB values of an image with the following formula, for example:2024PF80312

[0098] 13

[0099] 0.299*R + 0.587*G+ 0.114*B (1)

[0100] A step 105 comprises determining a difference in average brightness of at least one part of the user’s face between the first brightness values determined in step 103 and the second brightness values determined in step 103. For example, the average brightness of the face’s envelope (as identified by a face recognition method) may be calculated for both sets of images. The average brightness is used, because the number of face pixels typically differs per image. The difference between the average brightness values is indicative of the contribution of the display to the image brightness. Steps 103 and 105 are image processing steps.

[0101] A step 107 comprises estimating a display contribution to the illuminance of the user’s face based on differences in luminance between the display at low luminance screen output and the display at high luminance screen output and further based on an optical model. The display contribution indicates how much light from the display is estimated to reach the user’s face and contribute to the vertical illuminance of the user’s face.

[0102] The known properties of the display (width, height, number of nits at maximum output) may be used to establish an accurate estimation of the radiation distribution that results from this display for different levels of luminance screen output.

[0103] These properties may be obtained from the personal device, for example. Calculation of this radiation distribution in function of position relative to the display and distance from the display can be done by established optical models that are well known by those people skilled in the art of geometrical optics.

[0104] Face recognition may be used to determine whether there is a person present in front of the camera, and if so, at which position and distance the person is from the camera, which may be assumed to be at approximately the same location as the display. Based on the estimated radiation distribution and this position and distance, a first vertical illuminance contribution of the display can be calculated when the display is at low luminance screen output and a second vertical illuminance contribution of the display can be calculated when the display is at high luminance screen output.

[0105] A vertical illuminance difference may be determined by subtracting the first vertical illuminance contribution of the display from the second vertical illuminance contribution of the display. This vertical illuminance difference indicates how much light from the display is estimated to contribute to the vertical illuminance of the user’s face, but it is used more generally, as representing any vertical illuminance difference at a certain distance from the2024PF80312

[0106] 14

[0107] display. Step 107 is a light processing step, i.e., conversion from luminance from a light source to illuminance at some distance from the light source.

[0108] A step 109 comprises calculating a calibration factor of the camera of the personal device based on the difference in average brightness determined in step 105 and the display contribution estimated in step 107. This calibration factor typically depends on the user' s skin type / color, the furniture arrangement, and the field of view of the camera. In step 109, the display contribution, i.e., the vertical illuminance difference, estimated in step 107 is correlated to the average brightness difference determined in step 105. This therefore calibrates the camera image brightness versus vertical illuminance.

[0109] The calibration factor allows another average brightness of the at least one part of the user’s face in one or more other camera images to be translated to an estimate of vertical illuminance of the user’s face. The calibration factor allows this other average brightness value to be correlated to a vertical illuminance at the position captured by the camera. After the calibration, the brightness values of any subsequent camera image from this camera depicting this user can thus be approximated to a vertical illuminance value. At that point it does not matter what light sources contributed to the brightness of the captured image. The calibration factor may be associated with the personal device and its location during calibration.

[0110] Step 109 links image processing to light processing. This step takes into account the properties of the user’s face (skin color, reflectivity, etc.) because these properties influence how incident light (illuminance) is reflected and imaged by the camera (brightness). The calibration factor links a delta in subjective brightness of the face, as imaged by the sensor, to a delta in objective vertical illuminance of the face, through the optical model.

[0111] The relationship between screen luminance and face illuminance is somewhere between linear and inverse square. The relationship may be inverse square for larger distances and a point light source, but in most cases, the relationship will be linear or close to linear. For practical reasons, linear approximation may be assumed. This means that the calibration factor can in most cases be used to determine absolute vertical illuminance based on absolute brightness value.

[0112] The calibration factor represents the response of the camera at the applicable camera settings at the time of calibration. Embedded cameras in laptops are known to sometimes automatically adjust the camera settings to improve captured images. These adjustments influence the captured brightness.2024PF80312

[0113] 15

[0114] The camera settings may be stored and taken into account when determining the vertical illuminance estimate based on the further image(s) or restored when the further image(s) are captured, even if it only is for a short time to measure vertical illuminance and not improve the video capture. Preferably, the camera settings are the same when the calibration is performed and when the vertical illuminance data is later collected.

[0115] The following types of camera settings may be distinguished, for example: a) optical camera settings (e.g., exposure time);

[0116] b) image processing settings in the camera (in the hardware or in the driver);

[0117] c) image processing settings in the video conferencing software.

[0118] Settings c) might only affect the display of the images in the video conferencing software and, assuming they do not affect the calibration images, might be of less importance. Settings a) and b) may be stored and later taken into account or restored. The operating system of the personal device, e.g., laptop, typically has functionality that allows settings a) and b) to be read and may have functionality to disable automatic adjustments of settings a) and b). An API to the video conferencing software may have functionality that allows one or more of the above-mentioned camera settings to be read and adjusted and / or to disable automatic adjustments of one or more of the above-mentioned camera settings.

[0119] If the vertical illuminance estimates will be used for automatically controlling the office lighting, target values may for meeting a desired vertical illuminance may also be determined in step 109. Steps 101-109 represent a calibration, which may be done using either a special computer program, or as part of the setting-up phase of a video conference program like Microsoft Teams, for example.

[0120] The method of Fig. 2 may be performed multiple times for personal devices of different users and some of these users may occupy the same location at different times. The method of Fig. 2 may be performed for multiple locations. This crowd sourcing approach allows a building manager to access light quality information, including vertical illuminance, for a plurality of locations across the building. This crowd sourcing approach is a long-term aspect (averaged over time but possibly including a daily cycle, e.g., seasonal) that allows optimization of the baseline illumination.

[0121] In this crowd sourcing approach, images may first be collected from multiple personal devices, e.g., captured by webcams of laptops during video calls. An image of a webcam may be used to create a 3D model of the visible portion of the room. For instance, a diffusion-model based approach may be used to create a depth map of the room from a single image of the webcam (e.g., using the method from the paper “Repurposing Diffusion-Based2024PF80312

[0122] 16

[0123] Image Generators for Monocular Depth Estimation”, Bingxin Ke et al., CVPR 2024 Al conference, http s : / / doi . or g / 10.48550 / ar Xi v .2312.02145).

[0124] Subsequently, the floorplan of the room may be analyzed. Based on the depth map created from the camera image and the known floorplan of the office, the current 3D location of the webcam as well as its facing direction of the webcam (also indicative of the facing direction of the laptop display, e.g., 80 degrees vs 70 degrees) and the height of the face as well as the facing direction of the face may be determined.

[0125] After a lighting system has been installed in an office, there will typically be countless video calls taken by the offices workers occupying each space. The personal devices to be used for determining vertical illuminance data may be purposefully selected. Personal devices may be selected which are used for video calls that are conducted at locations in the floorplan, at heights (e.g., standing vs sitting), or at orientations of the face (e.g., facing towards the window vs facing towards the wall) for which there is no high-quality estimate of the vertical illumination, for example.

[0126] The images may be collected in a certain calibration period. If a table has adjustable height, images of a face of a first person who is standing upright during a first video call may be collected on a first day and images of a face of a second person who is sitting during a second video call may be collected on a second day. The goal may be to determine the vertical illumination at 90cm height (sitting position) and 1.7m (standing position). Optionally, only images of the webcam when the user' s face is oriented vertically with respect to the ceiling are selected.

[0127] A second implementation of the method of enabling determination of vertical illuminance data is shown in Fig. 4. The method may be performed by the personal computer 21 of Fig. 1, for example. The implementation of Fig. 4 is an extension of the implementation of Fig. 2. In the implementation of Fig. 4, steps 121, 123, 125, 127, and 129 are performed after step 109 of Fig. 2

[0128] Step 121 comprises obtaining one or more further images captured of the location by the camera of the personal device. The one or more further images depict the user of the personal device and thus the same user as depicted in the calibration images. Step 121 may comprise verifying that the same user is depicted before proceeding with the next steps.

[0129] Step 123 comprises determining further brightness values based on the one or more further images obtained in step 121. Step 125 comprises determining a further average brightness of at least one part of the user’s face from the further brightness values determined in step 123.2024PF80312

[0130] 17

[0131] Step 127 comprises determining an estimate of vertical illuminance of the user’s face by applying the calibration factor calculated in step 109 to the further average brightness determined in step 125 Step 129 comprises outputting the vertical illuminance estimate determined in step 127. Step 121 is repeated after step 129, after which the method proceeds as shown in Fig. 4.

[0132] In the method of Fig. 4, (average) brightness across the face is measured and translated to (average) vertical illuminance under the given lighting circumstances. This may be used for the purpose of monitoring vertical illuminance at various locations under various circumstances.

[0133] Vertical illuminance intrinsically includes all types of light, i.e., display light, office light and daylight, and it is the combination and therefore the actual vertical illuminance that needs monitoring. The circumstances can vary, i.e., blinds closed / open, high screen output or not, desk light on / off, etc. These circumstances may be stored together with the vertical illuminance for later analysis.

[0134] In order to make brightness values in captured images (and therewith vertical illuminance deduced from the captured images) meaningful, they may be associated with location and orientation of the camera and lighting conditions (the above referred circumstance) of the environment. This data may then be analyzed / mined for the purpose of monitoring vertical illuminance at the location under various circumstances.

[0135] The estimates of vertical illuminance determined in step 127 and associated data may be used for short-term adjustment and / or long-term adjustment of light settings. Both can be automated (with the short-term adjustment based on measured data and the long-term adjustment based on historical or trend data). The long-term adjustment is typically something that a building manager may have a say on. The building manager may, for example, also take other aspects like energy consumption into consideration when making adjustment decisions.

[0136] With the estimates of vertical illuminance determined in step 127 and associated data, a building manager may be able to alter a baseline illuminance or background illuminance, which is also applicable for those not doing screen work and which reduces the individual / local adaptation needs (that may require local desk lamps or directional luminaires to be in place) that could create illumination islands. The estimates of vertical illuminance make it possible to monitor whether the average vertical luminance meets a target value.

[0137] With the method of Fig. 4, vertical illuminance data may be collected at face level for a particular location over time such that an assessment can be made of the overall (human centric) light quality at that location and the changes thereof over, for example, a day or2024PF80312

[0138] 18

[0139] 24 hours. The vertical illumination may be extracted at different times of the day (i.e., with different contributions from the daylight), for different positions of the window blinds, for different (dimming level / CCT) settings of the lighting devices, or for different laptop screen status during the video call (e.g., bright white screen vs mostly black screen). It should be noted that some changes of the vertical illuminance over time could be beneficial to support a circadian rhythm.

[0140] A third implementation of the method of enabling determination of vertical illuminance data is shown in Fig. 5. The method may be performed by the personal computer 21 of Fig. 1, for example. The implementation of Fig. 5 is an extension of the implementation of Fig. 4. In the implementation of Fig. 5, a step 141 is performed between steps 121 and 123.

[0141] Step 141 comprises determining whether a change has occurred in a furniture arrangement at the location and / or in a field of view of the camera of the personal device between a moment the calibration images were captured and a moment the one or more further images are captured. There is a change in the field of view of the camera when the personal device has changed orientation and therefore sees a different scene with different influences from light sources on vertical illuminance.

[0142] The determination whether a change has occurred in a furniture arrangement at the location may be based on image analysis but may alternatively or additionally be based on input collected in a different manner, as furniture not visible in the image can have an impact on the vertical illuminance and furniture in the background image does not contribute a lot to the illuminance in foreground image.

[0143] Step 141 may comprise further analyzing the depth map derived from the video call image, as described earlier in relation to the crowd sourcing approach, to detect that the arrangement of the furniture has changed (e.g., tables or filing cabinets shifted), for example. Step 141 may comprise, for instance, detecting that there are two more tables present, after which the vertical illuminance model for this location in the office is recalibrated (as the presence of the two white tables will alter the vertical illuminations).

[0144] Step 101 is repeated if it is determined in step 141 that a change has occurred in the furniture arrangement and / or in the field of view, after which the method proceeds as shown in Fig. 5. Step 123 is performed after step 141 if it is determined in step 141 that no change has occurred.

[0145] In the implementation of Fig. 5, the calibration factor is recalculated if it is determined in step 141 that a change has occurred in the furniture arrangement. In an2024PF80312

[0146] 19

[0147] alternative implementation, only the vertical illuminance model used in step 107 is recalibrated and new target values are determined based on this new model in step 109.

[0148] If new reflective surfaces are added / removed from the environment, the vertical illuminance changes even with identical amount of office light, desk light, daylight. In that case, the targeted office light and / or desk light setting for meeting a certain vertical illuminance should normally be changed. If the vertical illuminance estimates are only used for monitoring, this is not an issue, as just the vertical illuminance that is actually there is measured. If the vertical illuminance estimates are used for automatically controlling the office lighting, new target values need to be set for meeting the desired vertical illuminance if operated in an open loop, e.g., to set (minimum) baseline values. If the office lighting is operated in a feedback loop, the output of the office lighting will be adjusted dynamically to achieve the desired vertical illuminance.

[0149] To speed up the recalibration of the vertical illuminance model at a certain location, it is beneficial to make use of calibration images depicting the same user as depicted in the calibration used for the initial calibration at this location, as then the skin appearance is the same. The optical model used in step 107 translates screen output luminance into vertical illuminance at a certain location from the screen. The corresponding brightness of the image captured by the camera of that vertical illuminance is dependent on the absorption / refl ection properties of the surface, i.e., the skin receiving the illumination and reflecting it back to the camera. It is therefore easier if the same face can be used, because then that part of the model remains the same.

[0150] A fourth implementation of the method of enabling determination of vertical illuminance data is shown in Fig. 6. The method may be performed by the personal computer 21 of Fig. 1, for example. The implementation of Fig. 6 is an extension of the implementation of Fig. 4. In the implementation of Fig. 6, step 129 of Fig. 4 and a step 155 are performed as part of a step 153 and a step 151 is performed before step 155.

[0151] Step 151 comprises determining one or more of a current time of day, a current date, one or more current positions of one or more window blinds, and one or more current settings of one or more lighting devices. Step 155 comprises outputting one or more of the current time of day, the current date, the one or more current positions of one or more window blinds, and the one or more current settings of one or more lighting devices as metadata to the vertical illuminance estimate output in step 129. Step 153 comprises outputting both the vertical illuminance estimate and the metadata.2024PF80312

[0152] 20

[0153] A fifth implementation of the method of enabling determination of vertical illuminance data is shown in Fig. 7. The method may be performed by the personal computer 21 of Fig. 1, for example. The implementation of Fig. 7 is an extension of the implementation of Fig. 4. In the implementation of Fig. 7, additional steps 171, 173, and 175 are performed after step 123 of Fig. 4. Step 171 comprises determining a distribution of the one or more further brightness values across the user’s face, which are determined in step 123.

[0154] Step 173 comprises identifying one or more lighting devices that contribute to the illumination of the user’s face, based on the distribution determined in step 171. The distribution may identify areas of the face that are more lit than others, and from that information, the position of lighting devices that are responsible for the additional illumination may be estimated. Step 173 does not require the vertical illuminance estimates but only requires the distribution of the brightness values (contrast values), which may be compared to a range of allowable contrasts.

[0155] Step 175 comprises adjusting light settings of the one or more lighting devices identified in step 173 based on the distribution of the one or more further brightness values across the user’s face, as determined in step 171, to minimize differences in brightness values across the distribution. Step 121 is repeated after step 175, after which the method proceeds as shown in Fig. 7.

[0156] Thus, the vertical illumination may be optimized to make the people look maximally attractive (e.g., to other office workers or on a video call) by optimizing the vertical illumination to minimize contrast over the face (this translates into wanting maximal uniformity of the vertical illumination across the face; this is due to the face of a sitting person being oriented vertically). Traditionally, the office lights are optimized for horizontal illumination uniformity and not for vertical illumination uniformity.

[0157] In the method of Fig. 7, brightness uniformity across the face is measured and based thereon, one or more settings of office light, desk light or daylight are controlled such that the brightness uniformity is improved (in a closed loop control). This requires knowledge of the properties, e.g., directionality, of the office light, desk light and daylight to be able to assess the appropriate light source to control. Such knowledge is normally available in the lighting system (e.g., via floorplans).

[0158] As mentioned in relation to Fig. 4, vertical illuminance data may be collected at face level for a particular location over time such that an assessment can be made of the overall (human centric) light quality at that location. When combining this with the implementation of Fig. 7, an arbitration may be carried out between the office worker' s (human centric) light2024PF80312

[0159] 21

[0160] quality needs and the needs to make the office worker look great in video calls (e.g., using movie-set like lighting).

[0161] A sixth implementation of the method of enabling determination of vertical illuminance data is shown in Fig. 8. The method may be performed by the personal computer 21 of Fig. 1, for example. The implementation of Fig. 8 is an extension of the implementation of Fig. 7. In the implementation of Fig. 8, step 173 of Fig. 7 is implemented by a step 185 and steps 181 and 183 are performed before step 185, optionally in parallel. Optionally, a step 191 is also performed before step 185.

[0162] Step 181 comprises identifying shadows from the distribution of brightness values across the user’s face determined in step 171. The shadows are shadows in the imaged face, which can be identified from the distribution of brightness values across the face. Step 183 comprises obtaining information indicative of locations, orientations, and light distributions of a plurality of lighting devices in a space.

[0163] Step 185 comprises identifying one or more lighting devices that contribute to the illumination of the user’s face based on the shadows identified in step 181 and the locations, orientations, and light distributions of the plurality of lighting devices indicated in the information obtained in step 181.

[0164] Optional step 191 comprises obtaining further information specifying details related to how natural daylight interacts with the space throughout the day. These details comprise at least a directionality of the natural daylight entering the space. If step 191 is performed, the one or more lighting devices are identified in step 185 further based on the details related to the natural daylight specified in the further information obtained in step 191.

[0165] For example, image analysis software may be used that identifies shadows in an image (in step 181) and based on the location of the shadows in the image (compared with objects in the image) determines (in step 185) the location of the light source creating these shadows, or at least the angle of incident. In the Al domain, this technique is called “relighting”, see for example https: / / cseweb.ucsd.edu / ~ravir / indoorelighting.pdf.

[0166] Removing shadows then means adding illumination from other angles and / or reducing illumination from the shadow generating light source (in step 175). The location, orientation and light distribution of the (connected) light source is typically known within the lighting management system.

[0167] A seventh implementation of the method of enabling determination of vertical illuminance data is shown in Fig. 9. The method may be performed by the personal computer2024PF80312

[0168] 22

[0169] of Fig. 2. In the implementation of Fig. 9, step 103 of Fig. 2 is implemented by a step 203 and a step 201 is performed before step 203.

[0170] Step 201 comprises obtaining one or more third calibration images captured of the location by a further camera not included in the personal device while the display of the personal device is at low luminance screen output and one or more fourth calibration images captured of the location by the further camera while the display of the personal device is at high luminance screen output. The third and fourth calibration images depict the user of the personal device and are synchronized with the first and second calibration images.

[0171] Thus, the further camera captures the same location and the same user which are being illuminated by the personal device’s display. The further camera may be, for example, a security camera, e.g., security camera 49 of Fig. 1, or a non-integrated USB webcam, e.g., external USB webcam 65 of Fig. 3. The further camera may then be triggered by the personal device to synchronize the image capturing with the screen output.

[0172] Step 203 comprises determining the first brightness values of the user’s face in the first and third calibration images obtained in steps 101 and 201 and the second brightness values of the user’s face in the second and fourth calibration images obtained in steps 101 and 201. By using images from multiple cameras, the determined brightness values may be more accurate.

[0173] One or more of the implementations described above may be combined to create one or more additional implementations. For example, one or more steps of one flowchart may be added to another flowchart.

[0174] Fig. 10 depicts a block diagram illustrating an exemplary data processing system that may perform the method as described with reference to the flow charts.

[0175] As shown in Fig. 10, the data processing system 900 may include at least one processor 902 coupled to memory elements 904 through a system bus 906. As such, the data processing system may store program code within memory elements 904. Further, the processor 902 may execute the program code accessed from the memory elements 904 via a system bus 906. In one aspect, the data processing system may be implemented as a computer that is suitable for storing and / or executing program code. It should be appreciated, however, that the system 900 may be implemented in the form of any system including a processor and a memory that is capable of performing the functions described within this specification. The data processing system may be an Intemet / cloud server, for example.

[0176] The memory elements 904 may include one or more physical memory devices such as, for example, local memory 908 and one or more bulk storage devices 910. The local2024PF80312

[0177] 23

[0178] memory may refer to random access memory or other non-persistent memory device(s) generally used during actual execution of the program code. A bulk storage device may be implemented as a hard drive or other persistent data storage device. The processing system 900 may also include one or more cache memories (not shown) that provide temporary storage of at least some program code in order to reduce the quantity of times program code must be retrieved from the bulk storage device 910 during execution. The processing system 900 may also be able to use memory elements of another processing system, e.g. if the processing system 900 is part of a cloud-computing platform.

[0179] Input / output (I / O) devices depicted as an input device 912 and an output device 914 optionally can be coupled to the data processing system. Examples of input devices may include, but are not limited to, a keyboard, a pointing device such as a mouse, a microphone (e.g. for voice and / or speech recognition), or the like. Examples of output devices may include, but are not limited to, a monitor or a display, speakers, or the like. Input and / or output devices may be coupled to the data processing system either directly or through intervening VO controllers.

[0180] The input and the output devices may be implemented as a combined input / output device (illustrated in Fig. 10 with a dashed line surrounding the input device 912 and the output device 914). An example of such a combined device is a touch sensitive display, also sometimes referred to as a “touch screen display” or simply “touch screen”. In such an implementation, input to the device may be provided by a movement of a physical object, such as e.g. a stylus or a finger of a user, on or near the touch screen display.

[0181] A network adapter 916 may also be coupled to the data processing system to enable it to become coupled to other systems, computer systems, remote network devices, and / or remote storage devices through intervening private or public networks. The network adapter may comprise a data receiver for receiving data that is transmitted by the systems, devices and / or networks to the data processing system 900, and a data transmitter for transmitting data from the data processing system 900 to the systems, devices and / or networks. Modems, cable modems, and Ethernet cards are examples of different types of network adapter that may be used with the data processing system 900.

[0182] As pictured in Fig. 10, the memory elements 904 may store an application 918. The application 918 may be stored in the local memory 908, the one or more bulk storage devices 910, or separate from the local memory and the bulk storage devices. It should be appreciated that the data processing system 900 may further execute an operating system (not shown in Fig. 10) that can facilitate execution of the application 918. The2024PF80312

[0183] 24

[0184] application 918, being implemented in the form of executable program code, can be executed by the data processing system 900, e.g., by the processor 902. Responsive to executing the application, the data processing system 900 may be configured to perform one or more operations or method steps described herein.

[0185] The invention may be implemented as a program product for use with a computer system, where the program(s) of the program product define functions. The program(s) may be contained on a variety of non-transitory computer-readable storage media, where, as used herein, the expression “non-transitory computer readable storage media” comprises all computer-readable media, with the sole exception being a transitory, propagating signal. The program(s) may also be contained on a variety of transitory computer-readable storage media. Illustrative computer-readable storage media include, but are not limited to: (i) non-writable storage media (e.g., read-only memory devices within a computer such as CD-ROM disks readable by a CD-ROM drive, ROM chips or any type of solid-state non-volatile semiconductor memory) on which information is permanently stored; and (ii) writable storage media (e.g., flash memory, floppy disks within a diskette drive or hard-disk drive or any type of solid-state random-access semiconductor memory) on which alterable information is stored. The computer program may be run on the processor 902 described herein.

[0186] The terminology used herein is for the purpose of describing particular implementations only and is not intended to be limiting of the invention. As used herein, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and / or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0187] The corresponding structures, materials, acts, and equivalents of all means or step plus function elements in the claims below are intended to include any structure, material, or act for performing the function in combination with other claimed elements as specifically claimed. The detailed description has been presented for purposes of illustration, but is not intended to be exhaustive or limited to the implementations in the form disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope of the present invention.

Claims

2024PF8031225CLAIMS:

1. A system (21) for enabling determination of vertical illuminance data, the system (21) comprising:at least one input interface (23); andat least one processor (25) configured to:- obtain, via the at least one input interface (23), one or more first calibration images captured of a location by a camera (28) of a personal device (21) while a display (29) of the personal device (21) is at low luminance screen output and one or more second calibration images captured of the location by the camera (28) of the personal device (21) while the display (29) of the personal device (21) is at high luminance screen output, the calibration images depicting a user (61) of the personal device (21),- determine first brightness values of the user’s face (62) in the one or more first calibration images and second brightness values of the user’s face (62) in the one or more second calibration images,- determine a difference in average brightness of at least one part of the user’s face (62) between the first brightness values and the second brightness values,- estimate a display (29) contribution to the vertical illuminance of the user’s face (62) based on differences in luminance between the display (29) at low luminance screen output and the display (29) at high luminance screen output and further based on an optical model, the display (29) contribution indicating how much light from the display (29) is estimated to contribute to the vertical illuminance of the user’ s face (62), and- calculate a calibration factor of the camera (28) of the personal device (21) based on the difference in average brightness and the display (29) contribution, the calibration factor allowing another average brightness of the at least one part of the user’s face (62) in one or more other images to be translated to an estimate of vertical illuminance of the user’s face (62).

2. A system (21) as claimed in claim 1, wherein the calibration images are captured during one or more video conferencing sessions using the personal device (21).2024PF80312263. A system (21) as claimed in claim 1 or 2, further comprising at least one output interface (24) and wherein the at least one processor (25) is further configured to:- obtain, via the at least one input interface (23), one or more further images captured of the location by the camera (28) of the personal device (21), the one or more further images depicting the user (61) of the personal device (21),- determine further brightness values based on the one or more further images, - determine a further average brightness of at least one part of the user’s face (62) from the further brightness values,- determine an estimate of vertical illuminance of the user’s face (62) by applying the calibration factor to the further average brightness, and- output the vertical illuminance estimate via the at least one output interface (24).

4. A system (21) as claimed in claim 3, wherein the at least one processor (25) is configured to:- determine whether a change has occurred in a furniture arrangement at the location and / or in a field of view of the camera (28) of the personal device (21) between a moment the calibration images were captured and a moment the one or more further images are captured, and- if a change has occurred in the furniture arrangement and / or in the field of view, obtain new calibration images and recalculate the calibration factor before determining the vertical illuminance estimate.

5. A system (21) as claimed in claim 3 or 4, wherein the at least one processor (25) is configured to:- determine one or more of a current time of day, a current date, one or more current positions of one or more window blinds, and one or more current settings of one or more lighting devices (51-54), and- output one or more of the current time of day, the current date, the one or more current positions of one or more window blinds, and the one or more current settings of one or more lighting devices (51-54) as metadata to the vertical illuminance estimate via the at least one output interface.2024PF80312276. A system (21) as claimed in any one of claims 3 to 5, wherein the at least one processor (25) is configured to:- determine a distribution of the one or more further brightness values across the user’ s face (62),- identify one or more lighting devices (51-54) that contribute to the illumination of the user’s face (62), based on the determined distribution, and- adjust, via the at least one output interface, light settings of the one or more lighting devices (51-54) based on the distribution of the one or more further brightness values across the user’s face (62) to minimize differences in brightness values across the distribution.

7. A system (21) as claimed in claim 6, wherein the at least one processor (25) is configured to identify the one or more lighting devices (51-54) by:- identifying shadows from the determined distribution of brightness values across the user’ s face (62),- obtaining information indicative of locations, orientations, and light distributions of a plurality of lighting devices (51-54) in a space, and- identifying the one or more lighting devices based on the shadows and the locations, orientations, and light distributions of the plurality of lighting devices (51-54).

8. A system (21) as claimed in claim 7, wherein the at least one processor (25) is further configured to:- obtain further information specifying details related to how natural daylight interacts with the space throughout the day, the details comprising at least a directionality of the natural daylight entering the space, and- identifying the one or more lighting devices (51-54) further based on the details related to the natural daylight.

9. A system (21) as claimed in any one of the preceding claims, wherein the at least one processor (25) is configured to:- obtain, via the at least one input interface (23), one or more third calibration images captured of the location by a further camera (49,65) not included in the personal device (21) while the display (29) of the personal device (21) is at low luminance screen output and one or more fourth calibration images captured of the location by the further2024PF8031228camera (49,65) while the display (29) of the personal device (21) is at high luminance screen output, the third and fourth calibration images depicting the user (61) of the personal device (21) and being synchronized with the first and second calibration images, and- determine the first brightness values of the user’ s face (62) in the first and third calibration images and the second brightness values of the user’s face (62) in the second and fourth calibration images.

10. A method of enabling determination of vertical illuminance data, the method comprising:- obtaining (101) one or more first calibration images captured of a location by a camera of a personal device while a display of the personal device is at low luminance screen output and one or more second calibration images captured of the location by the camera of the personal device while the display of the personal device is at high luminance screen output, the calibration images depicting a user of the personal device,- determining (103) first brightness values of the user’s face in the one or more first calibration images and second brightness values of the user’s face in the one or more second calibration images,- determining (105) a difference in average brightness of at least one part of the user’s face between the first brightness values and the second brightness values,- estimating (107) a display contribution to the illuminance of the user’s face based on differences in luminance between the display at low luminance screen output and the display at high luminance screen output and further based on an optical model, the display contribution indicating how much light from the display is estimated to reach the user’s face and contribute to the vertical illuminance of the user’s face, and- calculating (109) a calibration factor of the camera of the personal device based on the difference in average brightness and the display contribution, the calibration factor allowing another average brightness of the at least one part of the user’s face in one or more other images to be translated to an estimate of vertical illuminance of the user’s face.

11. A computer program product for a computing device, the computer program product comprising computer program code to perform the method of claim 10 when the computer program product is run on a processing unit of the computing device.