Method for operating at least one illumination source and at least one camera of a detector
The method allows dynamic adjustment of illumination source and camera settings in multiple modes, addressing display degradation and enhancing functionality in authentication systems by enabling flexible operation points.
Patent Information
- Application Number
- PCT/EP2026/063579
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2025-05-12
- Filing Date
- 2026-05-11
- Publication Date
- 2026-11-19
AI Technical Summary
Existing authentication systems face challenges in applying different operating points on the same hardware system for various functions, leading to potential display degradation and limited functionality due to fixed peak-current, pulse-width, and pulse-frequency settings.
A method for operating an illumination source and camera in at least two different modes, defined by predefined operating points, involving data retrieval, selection, programming of integrated circuits, and generating trigger signals to adjust settings dynamically.
Enables flexible operation of illumination sources and cameras for multiple functions, reducing display degradation and enhancing performance by allowing dynamic adjustment of peak-current, pulse-width, and pulse-frequency settings.
Smart Images

Figure EP2026063579_19112026_PF_FP_ABST
Abstract
Description
[0001] Method for operating at least one illumination source and at least one camera of a detector
[0002] Technical Field
[0003] The invention relates to a method for operating at least one illumination source and at least one camera of a detector, an illumination and imaging controller, a detector comprising at least one illumination source and at least one camera, and a use of the detector. Further, the invention relates to a computer program, a computer-readable storage medium, and a non-transient computer-readable medium. The devices, methods and uses according to the present invention specifically may be employed in the field of face authentication, for example in various areas of daily life, security technology, gaming, traffic technology, production technology, photography such as digital photography or video photography for arts, documentation or technical purposes, safety technology, information technology, agriculture, crop protection, maintenance, cosmetics, medical technology or in the sciences. However, other applications are also possible.
[0004] Background art
[0005] Available authentication systems in mobile devices such as in smartphones, tablets and the like, include cameras, e.g. camera integrated circuits (IC) to record images, and light projectors, such as a flood light source to illuminate the scene, e.g. an LED or a VCSEL-Laser component, and / or a pattern light source used to project a dot pattern onto the scene to be measured. Light projectors may be controlled and / or driven by application-specific integrated circuits (ASICS), called current drivers. The current drivers may provide the required voltage and / or current to operate the light projectors. The current driving the light projectors can be characterized by one or more of the following parameters: peak current, i.e. a strength of the applied current measured in Ampere; pulse width, in case the current is applied only on for a short duration in a repetitive manner and off for the rest of the time; pulse frequency, in case the current is applied in a repetitive manner at a certain frequency; optical power. The optical power may specifically be a function of the peak current, the pulse width and the pulse frequency. The combination of peak-current, pulse-width and pulse frequency may also be referred to as operating point. The current drivers may often provide additional functionality such as monitoring of the current to prevent overcurrent conditions, or monitoring of other parameters such pulsefrequency and pulse-width.
[0006] For example, US 2023 / 0051475 A1 describes a driver circuit including an optical emitter, a capacitive element, and an inductive element. The driver circuit may include a first switch that, in a closed state, is to cause charging of the inductive element, and when transitioning from the closed state to an open state is to cause discharging of the inductive element to charge the capacitive element. The driver circuit may include a second switch that in a closed state is to cause discharging of the capacitive element to provide an electrical pulse to the optical emitter. The driver circuit may include a signal generator configured to generate a first signal for controlling the open state and the closed state of thefirst switch, and a pulse shortening element configured to shorten a pulse width of the first signal to generate a second signal for controlling the open state and the closed state of the second switch.
[0007] The authentication systems are typically mounted behind a display, for example an OLED Display, such that light from the flood light source and / or the pattern light source needs to pass through the display to illuminate the scene, is reflected for example by a face, and needs to pass through the display again to reach the camera for being recorded. The display is generally not transparent to the infrared light of the light projectors and partially absorbs the light from the light projectors. This absorption may lead to local temperature increase or other failure effects. For example, active circuitry on the display in the area which is illuminated by the light projector may be damaged over time, resulting in a performance reduction, called degradation. The degradation may result in optically visible areas in which some of the displays pixels perform worse than the neighboring ones. In worst case, pixels of the display may even be destroyed by the light. In order to avoid degradation of the display of authentication systems, an optical power being absorbed by the display must be limited to avoid damage over the lifetime of the display.
[0008] Further, authentication system may be required to fulfill multiple functions, for example secure face authentication, 3D-measurements, vital-sign measurements, material classification, for example seatbelt detection or the like. For different functions, different settings for peak current, pulse width, pulse frequency may be required for optimum performance of the authentication system. Known systems and setups may allow only a single combination of settings for peak current, pulse width and pulse frequency which then must be used for all functions implemented in this system, which is not ideal.
[0009] US 11,300,865 B2 describes a mobile terminal and a system for controlling a laser projector. The system includes a first drive circuit, a second drive circuit, a microprocessor coupled to the first drive circuit, and an application processor. The first drive circuit is configured to output an electrical signal to the laser projector. The second drive circuit is configured to supply power to the first drive circuit. The application processor is configured to, read a preset signal from the microprocessor, and power off the second drive circuit to power off the first drive circuit and the laser projector, or send a reset signal for restarting the microprocessor to the microprocessor, in response to that the application processor cannot read the preset signal.
[0010] CN 114488892 B describes a laser irradiation control system, a laser irradiation control method, a device and a medium. The system comprises: a field programmable gate array (FPGA) controller module, a vertical cavity surface emitting laser module and a driving module, wherein the FPGA controller module is connected to the driving module via an IO port, and is used to control the driving module to generate a driving program of a specified wavelength. The driving module is connected to the lasers of each array element in the vertical cavity surface emitting laser module via a data interface, and is used to control each laser to form light waves of different wavelengths on an irradiated surface based on the driving program.Further, some system-on-chip (SoC) may use multiple operating points for their voltage regulators depending on context. Smartphones may support low-power modes, where the quality of, e.g. the GPS (Global Positioning System), face, camera, or the update rate of gyros, ambient light, and other sensors may be scaled up or down. Some CPUs may use complex dynamic voltage and operating frequency changes depending on current use.
[0011] Despite the advantages achieved by known methods and devices, several technical challenges remain. Specifically, there is still a need for a method to apply different operating points on the same hardware system for different functions. Multiple architectural approaches exist to define the operating point for a given system. Typically, the peak-current may be defined in the current drivers either by writing to a register in the driver (configuration) or by an external component, for example an external resistor. In the first case, the configuration is typically controlled by a microcontroller. In case the peak current is defined by external components, a programming bus may not be required. Both pulse-frequency and pulse-width may usually be defined dynamically during the operation of the system and may be provided implicit as part of a trigger signal, which is typically a low-current voltage, which may then be converted and amplified by the current driver to generate the output signal which drives the light projector. The trigger signal may be provided either by a microcontroller synchronized with a camera IC or directly by the camera IC, e.g. via its integrated microcontroller. The peak-current may typically be fixed for a given configuration as it is either hard-coded in the firmware of the microcontroller which then configures the current drivers or via the external components. The possible options for pulsewidth and pulse-frequency may be defined by the camera IC and its capabilities. Some camera ICs may allow for multiple sequences of operating points to be defined in repetitive patterns. However, this is typically only applicable to consecutive frames, i.e. to images subsequently acquired by the camera. An actual switch between features and operating modes may usually require reprogramming of the camera IC.
[0012] Problem to be solved
[0013] It is therefore desirable to provide methods and devices which at least partially avoid above-mentioned technical challenges. Specifically, it is an object of the present invention to provide methods and devices which allow to apply different operating points on the same hardware system for different functions.
[0014] Summary
[0015] This problem is addressed by a method for operating at least one illumination source and at least one camera of a detector, an illumination and imaging controller, a detector comprising at least one illumination source and at least one camera, a use of the detector, a computer program, a computer-readable storage medium, and a non-transient computer-readable medium with the features of the independent claims. Advantageous embodiments which might be realized in an isolated fashion or in any arbitrary combinations are listed in the dependent claims as well as throughout the specification.In a first aspect of the present invention, a method for operating at least one illumination source and at least one camera of a detector at at least two different operating modes is disclosed. The detector comprises the illumination source and the camera. Each of the operating modes comprises one or more operating points. Each of the operating points is defined by at least one operating parameter of the illumination source and at least one operating parameter of the camera.
[0016] The method comprises the following steps that may be performed in the given order. However, a different order may also be possible. In particular, one, more than one or even all of the method steps may be performed once or repeatedly. Further, the method steps may be performed successively or, alternatively, one or more of the method steps may be performed in a timely overlapping fashion or even in a parallel fashion and / or in a combined fashion. The method may further comprise additional method steps that are not listed.
[0017] The method comprises the following steps:
[0018] I. retrieving input data comprising data relating to at least one operating mode, in which the illumination source and the camera are to be operated;
[0019] II. selecting in accordance with the received input data at least one predefined operating point from a plurality of predefined operating points;
[0020] ill. programming at least one integrated circuit of the camera depending on the selected predefined operating point; iv. generating at least one trigger signal comprising information about the selected predefined operating point and providing the trigger signal to at least one integrated circuit of the illumination source.
[0021] The term "operating” as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to a process of causing at least one function of at least one device. The operating of the detector may comprise causing at least one function of the detector, such as causing at least one function of the illumination source and / or the camera of the detector. The operating may specifically comprise causing the detector or any subunit of the detector, such as the illumination source and / or the detector, to perform at least one function. For example, the operating may comprise causing the illumination source of the detector to illuminate a scene with illumination light. Additionally or alternatively, the operating may comprise causing the camera of the detector to generate at least one image of the illuminated scene. The operating may specifically comprise causing the detector the detector or any subunit of the detector, such as the illumination source and / or the detector, to perform the at least one function in a timely overlapping fashion or even in a parallel fashion. For example, the operating of the detector may comprise causing the illumination source of the detector to illuminate a scene with illumination light and causing the camera of the detector to generate at least one image of the illuminated scene in a timely overlapping fashion or even in a parallel fashion.The term "detector” as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to a device configured for detecting, i.e. for at least one of determining, measuring and monitoring, at least one parameter, qualitatively and / or quantitatively, such as at least one of a physical parameter, a chemical parameter and a biological parameter. The detector may specifically be an optical detector. The detector, as outlined above, comprises the illumination source and the camera. The detector may comprise further components. For example, the detector may comprise at least one illumination and imaging controller configured for operating the illumination source and the camera. The detector may specifically be configured for authenticating a user.
[0022] The term "user” as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to a person intended to and / or using a device. The device may be selected from the group consisting of: a mobile device, particularly a cell phone, and / or a smart phone, and / or a tablet computer, and / or a laptop, and / or a tablet, and / or a virtual reality device, and / or a wearable, such as a smart watch; or another type of portable computer, a television device; a game console; a personal computer; an access system such as of an automotive. The detector may be part of the device.
[0023] The term "authenticating” as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to verifying an identity of a user. Specifically, the authentication may comprise distinguishing between the user from other humans or objects, in particular between an authorized access from a non-authorized access. The authentication may comprise verifying identity of a respective user and / or assigning identity to a user. The authentication may comprise generating and / or providing identity information, e.g. to other devices or units such as to at least one authorization unit for authorization for providing access to the device. The identify information may be proofed by the authentication. For example, the identity information may be and / or may comprise at least one identity token. In case of successful authentication an image of a face recorded by the detector may be verified to be an image of the user's face and / or the identity of the user is verified. The authenticating may be performed using at least one authentication process. The authentication process may comprise a plurality of steps such as at least one face detection, e.g. on at least one flood image as will be described in more detail below, and at least one identification step in which an identity is assigned to the detected face and / or at least one identity check and / or verifying an identity of the user is performed.
[0024] The term "illumination source” as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to device configured for generating or providing light. As used herein, the term "light” is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to electromagneticradiation in one or more of the infrared, the visible and the ultraviolet spectral range. Herein, the term "ultraviolet spectral range”, generally, refers to electromagnetic radiation having a wavelength of 1 nm to 380 nm, preferably of 100 nm to 380 nm. Further, in partial accordance with standard ISO-21348 in a valid version at the date of this document, the term "visible spectral range”, generally, refers to a spectral range of 380 nm to 760 nm. The term "infrared spectral range” (IR) generally refers to electromagnetic radiation of 760 nm to 1000 pm, wherein the range of 760 nm to 1.5 pm is usually denominated as "near infrared spectral range” (NIR) while the range from 1.5 pm to 15 pm is denoted as "mid infrared spectral range” (MidlR) and the range from 15 pm to 1000 pm as "far infrared spectral range” (FIR).
[0025] The illumination source may be configured for illuminating a scene with illumination light and / or may be suitable for emitting illumination light. The illumination source may be configured for emitting light at a single wavelength, e.g. in the infrared region. Additionally or alternatively, the illumination source may be adapted to emit light with a plurality of wavelengths, e.g. for allowing additional measurements in a plurality of wavelengths channels. The illumination source may comprise at least one element selected from the group consisting of: at least one point light source; at least one pattern light source; and at least one flood light source. For example, the illumination source may comprise a pattern light source and a flood light source.
[0026] The term "pattern light source” as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to an optical device configured for generating and / or for providing at least one light pattern, in particular at least one infrared light pattern. The light pattern may comprise at least one arbitrary pattern comprising a plurality of light spots. The light spot may be at least partially spatially extended. At least one spot or any spot may have an arbitrary shape. In some cases, a circular shape of at least one spot or any spot may be preferred. The spots may be arranged by considering a structure of a display of the device. Typically, an arrangement of an OLED-pixel-structure of the display may be considered. The light pattern may be an infrared light pattern comprising spots in the infrared spectral range, specifically a near infrared light pattern.
[0027] The light pattern generated by pattern light source may be coherent. The light pattern may be a coherent, in particular infrared, light pattern. The light pattern may comprise at least one regular and / or constant and / or periodic pattern such as a triangular pattern, a rectangular pattern, a hexagonal pattern or a pattern comprising further convex tilting. For example, the light pattern is a hexagonal pattern, preferably a hexagonal 2 / 5 light pattern, preferably a 2 / 5 hexagonal infrared light pattern. Using a periodical 2 / 5 hexagonal pattern can allow distinguishing between artefacts and usable signal. The light pattern may comprise at least one point pattern. The light pattern has a low point density. For example, a number of light beams projected on the user is lower than 5000, preferably 30 lower than 3000, more preferably lower than 2000, even more preferably below 1500, most preferably below 1000. The light pattern may have a low point density, in particular in comparison with other structured light techniques having typically a point density of 10k -30k in a field of view of 55x38°. Using such a low point density may allow compensating for the above-mentioneddiffraction loss. By decreasing the number of spots projected onto an object and / or a user, a contrast in the pattern image may be increased. Increasing the number of points would decrease the irradiance per point. The decreased number of spots may lead to an increase in irradiance of a spot and thus, to an increase in contrast in the pattern image of the projection of the infrared light pattern. The light pattern may have a periodic point pattern with a reduced number of spots, wherein each of the spots has a high irradiance. Such a light pattern can ensure improved authentication using illumination sources and image generation unit behind a display. Moreover, the low number of spots can ensure complying with eye safety requirements and stability requirements. The allowed dose may be divided between the spots of the light pattern.
[0028] The pattern light source may comprise at least one least one emitter, in particular a plurality of emitters. The emitter may be selected from the group consisting of: at least one laser source such as at least one semi-conductor laser, at least one double heterostructure laser, at least one external cavity laser, at least one separate confinement heterostructure laser, at least one quantum cascade laser, at least one distributed Bragg reflector laser, at least one polariton laser, at least one hybrid silicon laser, at least one extended cavity diode laser, at least one quantum dot laser, at least one volume Bragg grating laser, at least one Indium Arsenide laser, at least one Gallium Arsenide laser, at least one transistor laser, at least one diode pumped laser, at least one distributed feedback lasers, at least one quantum well laser, at least one interband cascade laser, at least one semiconductor ring laser, at least one vertical cavity surface emitting laser (VCSEL); at least one non-laser light source such as at least one light-emitting diode (LED) or at least one light bulb; at least one edge-emitting laser. For example, light sources inherently having a narrow emission profile may be used such as VCSELs, e.g. in combination with an optical element like MLA, DOE, meta-surface, or lens. Such a light source may have a narrower emission profile than off-the-shelf LEDs. For example, the pattern light source may comprise at least one VCSEL, preferably a plurality of VCSELs. The plurality of VCSELs may be arranged in at least one array, e.g. comprising a matrix of VCSELs. The VCSELs may be arranged on the same substrate, or on different substrates. The term "vertical-cavity surface-emitting laser” as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to a semiconductor laser diode configured for laser beam emission perpendicular with respect to a top surface. Examples for VCSELs can be found e.g. in en.wikipe-dia.org / wiki / Verticalcavity_surface-emitting_laser. VCSELs are generally known to the skilled person such as from WO 2017 / 222618 A. Each of the VCSELs is configured for generating at least one light beam. The VCSEL or the plurality of VCSELs may be configured for generating the desired spot number. The VCSELs may be configured for emitting light beams at a wavelength range from 800 to 1000 nm. For example, the VCSELs may be configured for emitting light beams at 808 nm, 850 nm, 940 nm, and / or 980 nm. Preferably the VCSELs emit light at 940 nm, since terrestrial sun radiation has a local minimum in irradiance at this wavelength, e.g. as described in CIE 085-1989 „Solar spectral Irradiance”.
[0029] A display of the device may be configured for modifying the spots, e.g. by increasing a number of spots, generated by the pattern light source when traversing the display. For example, the display may act as diffractive optical element(DOE). Thus, resources can be saved since the display functions as DOE and such that no further DOE is necessary. Moreover, less emitter, e.g. VCSEL cavities, are necessary since the light beams can be multiplicated by the display. Additionally or alternatively, the pattern light source may comprise at least one optical element, e.g. configured for modifying the spots, e.g. by increasing a number of spots, selected from the group consisting of: at least one lens; at least one Micro-lens-array (MLA); at least one diffractive optical element (DOE); and at least one meta surface element. The DOE and / or the metasurface element may be configured for generating multiple light beams from a single incoming light beam. For example, a VCSEL projecting up to 2000 spots and an optical element comprising a plurality of metasurface elements may be used to duplicate the number of spots. Further arrangements, particularly comprising a different number of projecting VCSEL and / or at least one different optical element configured for increasing the number of spots may be possible. Other multiplication factors are possible. For example, a VCSEL or a plurality of VCSELs may be used and the generated laser spots may be duplicated by using at least one DOE.
[0030] The pattern light source may further comprise at least one transfer device, i.e. one or more optical elements which are adapted to modify the light beam, particularly the light beam used for generating at least a portion of the light pattern, such as by modifying one or more of a beam parameter of the light beam, a width of the light beam or a direction of the light beam. The transfer device may comprise at least one imaging optical device .The transfer device specifically may comprise one or more of: at least one lens, for example at least one lens selected from the group consisting of at least one focus-tunable lens, at least one aspheric lens, at least one spherical lens, at least one Fresnel lens; at least one diffractive optical element; at least one concave mirror; at least one beam deflection element, preferably at least one mirror; at least one beam splitting element, preferably at least one of a beam splitting cube or a beam splitting mirror; at least one multi-lens system; at least one holographic optical element; at least one meta optical element. Specifically, the transfer device comprises at least one refractive optical lens stack. The transfer device may comprise a multi-lens system having refractive properties.
[0031] The term "flood light source” as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to a device configured for providing substantially continuous spatial illumination, in particular diffuse and / or uniform illumination. The flood light source may be configured for generating and / or providing flood light, specifically flood light having a wavelength in the infrared range, in particular in the near infrared range. The flood light source may comprise at least one light-emitting diode (LED) or at least one vertical cavity surface emitting laser (VCSEL), preferably a plurality of VCSELs. The plurality of VCSELs may overlap to a uniform area. The substantially continuous spatial illumination may refer, without limitation, to uniform spatial illumination, wherein areas of non-uniform are possible. The area, e.g. covering a user, a portion of the user and / or a face of the user, illuminated from the flood light source, may be contiguous. Power may be spread over a whole field of illumination. In contrast, illumination provided by the light pattern may comprise at least two contiguous areas, in particular a plurality of contiguous areas, and / or power may be concentrated in small (compared to the whole field of illumination) areas of the field of illumination.The infrared flood light may be suitable for illuminating a contiguous area, in particular one contiguous area. The infrared pattern illumination may be suitable for illuminating at least two contiguous areas. The flood light source may illuminate a measurement area, such as a user, a portion of the user and / or a face of the user, with a substantially constant illumination intensity. Flood light may vary temporally or may be substantially constant over time, i.e. a completely constant illumination and embodiments in which deviations from a constant illumination of < ± 10 %, preferably < ± 5 %, more preferably < ± 2 % are possible. The emitting of the flood light and the illumination of the light pattern may be performed subsequently or at at least partially overlapping times. For example, the flood light and the light pattern may be emitted at the same time. For example, one of the flood light or the light pattern may be emitted with a lower intensity compared to the other one.
[0032] The detector may specifically comprise a plurality of illumination sources. For example, the detector may comprise at least one pattern light source and at least one flood light source, specifically comprising a VCSEL, preferably a plurality of VCSELs. The pattern light source may comprise a plurality of first VCSELs mounted on a first platform. The flood light source may comprise a plurality of second VCSELs mounted on a second platform. The second platform may be beside the first platform.
[0033] The term "camera” as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to a device having at least one image sensor configured for generating or recording spatially resolved one-dimensional, two-dimensional or even three-dimensional optical data or information. The camera may be a digital camera. As an example, the camera may comprise at least one image sensor, such as at least one CCD sensor and / or at least one CMOS sensor configured for recording images. The image may be generated via a hardware and / or a software interface, which may be considered as the camera. The camera may comprise at least one image sensor, in particular at least one pixelated image sensor. For example, an image may be generated by using the at least one camera comprising at least one image sensor such as at least one CCD sensor and / or at least one CMOS sensor. The camera may comprise at least one CMOS sensor and / or at least one CCD chip. For example, the camera may comprise at least one CMOS sensor, which may be sensitive in the infrared spectral range. The camera may have a field of view between 10°x10° and 75°x75°, preferably 55°x65°. The camera may have a resolution below 2 megapixel, preferably between 0.3 megapixel and 1.5 megapixel. Megapixel may refer to a unit for measuring the number of pixels associated with a camera and / or an image. The camera may comprise further elements, such as one or more optical elements, e.g. one or more lenses. As an example, the camera may be a fix-focus camera, having at least one lens which is fixedly adjusted with respect to the camera. Alternatively, however, the camera may also comprise one or more variable lenses which may be adjusted, automatically or manually. Other cameras, however, are feasible.
[0034] For example, the camera may comprise the at least one image sensor and at least one further optical element. For example, the further optical element may be at least one lens. A lens may refer to an optical element suitable for influencing the expansion of the light beam associated with the coherent electromagnetic radiation. For example, thefurther optical element may be at least one polarizer. For example, the camera may comprise at least one image sensor, at least one lens and at least one polarizer. The polarizer may refer to an optical element suitable for selecting the electromagnetic radiation according to its polarization. In particular, the polarizer may be an optical element suitable for selecting the coherent electromagnetic radiation according to polarization its. Thus, a part of the electromagnetic radiation may pass the polarizer while the rest of the electromagnetic radiation may be turned away at least partially and / or may be absorbed at least partially.
[0035] The term "operating mode” as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to a particular technical fashion of operating the detector. Specifically, the operating mode may be defined in accordance with a particular objective of operating the detector. For example, the objective may be to save energy. The two different operating modes may comprise at least a first operating mode and at least a second operating mode, wherein the first operating mode may be a low power mode and the second operating mode may be a full power mode. The operation of the detector in the low power mode may require less electrical energy compared with the operation of the detector in the full power mode. Other objectives, such enhancement of detection precision of the detector or the prevention of degradation or the like, may also be feasible. The operating mode may comprise a collection of one or more operating points which are suitable for achieving the particular objective of operating the detector.
[0036] The term "operating point” as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to a combination of operating parameters of the detector. Each operating point is defined by at least one operating parameter of the illumination source and at least one operating parameter of the camera. The operating point may further comprise specifications for each operating parameter of the combination of operating parameters. Thus, the operating point may define a numerical value for each operating parameter of the combination of operating parameters. The operating point may comprise specifications for every operating parameter of the detector, in particular for every operating parameter of at least the illumination source and the camera, and, optionally, of any other subunit comprised by the detector. For example, the operating point may comprise a combination of peak-current, pulse-width and pulse frequency for the illumination source and the camera. The operating point may be selected during operation of the illumination source.
[0037] The method may comprise using the selected predefined operating point for at least one function selected from the group consisting of: face authentication; 3D measurement in full power mode; 3D measurement low power mode; vital sign detection in full power mode; vital sign detection in low power mode; material classification in full power mode; material classification in low power mode.The term "operating parameter” as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to a physical quantity required for operating the detector. The operating parameter may specifically refer to an adjustable or variable physical quantity of the detector, such as of the illumination source and / or of the camera, being required for operating the detector. The operating parameter may comprise a setting of the adjustable or variable physical quantity of the detector, such as of the illumination source and / or of the camera, being required for operating the detector. The operating parameter may comprise one or more of peak-current, pulse-width, pulse frequency, optical power. For example, the operating point may comprise three operating parameter peak-cur-rent, pulse-width, and pulse frequency. Alternatively, it may also be possible to have one of these operating parameter fixed and vary the other two operating parameter.
[0038] The term ''retrieving'"' as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to a process of reading or obtaining at least one item of information. The retrieving may specifically comprise reading or obtaining the input data, e.g. from an external data source such as an external microcontroller. The retrieving may specifically take place via at least one interface, such as via a port such as a serial or parallel port. The retrieving may comprise several sub-steps, such as the sub-step of obtaining one or more items of primary information and generating secondary information by making use of the primary information, such as by applying one or more algorithms to the primary information, e.g. by using a processor. As a result of the retrieving of the input data, the data relating to the at least one operating mode may be made available to the detector for further processing. The input data may be retrieved via at least one communication interface such as an Application Programming Interface.
[0039] The term "input data” as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to an input value or parameter for the detector and / or data which can be provided to the detector, specifically in an electronic format. The input data may be or may comprise a quantifiable variable of at least one value or parameter which can characterize the operating mode, in which the illumination source and the camera are to be operated. The input data may be or may comprise a quantifiable variable of at least one parameter which can characterize the operating mode. For example, the input data may comprise data relating to at least one operating mode and / or at least one operating point. Additionally or alternatively, the input data may comprise data relating to feature context. The input data may directly comprise the data relating to at least one operating mode or may comprise data which can be processed by the detector, specifically by an illumination and imaging controller of the detector, to obtain the data relating to at least one operating mode.
[0040] The data relating to at least one operating mode may further comprise data relating to at least one predefined sequence. For example, the predefined sequence may define a sequence of: operating point 1, operating point 2, operating point 3. Thus, in this example, the operating mode associated with this predefined sequence may be performedin the following way: operating point 1, operating point 2, operating point 3, operating point 1, operating point 2, operating point 3, etc.. However, other sequences are also possible, such as operating point 1, operating point 1, operating point 2, operating point 3, operating point 1.operatin point 1, operating point 2, operating point 3, etc, or the like.
[0041] The input data may be provided by at least one external data source. The external data source may comprise one or more of at least one external processor and / or a user interface. For example, the external data source may comprise an external signal generator, such as an external microcontroller.
[0042] The term "selecting” as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to a process of choosing at least one item or parameter from a plurality of predefined items or parameter. Specifically, the selecting may comprise choosing the at least one predefined operating point from the plurality of predefined operating points. As an example, the detector, specifically an illumination and imaging controller of the detector, may comprise at least one register comprising the plurality of predefined operating points. At least one of the predefined operating points from the plurality of predefined operating points in the register may be selected in accordance with the received input data. The method may comprise setting the operating parameter of the illumination source depending on the selected predefined operating point.
[0043] The term "integrated circuit” as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to a set of electronic circuits on a single chip. The chip may typically be a flat piece of semiconductor material, e.g. silicon. The set of electronic circuits may be configured for interacting with each other to perform various functions, such as processing and / or storing of data or information. The integrated circuit may be a programmable integrated circuit, such as an integrated circuit configured for being programmed to perform one or more specific tasks or functions.
[0044] The term "programming” as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to a process of transferring a software into an integrated circuit (IC) to enable the IC to perform one or more specific tasks or functions. The software may specifically comprise machine-readable commands which can be executed by the integrated circuit to perform the one or more specific tasks or functions. For example, the programming may comprise transferring software to the integrated circuit of the camera to perform the function of image capturing in accordance with the selected predefined operating point. Additionally, as another example, step iv. may comprise programming the integrated circuit of the illumination source, specifically by transferring software to the integrated circuit of the illumination source to perform the function of illumination in accordance with the selected predefined operating point.The term "generating” as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to a process of creating at least one signal by means of a defined process. The process may be defined by one or more machine-readable commands executed by a controller. The generating may specifically comprise transforming at least one first signal or item of information into at least one second signal or item of information. For example, the generating may comprise creating the trigger signal in accordance with the selected predefined operating point.
[0045] The term "trigger signal” as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to a signal initiating at least one process or function of a device. Specifically, the trigger signal may initiate at least one process of function of the illumination source, specifically the process of illumination. The trigger signal may specifically initiate the illumination source to perform the selected predefined operating point. The trigger signal may comprise information for control current reduction output of the integrated circuit of the illumination source. Alternatively or additionally, the trigger signal may be used for controlling at least one separate current reduction circuit.
[0046] Step iv. may specifically comprise converting a strobe signal from the camera into the trigger signal. The term "converting” as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to a process of changes at least one first signal into at least one second signal. The converting may comprise changing the strobe signal into the trigger signal. The conversion may specifically comprise changing and / or adding information of the strobe signal, in particular such that the trigger signal conveys other and / or further information than the strobe signal.
[0047] The term "providing” as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to a process of supplying or making available at least signal to at least one device. Specifically, the providing may comprise supplying or making available the at least one trigger signal to the integrated circuit of the illumination source.
[0048] Steps I. to iv. may be performed and / or triggered by at least one illumination controller. The term "illumination controller”, also referred herein to "illumination and imaging controller”, as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to an arbitrary logic circuitry configured for performing basic operations of a computer or system, and / or, generally, to a device which is configured for performing calculations or logic operations. In particular, the illumination controller may be configured for processing basic instructions thatdrive the detector. As an example, the illumination controller may comprise at least one arithmetic logic unit (ALU), at least one floating-point unit (FPU), such as a math co-processor or a numeric co-processor, a plurality of registers, specifically registers configured for supplying operands to the ALU and storing results of operations, and a memory, such as an L1 and L2 cache memory. In particular, the illumination controller may be a multi-core processor. Specifically, the illumination controller may be or may comprise a central processing unit (CPU). Additionally or alternatively, the illumination controller may be or may comprise a microprocessor, thus specifically the illumination controller's elements may be contained in one single integrated circuitry (IC) chip. Additionally or alternatively, the illumination controller may be or may comprise one or more application-specific integrated circuits (ASICs) and / or one or more field-programmable gate arrays (FPGAs) and / or one or more tensor processing unit (TPU) and / or one or more chip, such as a dedicated machine learning optimized chip, or the like. The illumination controller specifically may be configured, such as by software programming, for performing steps i. to iv..
[0049] The illumination controller may specifically comprise at least one element selected from the group consisting of: a processor; a logic circuit; a Micro-Controller; an FPGA, a CPU. The illumination controller may be configured for receiving the input data from an external input, for example another microcontroller. The input data may encode the operating mode in which the illumination source and the camera are to be operated next, e.g. "Start Operating Mode 1” or the like. The illumination controller may comprise at least one memory with instructions or commands to match a number of operating modes to the predefined operating points. For example, the illumination controller may comprise instructions or commands which assign "Operating Mode 1” to a first operating point with certain operating parameter, "Operating Point 2” to a second operating point with certain operating parameter, etc.. The data relating to the at least one operating mode may also be provided via an external input, for example via an application programming interface (API), allowing the external input to include the information about operating modes and operating points. The illumination controller may further be configured for selecting the respective operating points based on the operating mode. The illumination controller may further be capable of programing the integrated circuit of the camera, for example via an inter-integrated circuit (I2C) interface. The illumination controller may further be capable of programming the integrated circuit of the illumination source, specifically a driver of the pattern light source and / or a driver of the flood light source, for example via an inter-integrated circuit (I2C) interface. The programming of the driver of the pattern light source and / or the driver of the flood light source may be optional depending on the driver chosen. Further, the illumination controller may or may not include logic circuits to convert a strobe signal from the camera into trigger signals to the integrated circuit of the illumination source, specifically to the current drivers of the pattern light source and / or the flood light source. The conversion may also be external to the illumination controller. In one example, the illumination controller may comprise an architecture with external logic circuit. Alternatively, as another example, the illumination controller may comprise an architecture with internal logic circuit. Further, the illumination controller may be configured for generating an output to control current reduction output of current drivers and / or to control separate current reduction circuits.The illumination controller may further comprise at least one memory. The plurality of predefined operating points may be stored in the at least one memory of the illumination controller.
[0050] Further, the method may comprise using the selected predefined operating point once or repeatedly. Alternatively or additionally, the method may comprise selecting a plurality of predefined operating points and performing steps ill. and iv. consecutively for the different predefined operating points. Alternatively or additionally, the method may comprise repeating steps i. to iv., wherein in step i. of the repetition the input data may comprise data relating to at least one different operating mode.
[0051] The method may specifically be computer-implemented. The term "computer-implemented” as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to a method involving at least one computer and / or at least one computer network. The computer and / or computer network may comprise at least one processor which is configured for performing at least one of the method steps of the method according to the present invention. Preferably, each of the method steps is performed by the computer and / or computer network. The method may be performed completely automatically, specifically without user interaction.
[0052] In a further aspect of the present invention, an illumination and imaging controller configured for operating at least one illumination source and at least one camera of a detector at at least two different operating modes is disclosed. The detector comprises the illumination source and at least one camera. Each of the operating modes comprises one or more operating points. Each of the operating points is defined by at least one operating parameter of the illumination source and at least one operating parameter of the camera. The illumination and imaging controller is configured for performing a method according to the present invention, such as according to any one of the embodiments disclosed above and / or according to any one of the embodiments disclosed in further detail below. Thus, for possible embodiments and definitions of terms, reference is made to the description of the method above.
[0053] In a further aspect of the present invention, a detector comprising at least one illumination source and at least one camera is disclosed. The detector further comprises the illumination and imaging controller according to the present invention, such as according to any one of the embodiments disclosed above and / or according to any one of the embodiments disclosed in further detail below. Thus, for possible embodiments and definitions of terms, reference is made to the description of the method above.
[0054] In a further aspect of the present invention, a computer program is disclosed, comprising instructions which, when the program is executed by the illumination and imaging controller according to the present invention, such as according to any one of the embodiments disclosed above and / or according to any one of the embodiments disclosed in further detail below, cause the illumination and imaging controller to perform the method according to the present invention,such as according to any one of the embodiments disclosed above and / or according to any one of the embodiments disclosed in further detail below.
[0055] In a further aspect of the present invention, a computer-readable storage medium is disclosed, comprising instructions which, when the instructions are executed by the illumination and imaging controller according to the present invention, such as according to any one of the embodiments disclosed above and / or according to any one of the embodiments disclosed in further detail below, cause the illumination and imaging controller to perform the method according to the present invention, such as according to any one of the embodiments disclosed above and / or according to any one of the embodiments disclosed in further detail below.
[0056] As used herein, the term "computer-readable storage medium” specifically may refer to non-transitory data storage means, such as a hardware storage medium having stored thereon computer-executable instructions. The computer-readable storage medium specifically may be or may comprise a storage medium such as a random-access memory (RAM) and / or a read-only memory (ROM). The computer-readable storage medium may also be referred to as "computer-readable data carrier”.
[0057] In a further aspect of the present invention, a non-transient computer-readable medium is disclosed, including instructions that, when executed by one or more processors, cause the one or more processors to perform the method according to the present invention, such as according to any one of the embodiments disclosed above and / or according to any one of the embodiments disclosed in further detail below.
[0058] In a further aspect of the present invention, a use of a detector according to the present invention, such as according to any one of the embodiments disclosed above and / or according to any one of the embodiments disclosed in further detail below, is disclosed, for at least one purpose selected from the group consisting of: face authentication; 3D measurement in full power mode; 3D measurement low power mode; vital sign detection in full power mode; vital sign detection in low power mode; material classification in full power mode; material classification in low power mode.
[0059] Further disclosed and proposed herein is a computer program including computer-executable instructions for performing the method according to the present invention in one or more of the embodiments enclosed herein when the program is executed on a computer or computer network. Specifically, the computer program may be stored on a computer-readable data carrier and / or on a computer-readable storage medium.
[0060] Thus, specifically, one, more than one or even all of method steps I. to iv. as indicated above may be performed by using a computer or a computer network, preferably by using a computer program.
[0061] Further disclosed and proposed herein is a computer program product having program code means, in order to perform the method according to the present invention in one or more of the embodiments enclosed herein when the programis executed on a computer or computer network. Specifically, the program code means may be stored on a computer-readable data carrier and / or on a computer-readable storage medium.
[0062] Further disclosed and proposed herein is a data carrier having a data structure stored thereon, which, after loading into a computer or computer network, such as into a working memory or main memory of the computer or computer network, may execute the method according to one or more of the embodiments disclosed herein.
[0063] Further disclosed and proposed herein is a computer program product with program code means stored on a machine-readable carrier, in order to perform the method according to one or more of the embodiments disclosed herein, when the program is executed on a computer or computer network. As used herein, a computer program product refers to the program as a tradable product. The product may generally exist in an arbitrary format, such as in a paper format, or on a computer-readable data carrier and / or on a computer-readable storage medium. Specifically, the computer program product may be distributed over a data network.
[0064] Finally, disclosed and proposed herein is a modulated data signal which contains instructions readable by a computer system or computer network, for performing the method according to one or more of the embodiments disclosed herein.
[0065] Referring to the computer-implemented aspects of the invention, one or more of the method steps or even all of the method steps of the method according to one or more of the embodiments disclosed herein may be performed by using a computer or computer network. Thus, generally, any of the method steps including provision and / or manipulation of data may be performed by using a computer or computer network. Generally, these method steps may include any of the method steps, typically except for method steps requiring manual work, such as providing the samples and / or certain aspects of performing the actual measurements.
[0066] Specifically, further disclosed herein are:
[0067] a computer or computer network comprising at least one processor, wherein the processor is adapted to perform the method according to one of the embodiments described in this description,
[0068] a computer loadable data structure that is adapted to perform the method according to one of the embodiments described in this description while the data structure is being executed on a computer,
[0069] a computer program, wherein the computer program is adapted to perform the method according to one of the embodiments described in this description while the program is being executed on a computer,
[0070] a computer program comprising program means for performing the method according to one of the embodiments described in this description while the computer program is being executed on a computer or on a computer network,
[0071] a computer program comprising program means according to the preceding embodiment, wherein the program means are stored on a storage medium readable to a computer,a storage medium, wherein a data structure is stored on the storage medium and wherein the data structure is adapted to perform the method according to one of the embodiments described in this description after having been loaded into a main and / or working storage of a computer or of a computer network, and
[0072] a computer program product having program code means, wherein the program code means can be stored or are stored on a storage medium, for performing the method according to one of the embodiments described in this description, if the program code means are executed on a computer or on a computer network.
[0073] As used herein, the terms "have”, "comprise” or "include” or any arbitrary grammatical variations thereof are used in a non-exclusive way. Thus, these terms may both refer to a situation in which, besides the feature introduced by these terms, no further features are present in the entity described in this context and to a situation in which one or more further features are present. As an example, the expressions "A has B”, "A comprises B” and "A includes B” may both refer to a situation in which, besides B, no other element is present in A (i.e. a situation in which A solely and exclusively consists of B) and to a situation in which, besides B, one or more further elements are present in entity A, such as element C, elements C and D or even further elements.
[0074] Further, it shall be noted that the terms "at least one”, "one or more” or similar expressions indicating that a feature or element may be present once or more than once typically are used only once when introducing the respective feature or element. In most cases, when referring to the respective feature or element, the expressions "at least one” or "one or more” are not repeated, nonwithstanding the fact that the respective feature or element may be present once or more than once.
[0075] Further, as used herein, the terms "preferably", "more preferably", "particularly", "more particularly", "specifically", "more specifically" or similar terms are used in conjunction with optional features, without restricting alternative possibilities. Thus, features introduced by these terms are optional features and are not intended to restrict the scope of the claims in any way. The invention may, as the skilled person will recognize, be performed by using alternative features. Similarly, features introduced by "in an embodiment of the invention" or similar expressions are intended to be optional features, without any restriction regarding alternative embodiments of the invention, without any restrictions regarding the scope of the invention and without any restriction regarding the possibility of combining the features introduced in such way with other optional or non-optional features of the invention.
[0076] The method and devices according to the present invention may have a large number of advantages over known methods and devices of similar kind. Specifically, the method and devices according to the present invention allow to apply different operating points on the same hardware system for different functions. For example, the invention allows to define multiple operating modes, to define multiple operating points per operating mode and / or to define the operating parameters, such as pulse-frequency, pulse-width and peak-current, per operating point.The method may specifically be useful for modifying the operating point based on feature context during the operation of the detector. Thus, in this approach, different operating points may be used for different functions, such as vital-sign measurement, secure face authentication, and the like. Alternatively or additionally, a low-power mode can also be employed which may be implemented as a subset of a certain function. For example, it may be possible to perform a full power 3D-measurement at regular intervals and a low-power 3D-measurement at regular intervals with a higher frequency. In this example, at least two operating points would have to be defined, such as a full power 3D-measure-ment mode and a low power 3D-measurement mode. However, the method may not be limited to the 3D-measurement function. The method may be equally applied to other functions, especially vital-sign measurement and seatbelt material classification or the like.
[0077] The method may comprise defining a number of operating modes, for example secure face authentication, 3D-full power, 3D-low power, vital-sign full power, and / or vital-sign low power. Each operating mode may consist of one or more operating points. For example, an operating mode with multiple operating points may be the operating mode "secure face authentication” comprising a first operating point, e.g. with a Tx-flood exposure of 1.5 A, a pulse-width of 4 ms, and a frequency of 30 Hz, and a second operating point, e.g. with a Tx-dot exposure of 1.5 A, a pulse-width of 1 ms, and a frequency of 30 Hz. In this example, the two operating points may be used just once or may be used be repeated, specifically consecutively to each other. Alternatively or additionally, an operating mode may also include the same device more than once, such as the operating mode "secure face authentication” comprising a first operating point, e.g. with a Tx-flood exposure of 1.5 A, a pulse-width of 4 ms, and a frequency of 30 Hz, a second operating point, e.g. with a Tx-dot exposure of 1.5 A, a pulse-width of 1 ms, and a frequency of 30 Hz, and a third operating point, e.g. with a Tx-flood exposure of 1.5 A, a pulse-width of 20 ms, and a frequency of 30 Hz. However, other example are also feasible.
[0078] Summarizing and without excluding further possible embodiments, the following embodiments may be envisaged:
[0079] Embodiment 1 : A method for operating at least one illumination source and at least one camera of a detector at at least two different operating modes,
[0080] wherein the detector comprises the illumination source and the camera,
[0081] wherein each of the operating modes comprises one or more operating points, wherein each of the operating points is defined by at least one operating parameter of the illumination source and at least one operating parameter of the camera,
[0082] wherein the method comprises the following steps:
[0083] i. retrieving input data comprising data relating to at least one operating mode, in which the illumination source and the camera are to be operated;
[0084] ii. selecting in accordance with the received input data at least one predefined operating point from a plurality of predefined operating points;iii. programming at least one integrated circuit of the camera depending on the selected predefined operating point;
[0085] iv. generating at least one trigger signal comprising information about the selected predefined operating point and providing the trigger signal to at least one integrated circuit of the illumination source.
[0086] Embodiment 2: The method according to the preceding embodiment, wherein the operating parameter comprises one or more of: peak-current, pulse-width, pulse frequency, optical power.
[0087] Embodiment 3: The method according to any one of the preceding embodiments, wherein the method comprises setting the operating parameter of the illumination source depending on the selected predefined operating point.
[0088] Embodiment 4: The method according to any one of the preceding embodiments, wherein the operating modes comprise at least a first operating mode and at least a second operating mode, wherein the first operating mode is a low power mode and the second operating mode is a full power mode.
[0089] Embodiment 5: The method according to any one of the preceding embodiments, wherein the method comprises using the selected predefined operating point for at least one function selected from the group consisting of: face authentication; 3D measurement in full power mode; 3D measurement low power mode; vital sign detection in full power mode; vital sign detection in low power mode; material classification in full power mode; material classification in low power mode.
[0090] Embodiment 6: The method according to any one of the preceding embodiments, wherein the operating point is selected during operation of the illumination source.
[0091] Embodiment 7: The method according to any one of the preceding embodiments, wherein the input data comprises data relating to at least one operating mode and / or at least one operating point.
[0092] Embodiment 8: The method according to any one of the preceding embodiments, wherein the input data comprises data relating to feature context.
[0093] Embodiment 9: The method according to any one of the preceding embodiments, wherein the data relating to at least one operating mode comprises data relating to at least one predefined sequence.
[0094] Embodiment 10: The method according to any one of the preceding embodiments, wherein the method comprises using the selected predefined operating point once or repeatedly, and / or wherein the method comprises selecting a plurality of predefined operating points and performing steps ill. and iv. consecutively for the different predefined operating points.Embodiment 11 : The method according to any one of the preceding embodiments, wherein the method comprises repeating steps i. to iv., wherein in step i. of the repetition the input data comprises data relating to at least one different operating mode.
[0095] Embodiment 12: The method according to any one of the preceding embodiments, wherein the input data is retrieved via at least one communication interface such as an Application Programming Interface.
[0096] Embodiment 13: The method according to any one of the preceding embodiments, wherein the input data is provided by at least one external data source, wherein the external data source comprises one or more of at least one external processor and / or a user interface.
[0097] Embodiment 14: The method according to any one of the preceding embodiments, wherein steps I. to iv. are performed and / or triggered by at least one illumination controller, wherein the illumination controller comprises at least one element selected from the group consisting of: a processor; a logic circuit; a Micro-Controller; an FPGA, a CPU.
[0098] Embodiment 15: The method according to any one of the preceding embodiments, wherein the plurality of predefined operating points are stored in at least one memory of the illumination controller.
[0099] Embodiment 16: The method according to any one of the preceding embodiments, wherein step iv. comprises programming the integrated circuit of the illumination source.
[0100] Embodiment 17: The method according to any one of the preceding embodiments, wherein step iv. comprises converting a strobe signal from the camera into the trigger signal.
[0101] Embodiment 18: The method according to any one of the preceding embodiments, wherein the trigger signal comprises information for control current reduction output of the integrated circuit of the illumination source and / or wherein the trigger signal is used for controlling at least one separate current reduction circuit.
[0102] Embodiment 19: The method according to any one of the preceding embodiments, wherein the illumination source comprises at least one element selected from the group consisting of: at least one point light source; at least one pattern light source; and at least one flood light source.
[0103] Embodiment 20: The method according to any one of the preceding embodiments, wherein the detector comprises a plurality of illumination sources.Embodiment 21 : The method according to any one of the preceding method embodiments, wherein the method is computer-implemented.
[0104] Embodiment 22: An illumination and imaging controller configured for operating at least one illumination source and at least one camera of a detector at at least two different operating modes, wherein the detector comprises the illumination source and at least one camera, wherein each of the operating modes comprises one or more operating points, wherein each of the operating points is defined by at least one operating parameter of the illumination source and at least one operating parameter of the camera, wherein the illumination and imaging controller is configured for performing a method according to any one of the preceding embodiments.
[0105] Embodiment 23: A detector comprising at least one illumination source and at least one camera, wherein the detector further comprises the illumination and imaging controller according to the preceding embodiment.
[0106] Embodiment 24: A computer program comprising instructions which, when the program is executed by the illumination and imaging controller according to embodiment 22, cause the illumination and imaging controller to perform the method according to any one of the preceding embodiments referring to a method on the detector.
[0107] Embodiment 25: A computer-readable storage medium comprising instructions which, when the instructions are executed by the illumination and imaging controller according to embodiment 22, cause the illumination and imaging controller to perform the method according to any one of the preceding embodiments referring to a method.
[0108] Embodiment 26: A non-transient computer-readable medium including instructions that, when executed by one or more processors, cause the one or more processors to perform the method according to any one of the preceding embodiments referring to a method.
[0109] Embodiment 27: Use of a detector according to embodiment 23 for at least one purpose selected from the group consisting of: face authentication; 3D measurement in full power mode; 3D measurement low power mode; vital sign detection in full power mode; vital sign detection in low power mode; material classification in full power mode; material classification in low power mode.
[0110] Short description of the Figures
[0111] Further optional features and embodiments will be disclosed in more detail in the subsequent description of embodiments, preferably in conjunction with the dependent claims. Therein, the respective optional features may be realized in an isolated fashion as well as in any arbitrary feasible combination, as the skilled person will realize. The scope ofthe invention is not restricted by the preferred embodiments. The embodiments are schematically depicted in the Figures. Therein, identical reference numbers in these Figures refer to identical or functionally comparable elements.
[0112] In the Figures:
[0113] Figure 1 shows a flow chart of an embodiment of a method for operating at least one illumination source and at least one camera of a detector at at least two different operating modes; and
[0114] Figures 2 to 5 show different embodiments of a detector in a schematic view.
[0115] Detailed description of the embodiments
[0116] Figure 1 shows a flow chart of an exemplary embodiment of a method for operating at least one illumination source and at least one camera of a detector at at least two different operating modes. The detector is described in Figures 2 to 5 in further detail below and comprises the illumination source and the camera. Each of the operating modes comprises one or more operating points. Each of the operating points is defined by at least one operating parameter of the illumination source and at least one operating parameter of the camera. As an example, in this exemplary embodiment, the operating point may comprise a combination of peak-current, pulse-width and pulse frequency for the illumination source and the camera. However, other examples are also feasible.
[0117] The method comprises the following steps that may be performed in the given order. However, a different order may also be possible. In particular, one, more than one or even all of the method steps may be performed once or repeatedly. Further, the method steps may be performed successively or, alternatively, one or more of the method steps may be performed in a timely overlapping fashion or even in a parallel fashion and / or in a combined fashion. The method may further comprise additional method steps that are not listed.
[0118] The method comprises the following steps:
[0119] I. (denoted by reference number 110) retrieving input data comprising data relating to at least one operating mode, in which the illumination source and the camera are to be operated;
[0120] II. (denoted by reference number 112) selecting in accordance with the received input data at least one predefined operating point from a plurality of predefined operating points;
[0121] ill. (denoted by reference number 114) programming at least one integrated circuit of the camera depending on the selected predefined operating point;
[0122] iv. (denoted by reference number 116) generating at least one trigger signal comprising information about the selected predefined operating point and providing the trigger signal to at least one integrated circuit of the illumination source.The method may comprise using the selected predefined operating point for at least one function selected from the group consisting of: face authentication; 3D measurement in full power mode; 3D measurement low power mode; vital sign detection in full power mode; vital sign detection in low power mode; material classification in full power mode; material classification in low power mode.
[0123] Steps I. to iv. may be performed and / or triggered by at least one illumination controller. The illumination controller may specifically comprise at least one element selected from the group consisting of: a processor; a logic circuit; a Microcontroller; an FPGA, a CPU. The illumination controller may specifically be an illumination controller of the detector. This is shown in Figures 2 to 5 in further detail. Thus, for further details of the method, reference is made to the following description of the detector in Figures 2 to 5.
[0124] Figures 2 to 5 shows different embodiments of a detector 118 in a schematic view. The detector 118, as shown in Figure 2, comprises at least one illumination source 120 and at least one camera 122. As an example, the illumination source 120 may comprise a pattern light source 124 and a flood light source 126.
[0125] The detector 118 further comprises the illumination and imaging controller 128 according to the present invention. The illumination and imaging controller 128 is configured for operating the at least one illumination source 120 and the at least one camera 122 of the detector 118 at at least two different operating modes. Each of the operating modes comprises one or more operating points. Each of the operating points is defined by at least one operating parameter of the illumination source 120 and at least one operating parameter of the camera 122. The illumination and imaging controller 128 is configured for performing a method according to the present invention, such as according to the exemplary embodiment of Figure 1 and / or according to any other embodiment disclosed herein.
[0126] As shown in Figure 2, the input data may be provided by at least one external data source 130, wherein the external data source 130 may comprise one or more of at least one external processor and / or a user interface. As outlined above, in this example, the illumination controller 128 may retrieve the input data comprising data relating to at least one operating mode, in which the illumination source 120 and the camera 122 are to be operated, and may select in accordance with the received input data the at least one predefined operating point from a plurality of predefined operating points. Further, in this example, the illumination controller 128 may program the at least one integrated circuit of the camera 122 depending on the selected predefined operating point (denoted by reference number 132). Optionally, step iv. may comprise programming the integrated circuit of the illumination source 120. Thus, as indicated in Figure 2, the illumination controller 128 may program the integrated circuit of the illumination source 120 (denoted by reference number 132), in this case, a driver 134 of the pattern light source 124 and a driver 136 of the flood light source 126.
[0127] Further, as can be seen in Figure 2, the detector 118, in this example, may comprise a logic circuit 138. Step iv. may comprise converting a strobe signal 140 from the camera 122 into the trigger signal 142, specifically using the logiccircuit 138 shown in Figure 2. The trigger signal 142 may be provided to the driver 134 of the pattern light source 124 and to the driver 136 of the flood light source 126, which may provide a current 144 to the pattern light source 124 and to the flood light source 126, respectively, in accordance with the selected predefined operating point. Thus, Figure 2 shows a simple setup of the detector 118 with Illumination controller 128, where the trigger signal 142 may be provided by the camera 122 and the logic circuit 138.
[0128] Figure 3 shows a further exemplary embodiment of the detector 118. The embodiment of Figure 3 widely corresponds to the embodiment shown in Figure 2. Thus, for a detailed description of the detector 118, reference is made to the description of Figure 2. However, in contrast, the embodiment of the detector 118 shown in Figure 3 does not comprise the logic circuit 138. In this example, the camera 122 may provide the strobe signal 140 to the illumination controller 128, which may provide the trigger signal 142 to the driver 134 of the pattern light source 124 and to the driver 136 of the flood light source 126, respectively. Thus, Figure 3 shows another simple setup of the Illumination controller 128 receiving the strobe signal 140 from camera 122 and providing the trigger signal 142 to the illumination source 120, specifically to the trigger signal 142 to the driver 134 of the pattern light source 124 and to the driver 136 of the flood light source 126. In the specific embodiments of Figures 2 and 3, both the pulse-frequency and pulse-width per operating point can be controlled via the programming of the camera 122 by the illumination controller 128.
[0129] Figure 4 shows a further exemplary embodiment of the detector 118. The embodiment of Figure 4 widely corresponds to the embodiment shown in Figure 2. Thus, for a detailed description of the detector 118, reference is made to the description of Figure 2. However, as can be seen in Figure 4, the illumination source 120 may comprise a current reduction input 146. Specifically, the driver 134 of the pattern light source 124 and / or the driver 136 of the flood light source 126 may comprise the current reduction input 146. The illumination controller 128 may provide a current reduction signal 148 to the illumination source 120, specifically to the current reduction input 146 of the driver 134 of the pattern light source 124 and / or of the driver 136 of the flood light source 126, in accordance with the selected predefined operating point. Thus, Figure 4 shows that the illumination controller 128 may also be used for driving current reduction (dimming) input of the illumination source 120, specifically of the driver 134 of the pattern light source 124 and / or of the driver 136 of the flood light source 126. With this method, the peak current received by the illumination source 120, specifically by the pattern light source 124 and / or of the flood light source 126, may be controlled.
[0130] For example, the driver 134 of the pattern light source 124 and / or of the driver 136 of the flood light source 126 may be configured for dynamically reducing the output current via the current reduction input 146, sometimes called "dimming input”. The absolute peak-current of the current driver may be defined either by programming or external components. The output peak-current may be dynamically reduced: For example, in a first operating mode, the peak-current may be 2 A, and in a second operating mode, the peak-current could be reduced by a factor of 2 to 1 A. The illumination controller 128 may control this input, based on the current operating mode, and optionally also based on the current operating point. For example, in a first operating mode, a first operating point for the flood light source 126 may use 3 A, and a second operating point of the first operating mode may use 1.8 A for the flood light source126. The current144 may be dynamically adjusted by programming the driver 134 of the pattern light source 124 and / or the driver 136 of the flood light source 126, in particular in situations where the current 144 can be controlled by setting for example a register in the drivers 134, 136 to a certain value.
[0131] Figure 5 shows a further exemplary embodiment of the detector 118. The embodiment of Figure 5 widely corresponds to the embodiment shown in Figure 2. Thus, for a detailed description of the detector 118, reference is made to the description of Figure 2. However, in this exemplary embodiment, the detector 118 may comprise a current reduction circuit 150. Thus, in case the current drivers 134, 136 may not contain the capability to dynamically reduce the peakcurrent, it may be possible to implement this functionality externally using the current reduction circuit 150, for example comprising switches and a resistor network or the like, diverting a certain portion of the current 144 such that only a part of the current 144 reaches the driver 134 of the pattern light source 124 and / or the driver 136 of the flood light source 126. However, this may be less effective as the diverted current would lead to a temperature increase in the resistors. Other methods of current diversion are also possible. Thus, Figure 5 shows an illumination controller 128 configured for driving the external current reduction circuit 150.List of reference numbers
[0132] 110 retrieving input data
[0133] 112 selecting at least one predefined operating point
[0134] 114 programming at least one integrated circuit of the camera 116 generating at least one trigger signal
[0135] 118 detector
[0136] 120 illumination source
[0137] 122 camera
[0138] 124 pattern light source
[0139] 126 flood light source
[0140] 128 illumination and imaging controller
[0141] 130 external data source
[0142] 132 programming
[0143] 134 driver of the pattern light source
[0144] 136 driver of the flood light source
[0145] 138 logic circuit
[0146] 140 strobe signal
[0147] 142 trigger signal
[0148] 144 current
[0149] 146 current reduction input
[0150] 148 current reduction signal
[0151] 150 current reduction circuit
Claims
- 28 -Claims1. A method for operating at least one illumination source (120) and at least one camera (122) of a detector (118) at at least two different operating modes,wherein the detector (118) comprises the illumination source (120) and the camera (122),wherein each of the operating modes comprises one or more operating points, wherein each of the operating points is defined by at least one operating parameter of the illumination source (120) and at least one operating parameter of the camera (122),wherein the method comprises the following steps:I. retrieving input data comprising data relating to at least one operating mode, in which the illumination source (120) and the camera (122) are to be operated;ii. selecting in accordance with the received input data at least one predefined operating point from a plurality of predefined operating points;ill. programming at least one integrated circuit of the camera (122) depending on the selected predefined operating point;iv. generating at least one trigger signal (142) comprising information about the selected predefined operating point and providing the trigger signal (142) to at least one integrated circuit of the illumination source (120).
2. The method according to the preceding claim, wherein the operating parameter comprises one or more of:peak-current, pulse-width, pulse frequency, optical power.
3. The method according to any one of the preceding claims, wherein the method comprises setting the operating parameter of the illumination source (120) depending on the selected predefined operating point.
4. The method according to any one of the preceding claims, wherein the operating modes comprise at least a first operating mode and at least a second operating mode, wherein the first operating mode is a low power mode and the second operating mode is a full power mode.
5. The method according to any one of the preceding claims, wherein the method comprises using the selected predefined operating point for at least one function selected from the group consisting of: face authentication; 3D measurement in full power mode; 3D measurement low power mode; vital sign detection in full power mode; vital sign detection in low power mode; material classification in full power mode; material classification in low power mode.
6. The method according to any one of the preceding claims, wherein the method comprises using the selected predefined operating point once or repeatedly, and / or wherein the method comprises selecting a plurality of predefined operating points and performing steps ill. and iv. consecutively for the different predefined operating points and / or wherein the method comprises repeating steps I. to iv., wherein in step I. of the repetition the input data comprises data relating to at least one different operating mode.
7. The method according to any one of the preceding claims, wherein steps I. to iv. are performed and / or triggered by at least one illumination controller (128), wherein the illumination controller (128) comprises at least one element selected from the group consisting of: a processor; a logic circuit; a Micro-Controller; an FPGA, a CPU.
8. The method according to any one of the preceding claims, wherein step iv. comprises programming the integrated circuit of the illumination source (120).
9. The method according to any one of the preceding claims, wherein the trigger signal (142) comprises information for control current reduction output of the integrated circuit of the illumination source (120) and / or wherein the trigger signal (142) is used for controlling at least one separate current reduction circuit (150).
10. An illumination and imaging controller (128) configured for operating at least one illumination source (120) and at least one camera (122) of a detector (118) at at least two different operating modes, wherein the detector (118) comprises the illumination source (120) and at least one camera (122), wherein each of the operating modes comprises one or more operating points, wherein each of the operating points is defined by at least one operating parameter of the illumination source (120) and at least one operating parameter of the camera (122), wherein the illumination and imaging controller (128) is configured for performing a method according to any one of the preceding claims.
11. A detector (118) comprising at least one illumination source (120) and at least one camera (122), wherein the detector (118) further comprises the illumination and imaging controller (128) according to the preceding claim.
12. A computer program comprising instructions which, when the program is executed by the illumination and imaging controller (128) according to claim 10, cause the illumination and imaging controller (128) to perform the method according to any one of the preceding claims referring to a method on the detector (118).
13. A computer-readable storage medium comprising instructions which, when the instructions are executed by the illumination and imaging controller (128) according to claim 10, cause the illumination and imaging controller (128) to perform the method according to any one of the preceding claims referring to a method.
14. A non-transient computer-readable medium including instructions that, when executed by one or more processors, cause the one or more processors to perform the method according to any one of the preceding claims referring to a method.
15. Use of a detector (118) according to claim 11 for at least one purpose selected from the group consisting of:face authentication; 3D measurement in full power mode; 3D measurement low power mode; vital sign detection in full power mode; vital sign detection in low power mode; material classification in full power mode; material classification in low power mode.
