Image enhanced skin analysis

Abstract

The invention relates to a method for obtaining at least one item of object condition information about an object (147), the method comprising: i. Acquiring image data of the object (147) by using at least one image generation unit (134); ii. Evaluating the image data to obtain at least one item of information about a local characteristic of the object (147); and evaluating at least one item of information about a local characteristic of the object (147) to obtain one or more measured locations on the object (147); iii. Acquiring at least one item of spectral information about the object (147) at one or more measurement locations using the spectrometer device (138); and iv. Evaluating the spectral information item to obtain at least one object condition information item about the at least one object (147), where evaluating the spectral information item to obtain the at least one object condition information item about the at least one object (147) further comprises evaluating the image data to obtain the at least one object (147) condition information item.

Description

Technical Field

[0001] This invention relates to a method for obtaining at least one object status information item about an object, an apparatus for obtaining at least one object status information item about at least one object, a computer program, and a non-transitory computer-readable storage medium. The method and apparatus according to the invention can be specifically used, for example, in various fields such as daily life, security technology, gaming, transportation technology, production technology, photography (e.g., digital or video photography for artistic, documentation, or technical purposes), safety technology, information technology, agriculture, crop protection, maintenance, beauty, and medical technology, or in science. However, other applications are also possible. Background Technology

[0002] Skin moisture content can be analyzed using infrared spectroscopy. Users may not typically be interested in the moisture content itself, but rather in the information gleaned from it, such as skincare needs, early disease detection, or overall health status. Therefore, a model is needed to translate skin moisture into useful information for users.

[0003] The problem with these models may be that skin moisture levels can vary between different areas of the skin (especially facial skin). Furthermore, measurements can be affected by localized phenomena such as eczema, lesions, or papules. For some applications, the average skin moisture level may not be sufficient information to obtain meaningful results.

[0004] US 6,529,767 B1 discloses a set of reference moisture values ​​for multiple skin samples measured using a conventional skin moisture measurement device. A set of standard calibration equations is then provided by calculating a set of measured calibrated reflectance spectra and the set of reference moisture values ​​using multiple regression, and these equations are stored in memory. The next step is to measure the skin moisture of the tested skin against this set of standard calibration equations stored in memory. Skin moisture is measured in a repeatable and stable manner by using a portable skin moisture measurement device to irradiate the test skin with near-infrared reflectance spectroscopy and sense a set of reflectance spectra, unaffected by changes in external environmental temperature or humidity.

[0005] WO 2018 166 749 A1 relates to a method for determining skin moisture content, which has various embodiments. The method may include: bringing at least one skin area of ​​a user into contact with at least one sensor contact area of ​​a skin moisture measuring device; recording a signal related to skin moisture in the skin area, the signal being generated by the skin moisture measuring device; and associating the skin moisture content with the recorded signal by comparing the recorded signal with a reference signal of known skin moisture content. According to the method, the skin moisture content can be associated with the recorded signal using a database stored in a processor-cloud architecture.

[0006] WO 2023 / 161331 A1 relates to a method for obtaining at least one object information item about at least one object by means of spectral measurement. The method includes the steps of: i. acquiring spectral data using at least one spectrometer device within at least one spatial measurement range of the spectrometer device; ii. acquiring image data of a scene within the field of view of at least one imaging device, specifically using a camera, the scene including at least a portion of the object and at least a portion of the spatial measurement range of the spectrometer device; and iii. evaluating the spectral data from step i. and at least one image information item obtained from the image data from step ii. to obtain at least one object information item about the at least one object.

[0007] WO 2021 / 064232 A1 relates to systems and methods for diagnosing skin conditions and determining deviations from normal appearance. In one aspect, a computer-implemented method involves: receiving a plurality of images of a subject by an image sensor of a computing device; and determining a region of interest (ROI) for each of the plurality of images by the computing device. The computer-implemented method further involves generating a skin condition measure for each of the plurality of images by a neural network configured within the computing device, relating to the severity of at least one skin condition manifested by the ROI. The computer-implemented method also involves comparing the skin condition measure with one or more stored measures at the computing device, and providing a titration recommendation by the computing device based on the comparison.

[0008] GB 2 448 546 A relates to an apparatus for acquiring data related to the protein structure of a nail, for example as a means of establishing an analogy with bone conditions. The apparatus includes a positioning device, preferably in the form of a removable receptacle, for positioning fingers of the hand in a fixed position within the apparatus. The apparatus further includes: an optical device for generating a light beam, preferably a laser, and directing the beam to one or more points on the nail to irradiate the nail; a collecting device for collecting radiation scattered by the nail; and an evaluation device for evaluating the collected radiation by Raman spectroscopy to provide data indicating the nail structure. The physical and chemical structure of keratinized tissue can be evaluated with consistent and reproducible results.

[0009] US 2019 / 117134 A1 relates to a method and system for measuring post-translational modifications of proteins in a subject. The method includes recording infrared radiation within a predetermined wavenumber range and attenuated by the subject's body tissue, such that the body tissue remains attached to the subject. The method further includes the step of comparing the attenuation of the infrared radiation with a predetermined value to obtain information about the post-translational modifications of proteins in the body tissue.

[0010] US 2020 / 176099 relates to a method for determining the condition of a body region. The method may include determining at least one body condition parameter and using the at least one body condition parameter to determine the condition of a body region. Determining the body condition parameter includes: recording multiple images of at least a portion of the light that has interacted with the body region while the user's body region is sequentially exposed to light of different colors via a display of a portable data processing device; determining spectral characteristics of the body region from the multiple images; comparing the spectral characteristics with calibration spectral characteristics obtained for multiple calibrated body regions; and determining the body condition parameter, including the comparison result. The problem to be solved

[0011] Therefore, it is desirable to provide a method or device that at least partially addresses the aforementioned technical challenges and at least substantially avoids the drawbacks of known devices.

[0012] In particular, the object of the present invention may be to enable a method for obtaining at least one object condition information item about an object, an apparatus for obtaining at least one object condition information item about at least one object, a computer program, and a non-transitory computer-readable storage medium to determine information items, such as skin moisture levels, in a more reliable and accurate manner.

[0013] More specifically, an object of the present invention may be to enable a method for obtaining at least one object status information item about an object, an apparatus for obtaining at least one object status information item about at least one object, a computer program, and a non-transitory computer-readable storage medium to determine object processing information items in a more reliable and accurate manner. More specifically, an object of the present invention may be to reduce the number of measurements. Summary of the Invention

[0014] This problem is solved by a method for obtaining at least one object status information item about an object, an apparatus for obtaining at least one object status information item about at least one object, a computer program, and a non-transitory computer-readable storage medium, as described by the features of the independent claims. Advantageous embodiments that can be implemented independently or in any arbitrary combination are set forth in the dependent claims and throughout the specification.

[0015] In a first aspect, a method for obtaining at least one object status information item about an object is disclosed. For this aspect, reference may be made to any definitions, embodiments, and / or other aspects as disclosed elsewhere herein.

[0016] The steps of a method for obtaining at least one object status information item about an object can be performed in a given order. However, a different order is also possible. Furthermore, two or more of these method steps can be performed simultaneously. Thus, these method steps can at least partially overlap in time. Furthermore, these method steps can be performed once or repeatedly. Furthermore, one or more, or even all, of these method steps can be performed once or repeatedly. The method may include additional method steps not listed herein.

[0017] The method for obtaining at least one object status information item about an object can be a computer-implemented method. Alternatively or additionally, at least one of these method steps, preferably any one of these method steps, can be performed using a device including at least one processor for performing these steps. As used herein, the term "computer-implemented method" is a broad term and will be given its common and conventional meaning to those skilled in the art and is not limited to a specific or custom meaning. The term can specifically refer to, but is not limited to, a method involving at least one device (specifically a computer) or, in particular, multiple devices connected via a computer network. The multiple devices can be connected via a network using at least one connection interface at any one of the multiple devices, particularly for transmitting data. The computer-implemented method can be implemented as at least one computer program, which can be provided on a storage medium carrying the computer program, thereby performing at least one step of the computer-implemented method, specifically, at least one step, by using the at least one computer program. Preferably, any one of these steps can be performed using the at least one computer program. Alternatively, the at least one computer program can be accessed by a device suitable for performing the method via a network (e.g., via an intranet, via the Internet, or via the cloud). Therefore, particularly with respect to the present invention, this method can be executed on a programmable device configured for this purpose, for example by providing a computer program configured for this purpose.

[0018] The method includes:

[0019] i. Obtain the image data of the object by using at least one image generation unit;

[0020] ii. Specifically, by using an evaluation unit, the image data is evaluated to obtain at least one piece of information about the local characteristics of the object; and the at least one piece of information about the local characteristics of the object is evaluated to obtain one or more measurement locations on the object;

[0021] iii. Acquire at least one spectral information item about the object at one or more measurement locations using a spectrometer; and

[0022] iv. Evaluate the at least one spectral information item to obtain at least one object condition information item about the at least one object, particularly by using an evaluation unit.

[0023] As already disclosed, the method includes the step of acquiring image data of the object using at least one image generation unit.

[0024] An “object” can generally be any body selected from living and non-living objects. Thus, as an example, at least one object can include one or more articles and / or one or more parts of articles, wherein at least one article or at least one part thereof can include at least one component that can provide a spectrum suitable for study. Additionally or alternatively, an object can be or can include one or more organisms and / or one or more parts thereof, such as one or more body parts of a human (e.g., a user) and / or an animal. An object can be skin, such as human skin. An object can be the nails of an organism, particularly human nails.

[0025] As used herein, the term “acquisition” is a broad term and will be given its common and conventional meaning to those skilled in the art and is not limited to any particular or custom meaning. The term may specifically refer to, but is not limited to, obtaining and / or acquiring ownership of something. Therefore, acquisition may include at least one step of receiving and / or obtaining and / or generating and / or recording. “Acquiring image data” may be and / or may include generating image data and / or recording image data, particularly active method steps performed as part of the method.

[0026] As used herein, the term "image data" is a broad term and will be given its common and conventional meaning to those skilled in the art, and is not limited to any particular or custom meaning. Specifically, the term may refer to, but is not limited to, a collection of information representing visual content in a digital format. Typically, image data may include one or more pixels. These pixels may be arranged in a known manner, particularly in a known grid arrangement. Any of these pixels may include at least one numerical value defining the color and / or intensity of the corresponding pixel. The numerical value may be binary data and / or data from a known color model, such as RGB (red, green, blue) or CMYK (cyan, magenta, yellow, black). Alternatively or additionally, image data may be vector image data. Vector image data may be at least one of the following: one or more points, one or more lines, one or more curves, and one or more other geometric elements. Image data may include information about visible light, particularly light with wavelengths between 380 nm and 750 nm.

[0027] As used herein, the term "image generation unit" (also referred to as "camera") is a broad term and will be given its common and conventional meaning to those skilled in the art and is not limited to any particular or custom meaning. Specifically, the term may refer to, but is not limited to, a device having at least one imaging element configured to record or capture spatially resolved one-dimensional, two-dimensional, or even three-dimensional optical data or information. As an example, an image generation unit may include at least one chip, such as at least one CCD chip and / or at least one CMOS chip configured to record images. For example, an image generation unit may be a color image generation unit, as will be described in detail below, comprising at least three color pixels. An image generation unit may be a color CMOS image generation unit. For example, an image generation unit may include monochrome pixels and color pixels. Color pixels and monochrome pixels may be internally combined within the image generation unit. An image generation unit may include at least one color image generation unit and at least one monochrome image generation unit, such as a monochrome CMOS. An image generation unit may include at least one monochrome CMOS chip. An image generation unit may typically include an image sensor (e.g., pixels) in a one-dimensional or two-dimensional array. An image generation unit may be sensitive to visible light, particularly visible light with wavelengths between 380 nm and 750 nm.

[0028] As already disclosed, the method includes the following steps: in particular, by using an evaluation unit, evaluating the image data to obtain at least one piece of information about the local characteristics of the object; and evaluating the at least one piece of information about the local characteristics of the object to obtain one or more measurement locations on the object.

[0029] As used herein, the term "evaluation" is a broad term and will be given its common and conventional meaning to those skilled in the art, and is not limited to a specific or custom meaning. Specifically, the term may refer to, but is not limited to, a process of processing at least one first information item to generate at least one second information item. Therefore, as used herein, the term "evaluation unit" is a broad term and will be given its common and conventional meaning to those skilled in the art, and is not limited to a specific or custom meaning. Specifically, the term may refer to, but is not limited to, any device or combination of devices configured to evaluate or process at least one first information item to generate at least one second information item thereof. Therefore, specifically, an evaluation unit may be configured to process at least one input signal and generate at least one output signal thereof. As an example, the at least one input signal may include at least one detector signal provided directly or indirectly by at least one photodetector.

[0030] As an example, the evaluation unit may be or may include one or more integrated circuits (such as one or more application-specific integrated circuits (ASICs)) and / or one or more data processing devices (such as one or more of a computer, digital signal processor (DSP), or field-programmable gate array (FPGA), preferably one or more microcomputers and / or microcontrollers. Additional components may be included, such as one or more preprocessing devices and / or data acquisition devices, such as one or more devices for receiving and / or preprocessing detector signals, such as one or more AD converters and / or one or more filters. Further, the evaluation unit may include one or more data storage devices. Further, the evaluation unit may include one or more interfaces, such as one or more wireless interfaces and / or one or more wired interfaces.

[0031] The evaluation unit may be included by a device. Alternatively or additionally, the evaluation unit may be included by a spectrometer device. Alternatively or additionally, the evaluation unit may include components included by a remote device (such as a server). The evaluation unit may include multiple sub-units, wherein each sub-unit performs a specific step of the method. At least one sub-unit of the evaluation unit may be included by a spectrometer device. At least one sub-unit of the evaluation unit may be included by a device.

[0032] As used herein, the term "acquisition" is a broad term and will be given its common and conventional meaning to those skilled in the art, and is not limited to any particular or custom meaning. Specifically, the term may refer to, but is not limited to, the process of obtaining access to data (such as information). Acquisition may include receiving data from a transmitting device. To receive data, acquisition may include requesting data from the transmitting device, such as by sending a query to the transmitting device. Alternatively or additionally, acquisition may include actively generating data, particularly in evaluation steps performed using an evaluation unit.

[0033] As used herein, the term "information item concerning a local characteristic of an object" is a broad term and will be given its common and conventional meaning to those skilled in the art, and is not limited to any particular or custom meaning. Specifically, the term may refer to, but is not limited to, at least one non-uniformity of an object, also referred to as information concerning "irregularities." The non-uniformity of an object can be a visible non-uniformity of the object. Local characteristics can be on the surface of the object, for example, visible on the surface of the object.

[0034] The at least one piece of information regarding the local characteristics of the object may include information regarding at least one irregularity of the object. As used herein, the term "irregularity" is a broad term and will be given its common and conventional meaning to those skilled in the art and is not limited to a particular or customary meaning. Specifically, the term may refer to, but is not limited to, at least one condition and / or state of lacking a regular and / or consistent pattern, shape, form, and / or arrangement. Irregularities can affect spectral measurements of the object in a manner particularly such that the results obtained from spectral measurements on the irregularity deviate from those performed not on and / or near the irregularity. An irregularity of the object can be at least one of the following: eczema; lesions; papules; rashes; local areas of different color, particularly compared to another area; local areas of different reflectance, particularly compared to another area, especially compared to another area of ​​human skin.

[0035] As used herein, the term "measurement location" is a broad term and will be given its common and conventional meaning to those skilled in the art, and is not limited to a specific or custom meaning. The term may specifically refer to, but is not limited to, a location from which spectral data is intended to be acquired. Thus, a measurement location can be a location where a measurement spot of a spectrometer is intended to be placed. As used herein, the term "measurement spot" is a broad term and will be given its common and conventional meaning to those skilled in the art, and is not limited to a specific or custom meaning. The term may specifically refer to, but is not limited to, the field of view of a spectrometer, including, a field from which a detector can detect and / or receive detection light from an object, particularly in a manner that generates at least one detector signal.

[0036] Specifically, the manner in which at least one of the one or more measurement locations is obtained enables at least one of the following:

[0037] The at least one measurement location is the location of at least one irregularity, specifically to obtain spectral information about the irregularity;

[0038] The at least one measurement location avoids locations with at least one irregularity, in particular to avoid obtaining spectral information about the irregularity.

[0039] Evaluating the image data to obtain at least one piece of information about the local characteristics of the object can be performed using image analysis software. Typically, image analysis software can be configured to process and / or analyze image data, particularly to obtain at least one representative result, such as the information contained in the image data.

[0040] The method of obtaining the one or more measurement locations may be such that at least one of the one or more measurement locations is a predetermined measurement location or is included by the predetermined measurement location.

[0041] As used herein, the term "predetermined measurement location" is a broad term and will be given its common and conventional meaning to those skilled in the art, and is not limited to any particular or custom meaning. Specifically, the term may refer to, but is not limited to, a known measurement location, particularly a location suitable for determining at least one item of conditional information about a particular object. A predetermined measurement location may be: the forehead and / or cheek, particularly the user's forehead and / or cheek.

[0042] As already disclosed, the method includes the step of acquiring at least one spectral information item about the object at one or more measurement locations by using a spectrometer device, particularly by placing the measurement spot of the spectrometer device at the one or more measurement locations.

[0043] "Acquiring at least one spectral information item" can be and / or may include generating and / or recording spectral information items, particularly in active method steps performed as part of the method.

[0044] As used herein, the term "spectrometer device" is a broad term and will be given its common and conventional meaning to those skilled in the art, and is not limited to any particular or custom meaning. Specifically, the term may refer to, but is not limited to, an optical device configured to acquire at least one spectral information item about at least one object. Specifically, at least one spectral information item may refer to at least one optical characteristic or optically measurable characteristic determined as a function of wavelength for one or more different wavelengths. More specifically, the optical characteristic or optically measurable characteristic and at least one spectral information item may relate to at least one characteristic characterizing at least one of transmission, absorption, reflection, and emission of at least one object itself or after exposure to external light. At least one optical characteristic may be determined for one or more wavelengths. The spectrometer device may specifically be configured to record signal strengths about corresponding wavelengths or partitions (e.g., wavelength intervals) of the spectrum, wherein the signal strength may specifically be provided as an electrical signal that can be used for further evaluation.

[0045] As used herein, the term "spectral information" (also known as "spectral information" or "spectral information item") is a broad term and will be given its common and conventional meaning to those skilled in the art and is not limited to any particular or custom meaning. Specifically, the term may refer to, but is not limited to, information items relating to, at least one object and / or radiation emitted by, at least one object, characterizing at least one optical property of that object, and more specifically, characterizing, for example, at least one information item qualitatively and / or quantitatively representing, at least one of the transmission, absorption, reflection, and emission of that at least one object. As an example, at least one spectral information item may include at least one intensity information, such as information regarding the intensity of at least one type of light transmitted, absorbed, reflected, or emitted by the object, the intensity being, for example, a function of wavelength or a subrange of wavelength within one or more wavelengths (e.g., within a wavelength range). Specifically, the intensity information may correspond to, or be derived from, a signal intensity (specifically an electrical signal) recorded by a spectrometer device in relation to the wavelength or wavelength range of the spectrum.

[0046] As already disclosed, the method includes the step of evaluating the spectral information item to obtain at least one object condition information item about the at least one object, particularly by using an evaluation unit.

[0047] As used herein, the term "object condition information item" is a broad term and will be given its common and conventional meaning to those skilled in the art, and is not limited to any specific or custom meaning. Specifically, the term may refer to, but is not limited to, any meta-information about an object that can be obtained from the evaluation of spectral information items. Furthermore, object condition information items can be obtained by evaluating image data. In this sense, both spectral information items and image data can be evaluated to obtain object condition information items.

[0048] The object condition information item regarding the object may include information about at least a part of the human body (such as skin). The object condition information item may be at least one of the following: moisture level; dryness; roughness; oiliness; blood flow. The object condition information item can be evaluated to determine the condition of the human body, which, for example, may be used to propose cosmetic treatments. The object condition information item regarding the object may include information about at least one glycation level.

[0049] Evaluating the at least one spectral information item to obtain at least one object condition information item includes further evaluating the image data to obtain at least one object condition item. Evaluating the spectral information item to obtain the at least one object condition information item about the at least one object can be performed by a model for obtaining the at least one object condition information item. The model for obtaining the at least one object condition information item can receive desired input data, such as spectral information items and / or image data. Additionally, the model for obtaining the at least one object condition information item can provide the object condition information item, particularly for further processing.

[0050] As used herein, the term "provide" or any grammatical variation thereof is a broad term and will be given its common and conventional meaning to those skilled in the art and is not limited to any particular or custom meaning. The term may specifically refer to, but is not limited to, making the provided item available for use by, for example, a device and / or entity, specifically through the use of a connection interface. The item may be provided by a component of the device and / or by another device and / or entity. To provide the item, it may be requested. The request may be received by the other component and / or the other device and / or entity.

[0051] As used herein, the term "receive" or any grammatical variation thereof is a broad term and will be given its common and conventional meaning to those skilled in the art and is not limited to any particular or custom meaning. The term may specifically refer to, but is not limited to, the acquisition of a received item by a device and / or entity through the use of a connection interface. This item may be provided by additional components and / or additional devices and / or entities.

[0052] The model used to obtain at least one object condition information item may include at least one mechanistic model. As used herein, the term "mechanistic model," also known as a "deterministic model," is a broad term and will be given its common and conventional meaning to those skilled in the art and is not limited to a specific or custom meaning. Specifically, the term may refer to, but is not limited to, a model that reflects physical phenomena in mathematical form, including, for example, first-principles models. A mechanistic model may include a set of equations describing the interaction between at least one object condition information item and / or image data, thereby obtaining object condition information about the object.

[0053] The mechanistic model used to obtain at least one object item can be calibrated using calibration data in a regression process. As used herein, the term "regression process" is a broad term and will be given its common and conventional meaning to those skilled in the art, and is not limited to any specific or custom meaning. Specifically, the term may refer to, but is not limited to, the statistical methods used to establish a relationship between a dependent variable (e.g., material data) and one or more independent variables (e.g., pattern images). The goal of regression is to predict the value of the dependent variable based on the input values ​​of the independent variables. As used herein, the term "calibration" is a broad term and will be given its common and conventional meaning to those skilled in the art, and is not limited to any specific or custom meaning. Specifically, the term may refer to, but is not limited to, the process of optimizing at least one parameter of the mechanistic model in a way that allows for a more accurate assessment of the dependent variable.

[0054] The model used to obtain at least one object status information item may include at least one data-driven model. As used herein, the term "data-driven model" is a broad term and will be given its common and conventional meaning to those skilled in the art and is not limited to any particular or custom meaning. Specifically, the term may refer to, but is not limited to, a classification model that includes at least one machine learning architecture and multiple model parameters. Parameters can be determined for the data-driven model during training using training data. Training can be the process of finding the optimal combination of parameters among multiple model parameters. Training is performed to improve the ability of the machine learning algorithm to obtain representative results (such as object status items) by evaluating inputs.

[0055] Training data may include one or more training datasets. Each of the one or more datasets may include input data and known representative results that can be obtained by evaluating the input data using a data-driven model. The data-driven model used to determine object status items can be trained using the training data in a training process, specifically, wherein the training data includes, in particular, multiple training datasets, each including:

[0056] - At least one spectral information item and / or image data about the object;

[0057] - At least one known object status item.

[0058] The training discussed in this article can include retraining. Furthermore, unsupervised training can be performed.

[0059] The method may include further steps

[0060] v. Specifically, before acquiring the spectral information item, instruct the user to place the invitation of the spectrometer device in a manner that allows the spectral information item about the object to be acquired at the one or more measurement locations.

[0061] As used herein, the term "invitation" is a broad term and will be given its common and conventional meaning to those skilled in the art, and is not limited to any particular or custom meaning. Specifically, the term may refer to, but is not limited to, a request to an individual user to perform a specific action. An invitation may be indicated by the use of at least one signal, such as a visual signal, an audio signal, and / or a tactile signal.

[0062] An invitation to place the spectrometer equipment in a manner that allows spectral information about the object to be obtained at one or more measurement locations may include displaying the invitation to the user on a display screen.

[0063] As used herein, the term "display" is a broad term and will be given its common and conventional meaning to those skilled in the art and is not limited to any particular or custom meaning. Specifically, the term may refer to, but is not limited to, a display user interface configured to visually represent information. A display can be and / or may include at least one screen. For example, a screen may have a flat and / or smooth surface. As an example, a display device can be or may include a liquid crystal display (LCD), such as a flat panel display, or an electro-modulation optical device that utilizes the light modulation properties of liquid crystals. Other types of displays are also possible, such as light-emitting diode (LEC) displays, etc.

[0064] The method may include further steps

[0065] vi. In particular, before obtaining the spectral information item, indicate to the user the location of one or more measurements.

[0066] Instructing a user to the one or more measurement locations may include directing the user to the one or more measurement locations.

[0067] To guide the user to the one or more measurement locations, indicating the at least one measurement location to the user may include changing the indication (e.g., a displayed indication, an audio indication, a haptic indication, an optical indication) in a manner that indicates the relative position of the spectrometer device to the one or more measurement locations. A change in relative position can cause a change in indication, in a manner particularly making the user aware of the change in relative position. The optical indication may be provided by at least one of the following: a light-emitting diode, such as a camera flash, particularly arranged on the back side of the mobile communication device; another light-emitting device, such as a charging indicator, particularly arranged on the back side of the mobile communication device. Any device used to provide the corresponding signal may be included by a device that further includes the spectrometer device, such as a mobile communication device. Alternatively or additionally, any device used to provide the corresponding signal may be included by other devices, such as other devices that do not include the spectrometer device, particularly smartwatches; virtual reality devices, augmented reality devices.

[0068] Instructing the user to the at least one measurement location, particularly guiding the user to the measurement location, may include

[0069] - Display an instruction on the display device;

[0070] -Play sound using a speaker device.

[0071] For example, audio commands used for guidance that indicate how to change relative positions, especially 'move left', 'move right', etc.

[0072] -Provide tactile feedback by using a haptic feedback device.

[0073] For example, to guide the use of tactile feedback, the intensity, frequency, frequency distribution, or pattern can be increased or decreased based on changes in relative position.

[0074] - Optical feedback is provided by using optical feedback devices, especially indicating optical signals.

[0075] For example, increasing and / or decreasing the intensity, color, frequency, or mode of optical feedback for guidance.

[0076] To display an indication on a display device, image data may be displayed, and at least one marker from one or more measurement locations may be displayed. The marker may indicate one or more measurement locations in the image data. Alternatively or additionally, to display an indication on a display device, a variety of different colors may be displayed, wherein a specific color is selected for a particular relative position and / or a specific change in relative position, such as displaying a first color when moving toward one or more measurement locations, and displaying a second color when moving away from one or more measurement locations.

[0077] Instructing the user of the one or more measurement locations may include obtaining the position of the spectrometer device relative to the measurement location by using a position sensor, particularly to obtain the relative position.

[0078] The position sensor may be selected from at least one of the following:

[0079] - The image generation unit used as the position sensor;

[0080] -Acceleration sensor;

[0081] - Distance sensor.

[0082] The method may include further steps

[0083] vii. Evaluate the at least one object status information item to obtain at least one object processing information item.

[0084] As used herein, the term "object processing information" is a broad term and will be given its common and conventional meaning to those skilled in the art, and is not limited to any particular or custom meaning. Specifically, the term may refer to, but is not limited to, any information about recommended actions on how to handle a particular situation (particularly a situation derived from the object situation information item). Object processing information may and / or may include recommendations for cosmetic treatments. Object processing information may not and / or may not include recommendations for medical treatments. Object processing information may and / or may include recommendations for dietary treatments. Object processing information may and / or may include recommendations for behavioral changes, such as washing procedures, the type and intensity of physical exercise, sun exposure, and sleep schedules.

[0085] Evaluating the at least one object condition information item to obtain at least one object processing information item may further include: evaluating the image data to obtain at least one object processing information item and / or evaluating the spectral information item to obtain at least one object processing information item, particularly in a manner such that obtaining the at least one object processing information item includes evaluating the at least one object condition information item and / or evaluating the image data and / or evaluating the spectral information item. Evaluating the at least one object condition information item to obtain at least one object processing information item may include further evaluation of data provided from another device. The data provided from the other device may be user-related data, such as data provided from a fitness tracker (e.g., a smartwatch).

[0086] Evaluating the at least one object condition information item to obtain at least one object processing information item can be performed by a model for obtaining the at least one object processing information item. The model for obtaining the at least one object processing information item can receive required input data, such as spectral information items, object condition information items, and / or image data. Additionally, the model for obtaining the at least one object condition information item can provide the object processing information item. The model for obtaining the at least one object processing information item may include a model for the object condition information item.

[0087] The model used to obtain at least one object processing information item may include at least one mechanistic model. The model used to obtain at least one object processing information item may include at least one data-driven model.

[0088] Acquiring spectral information about an object at one or more measurement locations using a spectrometer may include the following steps:

[0089] a) When the spectral information item is acquired by using the light-emitting element included in the spectrometer device, illumination light is emitted to illuminate the object to generate detection light from the at least one object.

[0090] Refer in particular to the definitions given in the context of spectrometer equipment.

[0091] Acquiring spectral information about an object at one or more measurement locations using a spectrometer may include the following steps:

[0092] b) When detection light from the object is received by a detector included in the spectrometer device, at least one detector signal is generated so as to obtain the spectral information item by evaluating the at least one detector signal.

[0093] Refer in particular to the definitions given in the context of spectrometer equipment.

[0094] On the other hand, a device for obtaining at least one object status information item regarding at least one object is disclosed. The device includes:

[0095] (1) At least one image generation unit, the at least one image generation unit being configured to acquire image data of the object;

[0096] (2) At least one evaluation unit, the at least one evaluation unit being configured to evaluate the image data to obtain at least one information item about the local characteristics of the object, and to select at least one measurement location on the object by evaluating the information item about the local characteristics of the object;

[0097] (3) At least one spectrometer device configured to acquire spectral information about the object at the at least one measurement location; and

[0098] The at least one evaluation unit is further configured to evaluate the spectral information item to obtain at least one object condition information item about the at least one object.

[0099] For this purpose, reference may be made to any definitions, embodiments and / or other aspects disclosed elsewhere in this document.

[0100] The device may be a mobile device. As used herein, the term "mobile device" is a broad term and will be given its common and conventional meaning to those skilled in the art and is not limited to any particular or custom meaning. Specifically, the term may refer to, but is not limited to, mobile electronic devices, and more specifically, mobile communication devices (such as mobile phones, smartphones, or wearable devices) configured to provide access to at least one telecommunications network. The mobile device may be a portable device.

[0101] As used herein, the term "portable" is a broad term and will be given its common and conventional meaning to those skilled in the art, and is not limited to any particular or custom meaning. Specifically, the term may refer to, but is not limited to, the characteristic that at least one object can be moved by human power (e.g., by a single user). Specifically, the weight of an object characterized by the term "portable" may not exceed 10 kg, specifically 5 kg, more specifically 1 kg, or even 500 g. Additionally or alternatively, the size of an object characterized by the term "portable" may allow the object to extend no more than 0.3 m in any dimension, specifically no more than 0.2 m in any dimension. Specifically, the volume of the object may not exceed 0.03 m³, specifically 0.01 m³, more specifically 0.001 m³, or even 500 mm³. In particular, as an example, a portable spectrometer device may have dimensions of, for example, 10 mm × 10 mm × 5 mm. Specifically, the portable spectrometer device may be part of or attachable to a mobile device, such as a laptop computer, tablet computer, mobile phone (e.g., smartphone), smartwatch, and / or wearable computer (also known as a "wearable device," such as a human-worn computer (e.g., a wristband or watch)). In particular, the weight of the spectrometer device, specifically the portable spectrometer device, may be in the range of 1 g to 100 g, more specifically in the range of 1 g to 10 g.

[0102] The device is configured to perform methods as disclosed elsewhere herein. It should be understood that the corresponding components described in the context of the method, and in particular specific method steps, are therefore components of the device and / or spectrometer apparatus configured to perform the corresponding method, and in particular the method steps.

[0103] The spectrometer device may include at least one light-emitting element configured to emit illumination light to illuminate the object, thereby generating detection light from the object. The spectrometer device may also include at least one detector configured to generate at least one detector signal upon receiving detection light from the object, to obtain spectral information about the object.

[0104] As further used herein, the term "light" is a broad term and will be given its common and conventional meaning to those skilled in the art and is not limited to any particular or custom meaning. Specifically, the term may refer to, but is not limited to, electromagnetic radiation in one or more of the infrared, visible, and ultraviolet spectral ranges. In this document, the term "ultraviolet spectral range" generally refers to electromagnetic radiation with wavelengths from 1 nm to 380 nm, preferably from 100 nm to 380 nm. Further, in part according to the standard ISO-21348, the effective version of this document as of the date of this document, the term "visible spectral range" generally refers to the spectral range from 380 nm to 760 nm. The term "infrared spectral range" (IR) generally refers to electromagnetic radiation from 760 nm to 1000 µm, wherein the range from 760 nm to 1.5 µm is generally referred to as the "near-infrared spectral range" (NIR), the range from 1.5 µm to 15 µm is referred to as the "mid-infrared spectral range" (MidIR), and the range from 15 µm to 1000 µm is referred to as the "far-infrared spectral range" (FIR). Preferably, the light used for the typical purposes of this invention is light in the infrared (IR) spectral range, more preferably light in the near-infrared (NIR) and / or mid-infrared (MidIR) spectral range, especially light with wavelengths of 1 µm to 5 µm, preferably 1 µm to 3 µm. This is because the material properties or characteristics relating to the chemical composition of many objects can be obtained from the near-infrared spectral range. However, it should be noted that spectral analysis in other spectral ranges is also applicable and within the scope of this invention.

[0105] Therefore, as used herein, the term "light-emitting element" (also known as "light source") is a broad term and will be given its common and conventional meaning to those skilled in the art and is not limited to any particular or custom meaning. Specifically, the term may refer to, but is not limited to, any device configured to generate or provide light, specifically "illuminating light" in the sense defined above in the term "light". A light-emitting element may specifically be, or may include, at least one electric light source.

[0106] As further used herein, the term "detection light" is a broad term and will be given its common and conventional meaning to those skilled in the art and is not limited to a specific or custom meaning. Specifically, the term may refer to, but is not limited to, light generated by an object, particularly light generated in the interaction of the illuminating light with the object (e.g., scattering, reflection, and / or transmission). Detection light may be illuminating light reflected and / or scattered back to the at least one detector through a sample interface. At least a portion of the illuminating light may be transmitted and / or absorbed by the object in a manner that prevents that portion from being detected by the at least one detector.

[0107] The light-emitting element can be a thermal radiator. A thermal radiator can be selected from incandescent lamps or thermal infrared emitters. As used herein, the term "incandescent lamp" is a broad term and will be given its common and conventional meaning to those skilled in the art, and is not limited to a specific or custom meaning. Specifically, the term can refer to, but is not limited to, an electric lamp having a heatable element (such as a heated filament) capable of being heated to the temperature of its emitted light, particularly infrared light. Therefore, an incandescent lamp can be considered a thermal emitter in the infrared spectral range, and thus the emission power of an incandescent lamp decreases with increasing wavelength. A thermal radiator can be selected from incandescent lamps or thermal infrared emitters. As used herein, the term "thermal infrared emitter" is a broad term and will be given its common and conventional meaning to those skilled in the art, and is not limited to a specific or custom meaning. Specifically, the term can refer to, but is not limited to, a micromachined thermal emitting device comprising a radiating surface emitting the optical radiation to be monitored as a light-emitting element.

[0108] Alternatively or additionally, the light-emitting element may be a laser, specifically a vertical-cavity surface-emitting laser (VCSEL), particularly emitting at least one wavelength in the infrared region.

[0109] As used herein, the term "vertical-cavity surface-emitting laser" is a broad term and will be given its common and conventional meaning to those skilled in the art, and is not limited to any particular or custom meaning. Specifically, the term may refer to, but is not limited to, a semiconductor laser diode configured to emit a laser beam perpendicularly to its top surface. VCSELs are generally known to those skilled in the art, for example, from WO 2017 / 222618 A.

[0110] Alternatively or additionally, the radiating element may be a light-emitting diode (LED), specifically an LED that emits light at least partially within the infrared spectral range. Alternatively or additionally, an LED that emits light illuminating a luminescent material (specifically, a phosphor) for converting the light generated by the LED, wherein the luminescent material generates converted light at least partially within the near-infrared spectral range.

[0111] As used herein, the term "light-emitting diode" or simply "LED" is a broad term and will be given its common and conventional meaning to those skilled in the art, and is not limited to any particular or custom meaning. Specifically, the term may refer to, but is not limited to, optoelectronic semiconductor devices that are capable of emitting light when an electric current flows through them. Optoelectronic semiconductor devices can be configured to generate light due to one or more of various physical processes, including spontaneous emission, induced emission, decay of metastable excited states, etc. Thus, by way of example, a light-emitting diode may include one or more of the following: a light-emitting diode based on spontaneous emission of light (particularly an organic light-emitting diode), a superluminescent light-emitting diode (sLED), or a laser diode (LD). In the following, without reducing possible embodiments of a light-emitting diode to any of the foregoing physical principles or configurations, the abbreviation "LED" will be used for any type of light-emitting diode.

[0112] Specifically, an LED may comprise at least two semiconductor material layers, wherein light can be generated at at least one interface between the at least two semiconductor material layers, specifically due to the recombination of positive and negative charges (e.g., electron-hole recombination). The at least two semiconductor material layers may have different electrical properties; for example, at least one of these layers may be an n-doped semiconductor material, and at least one of these layers may be a p-doped semiconductor material. Therefore, as an example, an LED may comprise at least one pn junction and / or at least one pin structure. However, it should be noted that other device structures are also feasible. At least one semiconductor material may specifically be or may comprise at least one inorganic semiconductor material. However, it should be noted that organic semiconductor materials may be used additionally or alternatively.

[0113] Typically, an LED converts electrical current into light, specifically light that is at least partially located in the infrared spectrum. Alternatively or additionally, an LED can convert electrical current into light, specifically primary light, and more specifically, blue primary light. Therefore, an LED can specifically be a blue LED. An LED can be configured to generate primary light, particularly for light conversion in a phosphor, which is also known as "pump light." Therefore, an LED can also be referred to as a "pumped LED." An LED can specifically include at least one LED chip and / or at least one LED die. Therefore, the semiconductor element of an LED can include a bare LED chip.

[0114] As used herein, the term "luminescence" is a broad term and will be given its common and conventional meaning to those skilled in the art, and is not limited to any particular or custom meaning. Specifically, the term may refer to, but is not limited to, the process by which a substance spontaneously emits light not caused by heat. Specifically, luminescence may refer to cold body radiation. More specifically, luminescence can be initiated or excited by irradiation with light, in which case it is also referred to as "photoluminescence." In the context of this invention, the property of a material capable of luminescence is referred to by the adjective "luminescent." At least one luminescent material may specifically be a photoluminescent material, i.e., a material capable of emitting light after absorbing photons or excitation light. Specifically, the luminescent material may have a positive Stokes shift, which generally refers to the fact that the secondary light is redshifted relative to the primary light.

[0115] Therefore, at least one luminescent material can form at least one transducer (also called a light transducer) that converts primary light into secondary light with different spectral characteristics compared to the primary light. Specifically, the spectral width of the secondary light can be greater than that of the primary light, and / or the emission center of the secondary light can be shifted (specifically, redshifted). Specifically, at least one luminescent material can be absorbent in the ultraviolet and / or blue spectral range and emissive in the near-infrared and / or infrared spectral range. Therefore, typically, the luminescent material or transducer can form at least one component of a phosphor LED that focuses primary light or pump light, particularly in the blue spectral range, into light with a longer wavelength, for example, in the near-infrared or infrared spectral range.

[0116] Therefore, the luminescent material can specifically form at least one transducer or light converter. The luminescent material can form at least one of a conversion sheet, a luminescent coating (specifically a phosphor coating) on ​​an LED, and a phosphor coating on an LED. As an example, the luminescent material may include one or more of the following materials: cerium-doped YAG (YAG:Ce 3+ or Y3Al5O 12 :Ce 3+); doped with rare earth Sialon; copper and aluminum co-doped with zinc sulfide (ZnS:Cu,Al).

[0117] LEDs and luminescent materials together can form what is known as “phosphorescent LEDs.” Therefore, as used herein, the term “phosphorescent light-emitting diode” or simply “phosphorescent LED” is a broad term and will be given its common and conventional meaning to those skilled in the art and is not limited to any particular or custom meaning. Specifically, the term can refer to, but is not limited to, a combination of at least one light-emitting diode configured to generate primary light or pump light and at least one luminescent material (also referred to as a “phosphor”) configured to convert the primary light generated by the light-emitting diode. Phosphorescent LEDs can form packaged LED light sources comprising an LED die (e.g., a blue LED emitting blue pump light) and a phosphor, for example, which is wholly or partially coated on the LED and, by way of example, configured to convert primary light or blue light into light with different spectral characteristics (specifically, into near-infrared light). Typically, phosphorescent LEDs can be packaged in a housing or can be unpackaged. Therefore, the LED and the at least one luminescent material for converting the primary light generated by the light-emitting diode can be specifically housed in a common housing. However, alternatively, LEDs can also be unencapsulated or bare LEDs, which can be completely or partially covered with light-emitting material, for example, by setting one or more layers of light-emitting material on the LED die. Phosphor LEDs can typically form the emitter or light source themselves.

[0118] Light-emitting elements can emit infrared radiation.

[0119] As used herein, the verb “detect” is a broad term and will be given its common and conventional meaning to those skilled in the art, and is not limited to any particular or custom meaning. Specifically, the term may refer to, but is not limited to, the process of qualitatively and / or quantitatively determining, measuring, and monitoring at least one parameter (e.g., at least one of physical, chemical, and biological parameters). Specifically, physical parameters may be or may include electrical parameters. Therefore, as used herein, the term “photodetector” or “detector” is a broad term and will be given its common and conventional meaning to those skilled in the art, and is not limited to any particular or custom meaning. Specifically, the term may refer to, but is not limited to, any device configured for detecting, i.e., qualitatively and / or quantitatively determining, measuring, and monitoring at least one parameter (e.g., at least one of physical, chemical, and biological parameters). The at least one detector may be configured to generate at least one detector signal, more specifically at least one detector electrical signal, such as an analog and / or digital detector signal, which provides information about the at least one parameter measured by the detector. The detector signal can be provided directly or indirectly to the evaluation unit by the at least one detector, such that the at least one detector and the evaluation unit can be directly or indirectly connected. The detector signal can be used as a "raw" detector signal and / or can be processed or preprocessed, for example, by filtering, before further use. Therefore, the at least one detector can include at least one processing device and / or at least one preprocessing device, such as at least one of an amplifier, an analog-to-digital converter, an electrical filter, and a Fourier transform.

[0120] The at least one detector can be configured to detect light propagating from an object to the spectrometer device, or more specifically, to the at least one detector within the spectrometer device. The at least one detector can be configured to determine at least one optical parameter, such as the intensity and / or power of light irradiating at least one sensitive region of the detector. More specifically, the at least one detector may include at least one photosensitive element and / or at least one optical sensor, such as at least one of a photodiode, photovoltaic cell, photoresistor, phototransistor, thermopile sensor, photoacoustic sensor, pyroelectric sensor, photomultiplier tube, and calorimeter. Therefore, the at least one detector can be configured to generate at least one detector signal in the foregoing sense, more specifically, at least one detector electrical signal, which provides information about at least one optical parameter (such as the power and / or intensity of light irradiating the detector or a sensitive region of the detector). The at least one detector may be a lead sulfide (PbS) detector.

[0121] The detector may include multiple photosensitive elements sensitive to different wavelength ranges, and in particular, each photosensitive element may generate at least one detector signal. Specifically, a first photosensitive element may detect light within a first wavelength range, and a second photosensitive element may detect light within a second wavelength range, wherein the first and second wavelength ranges are different from each other, particularly in that their wavelength ranges do not overlap. A third photosensitive element having another, different, particularly non-overlapping, wavelength range may also be present, and so on.

[0122] The spectrometer device may include at least one wavelength selection element. This at least one wavelength selection element may be configured in at least one of the following:

[0123] The beam path of the illuminating light; or

[0124] The beam path of the detection light.

[0125] The at least one wavelength selection element can be configured and / or arranged in such a way that each of the plurality of photosensitive elements can be exposed to a separate spectral range of light from the object.

[0126] As used herein, the term "wavelength-selective element" is a broad term and will be given its common and conventional meaning to those skilled in the art, and is not limited to any particular or custom meaning. Specifically, the term may refer to, but is not limited to, any optical element that interacts with different spectral portions of incident light in various ways, for example by having at least one wavelength-dependent optical property (such as at least one wavelength-dependent optical property selected from a list consisting of reflectivity, direction of reflection, refractivity, direction of refraction, absorption, transmission, and refractive index).

[0127] Wavelength selection elements can be configured such that each photodetector can be exposed to detection light within the same spectral range. Wavelength selection elements can be selected from the group consisting of tunable wavelength selection elements and wavelength selection elements with a fixed transmission spectrum. As an example, by using a tunable wavelength selection element, different wavelength ranges can be selected sequentially, while by using a wavelength selection element with a fixed transmission spectrum, the selection of the wavelength range can be fixed but can depend on, for example, the detection location, thus allowing, for example, different detectors and / or different photosensitive elements of the detectors to be exposed to light within different spectral ranges simultaneously in the beam path of the detection light.

[0128] Therefore, the at least one wavelength selection element may include at least one of a filter, grating, prism, plasmonic filter, diffractive optical element, and metamaterial. More specifically, the spectrometer device may include at least one wavelength selection element disposed in the beam path of light from the object (i.e., disposed in the beam path of the detection light), wherein the wavelength selection element may be specifically configured such that each photodetector is exposed to a separate spectral range of light from the object. As an example, a variable wavelength selection element may be used, the transmission of which depends on the position on the wavelength selection element, such that when the variable wavelength selection element is placed on top of the photodetector array, each photodetector is exposed to a different spectral range of incident light (specifically, the detection light from the object).

[0129] Wavelength selection elements can be selected from the group consisting of tunable wavelength selection elements and wavelength selection elements with fixed transmission spectra. Wavelength selection elements can be or can include at least one of the following: variable length filters; static filters; tunable filters, especially MEMS Fabry-Perot resonators; optical lenses; diffraction elements.

[0130] In another aspect, a computer program is disclosed that includes instructions, when executed by an evaluation unit of a device as disclosed elsewhere herein, to cause the device to perform a method as disclosed elsewhere herein, particularly at least one step in steps ii. and iv. of that method, and any other steps thereof. For this aspect, reference may be made to any definitions, embodiments, and / or additional aspects disclosed elsewhere herein.

[0131] In another aspect, a non-transitory computer-readable storage medium is disclosed, comprising instructions that, when executed by an evaluation unit of a device as disclosed elsewhere herein, cause the device to perform a method as disclosed elsewhere herein, particularly at least one step in steps ii. and iv. of that method, and any other steps thereof. For this aspect, reference may be made to any definitions, embodiments, and / or additional aspects disclosed elsewhere herein.

[0132] As used herein, "computer-readable storage medium" can specifically refer to a non-transitory data storage device, such as a hardware storage medium on which computer-executable instructions are stored. The stored computer-executable instructions can be associated with a computer program. Computer-readable data carriers or storage media can specifically be or can include storage media such as random access memory (RAM) and / or read-only memory (ROM).

[0133] As used herein, the terms “have,” “include,” or “contain,” or any of their grammatical variations, are used in a non-exclusive manner. Thus, these terms can refer either to a situation where no other features exist in the entity described in the context besides those introduced by these terms, or to a situation where one or more other features exist. For example, the statements “A has B,” “A includes B,” and “A contains B” can refer either to a situation where no other elements exist in A besides B (i.e., A consists solely of B), or to a situation where entity A contains one or more other elements besides B (such as element C, elements C and D, or even other elements).

[0134] Furthermore, it should be noted that the terms "at least one," "one or more," or similar expressions indicating a feature or element may appear once or more, but are typically used only once when describing the corresponding feature or element. In most cases, the expressions "at least one" or "one or more" are not repeated when referring to the corresponding feature or element, but in fact, the corresponding feature or element may appear once or more.

[0135] Furthermore, as used herein, the terms “preferredly,” “more preferably,” “particularly,” “more particularly,” “specifically,” “more specifically,” or similar terms are used in combination with optional features without limiting the possibility of alternatives. Therefore, the features introduced by these terms are optional features and are not intended to limit the scope of the claims in any way. As those skilled in the art will recognize, the invention can be practiced by using alternative features. Similarly, features introduced by phrases such as “in embodiments of the invention” are intended to be optional features and do not limit any alternative embodiments of the invention, the scope of the invention, or the possibility of combining features introduced in this way with other optional or non-optional features of the invention.

[0136] In one or more of the above embodiments and / or in one or more of the embodiments described in further detail below, the method, apparatus, computer program, and non-transitory computer-readable storage medium according to the present invention for obtaining at least one object status information item about an object, provides numerous advantages over known similar apparatuses and methods.

[0137] Specifically, the determination of information items (such as skin moisture levels) is achieved in a more reliable and accurate manner. Further specifically, the determination of object processing information items is achieved in a more reliable and accurate manner. Further specifically, the number of measurements is reduced, especially since measurements are unnecessary if previously measured areas do not indicate changes in skin condition.

[0138] Images from the image generation unit can be recorded and / or analyzed using image analysis software. The image analysis software can determine one or more measurement locations where infrared spectra should be recorded to obtain results representative of the skin.

[0139] For example, images of the face can be analyzed to identify one or more locations of skin irregularities. Measurement locations that are most representative of the entire face and / or specific parts of the face (e.g., the forehead and / or cheeks) can then be selected.

[0140] An image of the measurement location can be displayed to the user, who is then invited to place the spectrometer device over the indicated spot, specifically in a manner that allows spectral information to be received from the measurement location. The obtained spectrum, along with / or multiple spectra, can then be evaluated using a model to suggest optimal skincare, such as cosmetic skincare. In this case, the measurement can be more accurate because it is less affected by local biases.

[0141] Alternatively or additionally, images from the image generation unit can be recorded and / or analyzed using image analysis software. The image analysis software can detect irregularities, such as abnormal red and / or white areas of skin, and invites the user to place the spectrometer over these irregularities, particularly in a manner that allows spectral information to be received from the measurement location. The resulting spectra can be evaluated by a model that can derive diagnoses or recommendations, particularly for the cosmetic treatment of these irregularities.

[0142] Infrared spectroscopy and / or information derived therefrom and / or from images generated using an image generation unit can be used as input to a model. For example, moisture levels can be determined based on infrared measurements, and skin color / hue can be determined based on images generated by the image generation unit. Another example could be monitoring diabetes by determining glycation levels in nails using infrared spectroscopy and additionally analyzing images of those nails (as disclosed in P. Sihota et al., Investigation of diabetic patient's fingernail quality to monitor type 2 diabetes induced tissue damage, Scientific Reports (2019) 9:3193, pp. 1–11). Alternatively or additionally, infrared spectroscopy and / or information derived therefrom and / or from images generated using an image generation unit can be used as input to a model to detect skin stress levels and / or provide recommendations for cosmetic skin treatments.

[0143] In summary, and without excluding other possible embodiments, the following embodiments are conceivable:

[0144] Example 1: A method for obtaining at least one object status information item about an object, the method comprising:

[0145] i. Obtain the image data of the object by using at least one image generation unit;

[0146] ii. Evaluate the image data to obtain at least one piece of information about the local characteristics of the object; and evaluate the at least one piece of information about the local characteristics of the object to obtain one or more measurement locations on the object;

[0147] iii. Acquire at least one spectral information item about the object at one or more measurement locations using a spectrometer; and

[0148] iv. Evaluate the spectral information item to obtain at least one object condition information item about the at least one object.

[0149] Example 2: The method according to the previous example, wherein evaluating the image data to obtain at least one piece of information about the local characteristics of the object is performed using image analysis software.

[0150] Example 3: The method according to any one of the foregoing embodiments, wherein the at least one information item regarding the local characteristics of the object includes information regarding at least one irregularity of the object, wherein the at least one of the one or more measurement locations is obtained in a manner that achieves at least one of the following:

[0151] The at least one measurement location is the location of the at least one irregular condition;

[0152] The at least one measurement location avoids the location of the at least one irregular condition.

[0153] Example 4: The method according to any one of the foregoing embodiments, wherein the one or more measurement locations are obtained in such a way that at least one of the one or more measurement locations is a predetermined measurement location or is included by the predetermined measurement location.

[0154] Example 5: The method according to any one of the foregoing embodiments, wherein the method includes further steps.

[0155] v. Specifically, before acquiring the spectral information item, instruct the user to place the invitation of the spectrometer device in a manner that allows the spectral information item about the object to be acquired at the one or more measurement locations.

[0156] Example 6: According to the method of the previous embodiment, the invitation to place the spectrometer device in a manner that enables the acquisition of spectral information items about the object at the one or more measurement locations includes displaying the invitation to the user on the display.

[0157] Example 7: The method according to any one of the foregoing embodiments, wherein the method includes further steps.

[0158] vi. In particular, before obtaining the spectral information item, indicate to the user the location of one or more measurements.

[0159] Example 8: The method according to the previous example, wherein instructing the user of the one or more measurement locations includes guiding the user to the one or more measurement locations.

[0160] Example 9: The method according to any one of the preceding two examples, wherein instructing the user of the at least one measurement location includes

[0161] Display instructions on the display device;

[0162] Playing sound by using a speaker device;

[0163] Tactile feedback is provided by using a haptic feedback device.

[0164] Example 10: The method according to the previous embodiment, wherein, in order to display an instruction on a display device,

[0165] Display the image data and display at least one marker at the at least one measurement location;

[0166] Display color codes.

[0167] Example 11: The method according to any one of the preceding five examples, wherein instructing the user of the one or more measurement locations includes obtaining the position of the spectrometer device relative to the measurement location by using a position sensor.

[0168] Example 12: The method according to the previous embodiment, wherein the position sensor is selected from at least one of the following:

[0169] The image generation unit is used as the position sensor;

[0170] Accelerometer;

[0171] Distance sensor.

[0172] Example 13: The method according to any one of the preceding embodiments, wherein evaluating the spectral information item to obtain the at least one object condition information item about the at least one object further includes evaluating the image data to obtain the at least one object condition information item.

[0173] Example 14: The method according to any one of the preceding embodiments, wherein evaluating the spectral information item to obtain the at least one object condition information item about the at least one object is performed by a model for obtaining the at least one object condition information item.

[0174] Example 15: The method according to any one of the foregoing embodiments, wherein the model for obtaining at least one object status information item includes at least one mechanistic model.

[0175] Example 16: The method according to any one of the preceding four examples, wherein the model for obtaining at least one object status information item includes at least one data-driven model.

[0176] Example 17: The method according to any one of the foregoing embodiments, wherein the method includes additional steps.

[0177] vii. Evaluate the at least one object status information item to obtain at least one object processing information item.

[0178] Example 18: The method according to the previous embodiment, wherein evaluating the at least one object status information item to obtain at least one object processing information item further includes evaluating the image data to obtain at least one object processing information item.

[0179] Example 19: The method according to any one of the preceding two examples, wherein evaluating the at least one object status information item to obtain at least one object processing information item is performed by a model for obtaining at least one object processing information item.

[0180] Example 20: The method according to any one of the foregoing embodiments, wherein acquiring spectral information about the object at one or more measurement locations using a spectrometer includes the following steps.

[0181] a) Illuminating the object by emitting illumination light using a light-emitting element included in the spectrometer device, thereby generating detection light from the at least one object.

[0182] Example 21: According to the method described in the previous embodiment, acquiring spectral information about the object at one or more measurement locations using a spectrometer includes the following steps:

[0183] b) When detection light from the object is received by a detector included in the spectrometer device, at least one detector signal is generated so as to obtain the spectral information item by evaluating the at least one detector signal.

[0184] Example 22: The method according to any one of the foregoing embodiments, wherein the object is skin.

[0185] Example 23: The method according to the previous embodiment, wherein the object condition information item about the object includes information about at least one skin moisture level.

[0186] Example 24: The method according to any one of the preceding two examples, wherein the irregularity of the object is at least one of the following:

[0187] eczema;

[0188] lesions;

[0189] Papules.

[0190] Example 25: The method according to any one of the foregoing embodiments, wherein the object is a biological fingernail.

[0191] Example 26: The method according to the previous embodiment, wherein the object status information item about the object includes information about at least one glycation level.

[0192] Example 27: An apparatus for obtaining at least one object status information item about at least one object, the apparatus comprising:

[0193] (1) At least one image generation unit, the at least one image generation unit being configured to acquire image data of the object;

[0194] (2) At least one evaluation unit, the at least one evaluation unit being configured to evaluate the image data to obtain at least one information item about the local characteristics of the object, and to select at least one measurement location on the object by evaluating the information item about the local characteristics of the object;

[0195] (3) At least one spectrometer device configured to acquire spectral information about the object at the at least one measurement location; and

[0196] The at least one evaluation unit is further configured to evaluate the spectral information item to obtain at least one object condition information item about the at least one object.

[0197] Example 28: The device according to the previous example, wherein the device is a mobile device.

[0198] Example 29: The device according to any one of the foregoing device embodiments, wherein the device is configured to perform the method according to any one of the method embodiments.

[0199] Example 30: The device according to any one of the foregoing device embodiments, wherein the spectrometer device includes at least one light-emitting element configured to emit illumination light to illuminate the object in order to generate detection light from the object.

[0200] Example 31: The device according to any one of the foregoing device embodiments, wherein the spectrometer device includes at least one detector configured to generate at least one detector signal when receiving detection light from the object to obtain spectral information items about the object.

[0201] Example 32: The device according to the previous device embodiment, wherein the detector includes a plurality of photosensitive elements sensitive to different wavelength ranges.

[0202] Example 33: The device according to the preceding device embodiment, wherein the spectrometer device includes at least one wavelength selection element, wherein the at least one wavelength selection element is disposed in at least one of the following:

[0203] The beam path of the illuminating light; or

[0204] The beam path of the detection light.

[0205] Example 34: The device according to the previous device embodiment, wherein the at least one wavelength selection element is configured and / or arranged such that each of the plurality of photosensitive elements is exposed to a separate spectral range of light from the object.

[0206] Example 35: The device according to any one of the foregoing five device embodiments, wherein the light-emitting element is at least one of the following:

[0207] Thermal radiators;

[0208] Laser, specifically a vertical-cavity surface-emitting laser (VCSEL), particularly emitting at least one wavelength in the infrared region;

[0209] Light-emitting diodes (LEDs), especially

[0210] ○ An LED that emits light that is at least partially located in the infrared spectrum, and / or

[0211] ○ An LED that irradiates a phosphor, the phosphor being used to convert the light generated by the LED, wherein the luminescent material generates converted light that is at least partially located in the near-infrared spectral range.

[0212] Example 36: A spectrometer device according to any one of the foregoing six device embodiments, wherein the light-emitting element emits infrared radiation.

[0213] Example 37: A computer program comprising instructions that, when executed by an evaluation unit of the device according to any of the foregoing device embodiments, cause the device to perform the method according to any of the method embodiments, particularly at least one of steps ii. and iv. and vii. of the method, and any other steps.

[0214] Example 38: A non-transitory computer-readable storage medium comprising instructions that, when executed by an evaluation unit of a device according to any of the foregoing device embodiments, cause the device to perform a method according to any of the method embodiments, particularly at least one of steps ii. and iv. and vii., and any other steps of the method. Attached Figure Description

[0215] Further optional details and features of the invention will be apparent from the following description of preferred exemplary embodiments in conjunction with the dependent claims. In this context, specific features may be implemented individually or in combination with other features. The invention is not limited to exemplary embodiments. Exemplary embodiments are schematically illustrated in the accompanying drawings. The same reference numerals in the various drawings refer to the same elements or elements having the same function, or elements that correspond to each other in terms of their function.

[0216] In the attached diagram:

[0217] Figure 1 A schematic diagram of an exemplary method for obtaining at least one object status information item about an object is shown;

[0218] Figure 2 A schematic diagram of an exemplary device is shown; and

[0219] Figure 3 A schematic diagram of an exemplary spectrometer device is shown. Detailed Implementation

[0220] Figure 1 An exemplary method 110 is shown for obtaining at least one object status information item regarding object 147. Method 110 includes:

[0221] i. In step 112, image data of object 147 is acquired by using at least one image generation unit 134;

[0222] ii. In step 114, the image data is evaluated to obtain at least one piece of information about the local characteristics of the object 147; and at least one piece of information about the local characteristics of the object 147 is evaluated to obtain one or more measurement locations on the object 147;

[0223] iii. In step 116, at least one spectral information item about the object 147 is acquired at one or more measurement locations using spectrometer device 138; and

[0224] iv. In step 118, the spectral information item is evaluated to obtain at least one object condition information item regarding at least one object 147.

[0225] In particular, evaluating the image data in step 114 to obtain at least one piece of information about the local characteristics of object 147 can be performed using image analysis software. The at least one piece of information about the local characteristics of object 147 may include information about at least one irregularity of the object 147, particularly its surface, wherein the at least one of the one or more measurement locations is obtained in a manner that achieves at least one of the following:

[0226] The at least one measurement location is the location of the at least one irregular condition;

[0227] The at least one measurement location avoids the location of the at least one irregular condition.

[0228] The method of obtaining the one or more measurement locations may be such that at least one of the one or more measurement locations is a predetermined measurement location or is included by the predetermined measurement location.

[0229] The method may include further steps

[0230] v. In step 120, particularly before acquiring the spectral information item, an invitation is given to the user to place the spectrometer device 138 in such a manner that the spectral information item about the object 147 can be acquired at the one or more measurement locations.

[0231] In particular, the invitation to place the spectrometer device 138 in a manner that instructs the user in step 120 so that spectral information items about object 147 can be obtained at the one or more measurement locations may include displaying the invitation to the user on the display device 140.

[0232] The method may include further steps

[0233] vi. In step 122, particularly before acquiring the spectral information item, the user is instructed about the one or more measurement locations.

[0234] Instructing the user to the one or more measurement locations may include directing the user to the one or more measurement locations. Instructing the user to at least one measurement location may include...

[0235] Display an instruction on display device 140;

[0236] Sound is played using speaker device 142;

[0237] Tactile feedback is provided by using haptic feedback device 144.

[0238] In order to display an indication on the display device 140, image data can be displayed and at least one mark at at least one measurement location can be displayed;

[0239] It can display color codes.

[0240] Specifically, instructing the user of the one or more measurement locations in step 122 may include obtaining the position of the spectrometer device 138 relative to the measurement location by using the position sensor 133.

[0241] Position sensor 133 may be selected from at least one of the following:

[0242] Image generation unit 134 is used as position sensor 133;

[0243] Accelerometer 146;

[0244] Distance sensor 148.

[0245] Evaluating the at least one spectral information item to obtain the at least one object condition information item includes evaluating the image data to obtain the at least one object condition information item. The evaluation of the spectral information item to obtain the at least one object condition information item is performed by a model used to obtain the at least one object condition information item.

[0246] The model used to obtain at least one object status information item may include at least one mechanistic model. The model used to obtain at least one object status may include at least one data-driven model.

[0247] The method may include further steps

[0248] vii. In step 126, the at least one object status information item is evaluated to obtain at least one object processing information item, particularly as obtained in step 118.

[0249] Evaluating the at least one object condition information item to obtain at least one object processing information item may include evaluating the image data to obtain at least one object processing information item. Evaluating the at least one object condition information item to obtain at least one object processing information item may be performed by a model used to obtain at least one object processing information item.

[0250] In particular, obtaining spectral information about object 147 at one or more measurement locations using spectrometer device 138 in step 116 may include the following steps:

[0251] a) In step 128, illumination light is emitted from the light-emitting element included in the spectrometer device 138 to illuminate the object 147, so as to generate detection light from at least one object 147.

[0252] In particular, obtaining spectral information about object 147 at one or more measurement locations using spectrometer device 138 in step 116 may include the following steps:

[0253] b) In step 130, at least one detector signal is generated when detection light from object 147 is received by a detector included in spectrometer device 138, so as to obtain the spectral information item by evaluating the at least one detector signal.

[0254] Object 147 may be skin. The object condition information item for object 147 may include information about at least one skin moisture level. The irregular condition of object 147 may be at least one of the following: eczema; lesions; papules.

[0255] Alternatively or additionally, object 147 may be a biological fingernail. In particular, the object condition information item regarding object 147 may then include information about at least one level of glycosylation.

[0256] Figure 2 An exemplary device 132 is shown for obtaining at least one object status information item regarding at least one object 147, the device 132 comprising:

[0257] (1) At least one image generation unit 134, which is configured to acquire image data of object 147;

[0258] (2) At least one evaluation unit 136, the at least one evaluation unit being configured to evaluate the image data to obtain at least one information item about the local characteristics of the object 147, and to select at least one measurement location on the object 147 by evaluating the information item about the local characteristics of the object 147.

[0259] (3) At least one spectrometer device 138, the at least one spectrometer device being configured to acquire spectral information items about object 147 at at least one measurement location; and

[0260] At least one evaluation unit 136 is further configured to evaluate spectral information items to obtain at least one object condition information item regarding at least one object 147. Device 132 may be a mobile device.

[0261] Evaluation unit 136 may include components included by device 132 (such as...) Figure 2 (Exemplary depiction). Alternatively or additionally, evaluation unit 136 may be included by spectrometer device 138. Evaluation unit 136 may include a plurality of subunits, wherein each subunit performs a specific step of method 110. At least one subunit of evaluation unit 136 may be included by spectrometer device 138. At least one subunit of evaluation unit 136 may be included by device 132.

[0262] The device is configured to perform method 110 as disclosed elsewhere herein. The device may further include a display device 140 and / or a speaker device 142 and / or a haptic feedback device 144 and / or an accelerometer 146 and / or a distance sensor 148.

[0263] Specifically, in order to perform at least one of steps ii., iv., and vii. of method 110, a computer program includes instructions that, when executed by the evaluation unit 136 of device 132, cause device 132 to perform at least one of steps ii., iv., and vii. The computer program may be stored on a non-transitory computer-readable storage medium.

[0264] Figure 3 An exemplary spectrometer device 138 is shown, which may include at least one light-emitting element 140 configured to emit illumination light 142, specifically through a spectrometer window 144, to illuminate an object 147 146 in order to generate detection light 148 from the object 147 146. The spectrometer device 138 may include at least one detector configured to generate at least one detector signal upon receiving detection light 148 from the object 147 146 to obtain spectral information items about the object 147 146.

[0265] Detector 144 may include multiple photosensitive elements 150 sensitive to different wavelength ranges. Spectrometer device 138 may include at least one wavelength selection element 152, wherein the at least one wavelength selection element 152 is disposed in at least one of the following: the beam path of the irradiating light 142 (e.g., the path of the irradiating light 142). Figure 3 (as exemplarily depicted in the image); or detect the beam path of light 148.

[0266] At least one wavelength selection element 152 may be configured and / or arranged such that each of the plurality of photosensitive elements 150 is exposed to a separate spectral range of light from the objects 147 and 146.

[0267] The light-emitting element 140 may be at least one of the following:

[0268] Thermal radiators;

[0269] Laser, specifically a vertical-cavity surface-emitting laser (VCSEL), particularly emitting at least one wavelength in the infrared region;

[0270] Light-emitting diodes (LEDs), especially

[0271] ○ An LED that emits light that is at least partially located in the infrared spectrum, and / or

[0272] ○ An LED that irradiates a phosphor, the phosphor being used to convert the light generated by the LED, wherein the luminescent material generates converted light that is at least partially located in the near-infrared spectral range.

[0273] The light-emitting element 140 can emit infrared radiation.

[0274] List of reference numerals

[0275] .

Claims

1. A method for obtaining at least one object status information item about an object (147), the method comprising: i. Obtain image data of the object (147) by using at least one image generation unit (134); ii. Evaluate the image data to obtain at least one piece of information about the local characteristics of the object (147); and evaluate the at least one piece of information about the local characteristics of the object (147) to obtain one or more measurement locations on the object (147); iii. Obtain at least one spectral information item about the object (147) at one or more measurement locations using a spectrometer device (138); as well as iv. Evaluate the spectral information item to obtain at least one object condition information item about the at least one object (147), wherein evaluating the spectral information item to obtain at least one object condition information item about the at least one object (147) further includes evaluating the image data to obtain at least one object (147) condition information item.

2. The method according to the preceding claim, wherein, The at least one information item regarding the local characteristics of the object (147) includes information regarding at least one irregularity of the object (147), wherein the at least one of the one or more measurement locations is obtained in a manner that achieves at least one of the following: The at least one measurement location is the location of the at least one irregular condition; The at least one measurement location avoids the location of the at least one irregular condition.

3. The method according to any one of the preceding claims, wherein, The method includes the following further steps vi. To indicate the one or more measurement locations to the user.

4. The method according to the preceding claim, instructing the user to the one or more measurement locations includes guiding the user to the one or more measurement locations.

5. The method according to any one of the preceding two claims, wherein, Instructing the user on at least one measurement location includes Display an instruction on the display device (140); Sound is played by using a speaker device (142); Tactile feedback is provided by using a haptic feedback device (144).

6. The method according to any one of the preceding claims, wherein, The method includes the following further steps vii. Evaluate the at least one object status information item to obtain at least one object processing information item.

7. The method according to any one of the preceding claims, wherein, The object (147) is skin.

8. The method according to the preceding claim, wherein, The object condition information item for the object (147) includes information about at least one skin moisture level.

9. The method according to any one of the preceding two claims, wherein, The irregularity of the object (147) is at least one of the following: eczema; lesions; Papules.

10. The method according to any one of the preceding claims, wherein, The object (147) is the nail of an organism.

11. The method according to the preceding claim, wherein, The object status information item for the object (147) includes information about at least one glycosylation level.

12. An apparatus (132) for obtaining at least one object status information item regarding at least one object (147), the apparatus (132) comprising: (1) At least one image generation unit (134) configured to acquire image data of the object (147); (2) At least one evaluation unit, the at least one evaluation unit being configured to evaluate the image data to obtain at least one information item about the local characteristics of the object (147), and to select at least one measurement location on the object (147) by evaluating the information item about the local characteristics of the object (147); (3) At least one spectrometer device (138) configured to acquire spectral information items about the object (147) at the at least one measurement location; and The at least one evaluation unit is further configured to evaluate the spectral information item to obtain the at least one object condition information item about the at least one object (147), wherein the device (132) is configured to perform the method according to any one of the method claims.

13. A computer program comprising instructions that, when executed by an evaluation unit of the device (132) according to any one of the preceding device claims, cause the device (132) to perform the method according to any one of the method claims.

14. A non-transitory computer-readable storage medium comprising instructions that, when executed by an evaluation unit of the device (132) according to any one of the preceding device claims, cause the device (132) to perform the method according to any one of the method claims.

Images