Monitoring method, device and system

Abstract

A monitoring method, device and system, the method comprising: a processing device receiving acquisition information from a detector, the acquisition information comprising at least one of the following items: reflected light information of a user, thermal radiation information of the user, or image information of the user; the processing device determines a first optical receiver unit for collecting the ROI information of the user in the detector according to the collection information; the processing device determines a first time unit corresponding to the first optical receiver unit according to the corresponding relation between the optical receiver units and the time units; the processing device increases the irradiation power of the light source in the first time unit. The processing device increases the irradiation power of the light source in the first time unit of acquiring the ROI information, so that the problem of poor monitoring effect caused by insufficient illumination can be solved, and the processing device does not increase the irradiation power in other time units, so that the problem of poor user experience caused by too high light intensity of the external light source can be solved.

Description

Monitoring method, device and system Technical Field

[0001] The present application relates to the field of communication technology, and in particular to a monitoring method, device, and system. Background Art

[0002] With the development of smart terminal technology, smart wearable devices have found significant application in monitoring human physiological parameters. Smart wearable devices such as smartphones and smart bracelets can measure various physiological parameters such as blood pressure, respiration, blood volume, and other circulatory conditions. Among these, the use of optical measurement methods to monitor user health is a current research area.

[0003] Summary of the Invention

[0004] The present application provides a monitoring method, device and system for monitoring a user using optical measurement means.

[0005] In a first aspect, a monitoring method is provided. The method can be performed by a processing device, which can be a communication device or a communication device capable of supporting the communication device to perform the functions required by the method, such as a chip. Exemplarily, the communication device is a terminal device, or a chip configured in the terminal device to perform the functions of the communication device, or other components configured to perform the functions of the terminal device. The terminal device can be a mobile phone, a tablet computer, a computer with wireless transceiver capabilities, a wearable device, a vehicle, a drone, a helicopter, an airplane, a ship, a robot, a robotic arm, a smart home appliance, or the like. Taking the processing device as the execution subject as an example, the method includes: the processing device receiving collected information from a detector, the collected information including at least one of the following: reflected light information of a user, thermal radiation information of the user, or image information of the user; the processing device determining, based on the collected information, a first light receiver unit in the detector that collects information about a region of interest (ROI) of interest (ROI) of interest; the processing device determining, based on the correspondence between light receiver units and time units, a first time unit corresponding to the first light receiver unit; and the processing device increasing the irradiation power of a light source during the first time unit.

[0006] Through this design, the processing device controls the light source to increase its irradiation power during the first time unit corresponding to the ROI information, thereby resolving the problem of poor monitoring results caused by insufficient illumination. Furthermore, the processing device does not increase the irradiation power during other time units beyond the first time unit, thereby resolving the problem of poor user experience caused by excessive external light intensity.

[0007] In one design, the processing device increases the irradiation power of the light source in the first time unit, including: the processing device controls the communication device to increase the irradiation power of the light source in the first time unit. For example, the processing device sends a notification message to the communication device, and the notification message is used to notify the communication device to increase the irradiation power of the light source in the first time unit. Optionally, in the first time unit, increasing the irradiation power of the light source includes: in the first time unit, the light source irradiates outward according to a preset power. Optionally, for time units other than the first time unit, the light source is turned off. Alternatively, in the first time unit, the light source irradiates outward according to the first power. Optionally, for time units other than the first time unit, the light source irradiates outward according to the second power. The first power is greater than the second power, etc.

[0008] Through the above design, the processing device can directly control the light source to increase the irradiation power, or control the light source to increase the irradiation power through the communication device, thereby controlling the light source to increase the irradiation power of the light source in the first time unit corresponding to the ROI area.

[0009] In one design, the processing device determines, based on the collected information, a first light receiver unit in the detector that collects ROI information of the user, including: the processing device determines, based on the collected information, at least one of the following information of the user: depth information, light intensity information, or temperature information, where the depth information includes distance information between the user and the detector; the processing device determines, based on at least one of the depth information, light intensity information, or temperature information of the user, the first light receiver unit in the detector that collects ROI information of the user.

[0010] In one design, it also includes: the processing device determines a communication time unit based on the first time unit, and there is no intersection between the communication time unit and the first time unit; the processing device sends a communication signal to the communication device in the communication time unit.

[0011] Through the above design, the non-monitoring time can be used to realize the communication between the processing device and the external device, and the entire system has the function of communicating with the outside.

[0012] In one design, the first time unit is a time unit within one or more cycles, where one cycle is determined according to an exposure time of a light receiver unit included in a light receiving array in the detector.

[0013] In one design, it also includes: a processing device adjusting the first time unit corresponding to the first optical receiver unit; the processing device sends notification information to the detector, light source and the communication device, and the notification information is used to notify the adjustment of the first time unit corresponding to the first optical receiver unit.

[0014] With the above design, the adjustment includes increasing the number of time units corresponding to the first light receiver unit. With the above design, the duration of the light source's increased irradiation power can be increased, and the detector can be used to better collect ROI area information and better monitor the user.

[0015] In one design, the method further includes: a processing device updating the correspondence between the optical receiver unit and the time unit based on the adjusted first time unit corresponding to the first optical receiver unit.

[0016] In a second aspect, a monitoring method is provided. The method can be performed by a communication device, which can be a communication device or a device that supports the communication device in implementing the functions required by the method, such as a chip. For example, the communication device can be an electro-optical modulator, or a chip disposed within the electro-optical modulator for implementing the functions of the electro-optical modulator, or other components for implementing the functions of an electro-optical modulator. The electro-optical modulator can be a pulse driver (Photline) electro-optical modulator. Taking the communication device as the execution subject as an example, the method includes: the communication device receiving notification information from a processing device, the notification information being used to notify the communication device to increase the illumination power of a light source during a first region of interest (ROI) time unit; and the communication device controlling the light source to increase the illumination power during the first time unit.

[0017] In one design, the first time unit is a time unit within one or more cycles, where one cycle is determined according to an exposure time of a light receiver unit included in a light receiving array in the detector.

[0018] In one design, when the first time unit is an ROI time unit within a cycle, the communication device controls the light source to increase the illumination power in the first time unit, including: the communication device modulates the control signal in the first time unit to determine the first modulation signal; the communication device controls the light source to increase the illumination power according to the first modulation signal.

[0019] In one design, when the first time unit is an ROI time unit within multiple cycles, the communication device controls the light source to increase the irradiation power in the first time unit, including: the communication device determines the second ROI time unit corresponding to each cycle in the multiple cycles based on the first time unit; the communication device modulates the control signal in the second ROI time unit of each cycle to determine a second modulation signal; and the communication device controls the light source to increase the irradiation power based on the second modulation signal.

[0020] Through the above design, the first ROI time unit within a cycle is mapped to multiple cycles, further reducing the light source intensity within a cycle, thereby avoiding stimulation to the user, thereby enabling monitoring of users in a certain environment, such as monitoring users in a sleeping state.

[0021] In one design, it also includes: the communication device receives a communication signal from the processing device in a communication time unit, and there is no intersection between the communication time unit and the first time unit; the communication device modulates the communication signal in the communication time unit to determine a third modulation signal; and the communication device controls the light source to increase the illumination power according to the third modulation signal.

[0022] In one design, it also includes: the communication device receives notification information from the processing device, and the notification information is used to adjust the first ROI time unit corresponding to the first optical receiver unit; the communication device adjusts the first ROI time unit corresponding to the first optical receiver unit according to the notification information.

[0023] In a third aspect, a device is provided, which includes a unit or module corresponding to the method described in the first or second aspect above. The unit or module can be implemented by hardware circuits, or by software, or by a combination of hardware circuits and software.

[0024] In a fourth aspect, a device is provided, comprising a processor and a receiving circuit, wherein the processor is configured to communicate with other devices through an interface circuit and execute the method described in the first or second aspect above, and the processor comprises one or more.

[0025] In a fifth aspect, a device is provided, comprising a processor coupled to a memory, the processor configured to call a program stored in the memory to execute the method described in the first or second aspect. The memory may be located within or outside the device, and the processor may be one or more.

[0026] In a sixth aspect, a device is provided, comprising a processor and a memory, wherein the memory is used to store computer instructions. When the device is running, the processor executes the computer instructions stored in the memory so that the device executes the method described in the first or second aspect above.

[0027] In a seventh aspect, a chip system is provided, comprising: a processor for executing the method described in the first aspect or the second aspect above.

[0028] In an eighth aspect, a computer-readable storage medium is provided, wherein instructions are stored in the computer-readable storage medium, which, when run on a communication device, enables the method in the first aspect or the second aspect to be executed.

[0029] In a ninth aspect, a computer program product is provided, which includes a computer program or instructions, and when the computer program or instructions are run by a device, the method in the first aspect or the second aspect is executed.

[0030] In the tenth aspect, a monitoring system is provided, including: a processing device for determining a first light receiver unit in a detector for collecting the user's region of interest ROI information based on the collected user information, and determining a first time unit corresponding to the first light receiver unit based on the correspondence between the light receiver unit and the time unit; and a communication device for controlling the light source to increase the irradiation power in the first time unit.

[0031] Through the above design, the system can control the light source to increase the irradiation power in the first time unit of collecting ROI information, and does not increase the irradiation power in other time units except the first time unit, thereby solving the problem of the light source being too strong or too weak, using the user's ROI information under strong light, and causing less interference to the user.

[0032] In one design, it further includes: a detector for collecting information of the user and determining collected information, wherein the collected information includes at least one of the following: reflected light information of the user, thermal radiation information of the user, or image information of the user.

[0033] In one design, the detector includes a light receiver including at least one light receiving array including a plurality of light receiving units, and a period is determined according to an exposure time of the light receiving units included in the light receiving array.

[0034] In one design, the detector further includes a complementary metal oxide semiconductor (CMOS) camera.

[0035] Through the above design, the CMOS camera has better recognition performance for the ROI area; the light receiving array has better performance in signal acquisition; combining the above two can achieve accurate recognition of the ROI area and higher signal acquisition sensitivity.

[0036] In one design, it further includes: a light source, configured to increase the illumination power in the first time unit according to control.

[0037] In one design, when the processing device determines the first time unit for collecting the ROI information of the user in the detector based on the collected user information, it is specifically used to: determine at least one of the following information of the user based on the collected information: depth information, light intensity information or temperature information, and the depth information includes the distance information between the user and the detector; determine the first light receiver unit in the detector for collecting the ROI information of the user based on at least one of the depth information, light intensity information or temperature information of the user.

[0038] In one design, when the first time unit is an ROI time unit within a cycle, the communication device controls the light source to increase the illumination power in the first time unit, including: modulating the control signal in the first time unit to determine a first modulation signal; and controlling the light source to increase the illumination power according to the first modulation signal.

[0039] In one design, when the first time unit is an ROI time unit within multiple cycles, the communication device controls the light source to increase the illumination power in the first time unit, including: determining the second ROI time unit corresponding to each cycle in the multiple cycles based on the first time unit; modulating the control signal in the second ROI time unit of each cycle to determine a second modulation signal; and controlling the light source to increase the illumination power based on the second modulation signal.

[0040] In one design, the processing device is further used to: determine a communication time unit based on the first time unit, send a communication signal to the communication device in the communication time unit, and there is no intersection between the first time unit and the communication time unit.

[0041] Through the above design, the entire system also has the power to communicate with the outside world without affecting normal monitoring, thereby improving the utilization rate of the communication device.

[0042] In one design, the communication device is further used to: modulate the communication signal in the communication time unit to determine a third modulation signal; and control the illumination of the light source according to the third modulation signal.

[0043] In one design, the processing device is further used to: adjust the first time unit corresponding to the first optical receiver unit, and send notification information to the detector, light source and communication device, wherein the notification information is used to notify the detector, light source and communication device to adjust the first time unit corresponding to the first optical receiver unit.

[0044] In one design, the detector, the light source or the communication device is further used to: adjust the first time unit corresponding to the first light receiver unit according to the notification information. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] FIG1 is a schematic diagram of the monitoring method provided by this application;

[0046] FIG2 is a flow chart of the monitoring method provided by the present application;

[0047] FIG3 is a schematic diagram of the integration or exposure time provided in this application;

[0048] FIG4 is a schematic diagram of the PPM or MPPM modulation method provided by the present application;

[0049] FIG5 is a schematic diagram of VOOK or MPPM modulation provided by the present application;

[0050] FIG6 is a schematic diagram of the cycle after the change provided by this application;

[0051] FIG7 is a schematic diagram of a monitoring system provided by the present application;

[0052] FIG8 is another schematic diagram of the monitoring system provided by the present application;

[0053] FIG9 is a schematic diagram of the device provided by the present application;

[0054] FIG10 is another schematic diagram of the device provided in this application. DETAILED DESCRIPTION

[0055] In order to make the purpose, technical solutions and advantages of this application more clear, the application will be further described in detail below with reference to the accompanying drawings. The specific operation methods and functional descriptions in the method embodiments can also be applied to the device embodiments or system embodiments.

[0056] Photoplethysmography (PPG) technology works by illuminating the user's skin with a specific external light source, then using a light detector to collect the reflected light from the user's skin. Combining artificial intelligence and deep learning algorithms, it determines the blood flow characteristics corresponding to the reflected light from the user's skin, and then infers various physiological parameters of the user, including but not limited to at least one of the following: the user's blood pressure, respiration, blood volume, or other circulatory conditions.

[0057] When light of a certain wavelength strikes a user's skin, some of the light is transmitted, or absorbed, by the skin, while some is reflected. While light absorption by muscle, bone, veins, and other connective tissues is essentially constant, light absorption by arteries varies depending on the characteristics of blood flow within them. This means that varying blood flow within arteries results in varying light absorption, and thus varying light reflected from the skin. Therefore, the characteristics of a user's blood flow can be inferred based on the varying light reflected from the skin.

[0058] As shown in Figure 1, in one design, a specific external light source can be used to illuminate the user's face, and a camera can then be used to capture the reflected light from the user's face. Based on the captured reflected light from the user's face, the user's blood flow characteristics can be inferred, and further, the user's heart rate and respiratory rate can be inferred. For example, the captured reflected light from the user's face can be subjected to signal processing, which includes but is not limited to weighted averaging, filtering, and time-frequency analysis. After such processing, the user's heart rate and respiratory rate can be obtained. However, this solution has the following disadvantages: when the specific external light source illuminates the user's face, the monitoring effect is poor in insufficient lighting conditions. Furthermore, if the light intensity of the external light source is too strong, the user experience can be poor, such as glare.

[0059] The present application provides a monitoring method, which can be applied to scenarios for monitoring physiological parameters of a user, such as the user's blood pressure, respiration, blood volume and other circulatory conditions, and the method includes: a light source irradiates the user, a detector collects information about the user, and determines the collected information; a processing device determines a region of interest (ROI) based on the collected information. Optionally, the ROI area can be the user's external exposed skin, etc. The detector includes a plurality of light receiver units, which can determine the light receiver unit for collecting the ROI area, which can be called a ROI light receiver unit; further determine the exposure time of the ROI light receiver unit, which can be called a ROI time unit; control the light source in the ROI time unit to increase the irradiation power, thereby solving the problem of poor monitoring effect caused by insufficient light. The light source does not increase the irradiation power in the non-ROI time unit, which can also solve the problem of too strong light intensity of the external light source, resulting in poor user experience.

[0060] As shown in FIG2 , a flow chart of a monitoring method is provided, comprising the following steps:

[0061] Step 201: A light source illuminates the user.

[0062] The light source may be a light emitting diode (LED) or a low-power laser, and the light source may be directed toward the user. The user may also be referred to as a subject.

[0063] Step 202: The detector collects user information, determines collected information, and sends the collected information to a processing device. The collected information includes at least one of the following: user's reflected light information, user's thermal radiation information, or user's image information.

[0064] The detector includes multiple light receiver units that can receive optical information from the user, including but not limited to at least one of the following: reflected light from the user, or thermal radiation from the user. Thermal radiation from the user is a type of optical information. Considering that the normal human body temperature generally does not exceed 40°C, thermal radiation is primarily radiated as invisible infrared light. In other words, the collected thermal radiation information from the user can be infrared light information, etc. Alternatively, the detector can include a camera that can be used to collect image information from the user, etc., without limitation.

[0065] Optionally, the detector includes at least one light receiving array, each light receiving array including multiple light receiving units. The light receiving units included in each light receiving array are exposed in a cycle. For example, as shown in Figure 3, a light receiving array includes 16 light receiving units, which can be simply referred to as units. The 16 light receiving units can be exposed sequentially in time. For example, the 16 light receiving units correspond to 16 time units, and each light receiving unit is exposed in a corresponding time unit. For example, light receiving unit 1 is exposed in time unit 1 to collect user information. Light receiving unit 2 is exposed in time unit 2 to collect user information. Continuing in this cycle, light receiving unit 16 is exposed in time unit 16 to collect user information. The time unit can be a radio frame, subframe, slot, mini-slot, or symbol, etc., without limitation. Exposing each light receiving unit in a corresponding time unit can also be referred to as integrating each light receiving unit in a corresponding time unit.

[0066] Step 203: The processing device determines a first light receiver unit in the detector for collecting the user's ROI information based on the collected information.

[0067] For example, the processing device may determine at least one of the following user information based on the collected information: depth information, light intensity information, or temperature information; wherein the depth information includes the distance between the user and the detector, and the light intensity information includes the user's color information, including red, green, and blue (RGB) information. The user's depth information and / or light intensity information may be determined based on reflected light from the user or based on image information of the user. Specific determination methods include, but are not limited to, artificial intelligence and deep learning algorithms. The user's temperature information may be determined based on thermal radiation information or based on image information of the user, without limitation. The processing device determines a first light receiver unit in the detector that collects ROI information of the user based on at least one of the user's depth information, light intensity information, or temperature information. For example, the processing device determines a ROI region of interest (ROI) of the user based on at least one of the user's depth information, light intensity information, or temperature information. The ROI region is an exposed skin area of ​​the user, including, but not limited to, the user's face, hands, or arms. Taking the ROI area as the user's facial area as an example, the processing device can determine the user's outline based on the determined depth information; in the user's outline, determine the area that meets the human facial outline, referred to as the first area; further determine whether the light intensity information corresponding to the first area meets the requirements of human skin color; if so, further determine whether the temperature information corresponding to the first area meets the requirements of normal human temperature; if so, determine that the above-mentioned first area is the user's facial area and is the ROI area. Among the multiple light receiver units included in the detector, the light receiver unit that collects the ROI area information is determined to be the first light receiver unit. The first light receiver unit can include one or more light receiver units without limitation. For example, in the example of Figure 3, the first light receiver unit includes light receiver unit 2 and light receiver unit 3. That is, the light receiver unit 2 and light receiver unit 3 of the detector are used to collect information of the ROI area.

[0068] Step 204: The processing device determines the first time unit corresponding to the first light receiver unit according to the correspondence between the light receiver units and the time units.

[0069] As previously mentioned, the detector includes light receiver units and time units that correspond to each other, with each light receiver unit performing exposure during the corresponding time unit. Based on the correspondence between the light receiver units and the time units, the processing device can determine the time unit corresponding to the first light receiver unit that collects information about the ROI region, which can be referred to as the first time unit. This first time unit can include one or more time units, without limitation. For example, in the example of FIG3 , the first time unit includes time unit 2 and time unit 3. Since the first light receiver unit is used to collect information about the ROI region, the first light receiver unit can also be referred to as the ROI light receiver unit. Since the first time unit corresponds to the first light receiver unit, the first time unit can also be referred to as the ROI time unit.

[0070] Step 205: The processing device increases the irradiation power of the light source in the first time unit.

[0071] For example, the processing device may directly control the light source to increase its irradiation power during the first time unit. For example, the processing device may send a notification message to the light source instructing it to increase its irradiation power during the first time unit. Alternatively, the processing device may control the communication device to increase its irradiation power during the first time unit. For example, the processing device may send control information to the communication device instructing it to increase its irradiation power during the first time unit. Based on this control information, the communication device may control the light source to increase its irradiation power. The process by which the communication device controls the light source to increase its irradiation power is described below. Optionally, the light source may increase its irradiation power in the direction of the user's location. Increasing the irradiation power during the first time unit is as follows: During the first time unit, the light source irradiates outward at a preset power. Optionally, during time units other than the first time unit, the light source is turned off. Alternatively, during the first time unit, the light source irradiates outward at the first power. Optionally, during time units other than the first time unit, the light source irradiates outward at a second power. The first power is greater than the second power.

[0072] Optionally, the first time unit is a time unit within one or more cycles, where one cycle is determined based on the exposure time of the photoreceiver units included in the detector. For example, the photodetector includes at least one photoreceiver array, where a photoreceiver array instance includes multiple photoreceiver units. The photoreceiver units included in each photoreceiver array are exposed sequentially, and one cycle can be defined as the time it takes for all photoreceiver units in a photoreceiver array instance to be exposed once. In the example of Figure 3, one cycle can be 16 time units.

[0073] In one design, when the first time unit is an ROI time unit within a cycle, the communication device controls the light source to increase the irradiation power during the first time unit, including: the communication device modulating the control signal during the first time unit to determine a first modulation signal. For example, the control device may modulate the control signal using a first modulation method to determine the first modulation signal. Optionally, the control signal may be generated by the communication device itself, or generated by a processing device and notified to the communication device, without limitation. Optionally, the first modulation method may be notified to the communication device by the processing device, or may be preset, or the first modulation method may be related to the control signal or the first time unit, etc., without limitation. The communication device controls the light source to increase the irradiation power based on the first modulation signal.

[0074] For example, the processing device identifies the ROI area through the user information collected by the detector, maps the ROI area from space to time, and loads the control signal into the time unit corresponding to the ROI, that is, the first time unit. That is, the processing device can generate a control signal in the first time unit and send the control signal to the communication device. The communication device modulates the control signal using a first modulation method in the first time unit to determine the first modulation signal. Optionally, the control signal can be composed of a high level or a binary digit "1", without limitation. Optionally, the first modulation method includes but is not limited to any of the following: on-off keying (OOK), variable on-off keying (VOOK), pulse position modulation (PPM), or multiple pulse position modulation (MPPM), etc.

[0075] Take the VOOK modulation method as an example. The VOOK modulation method is essentially an OOK modulation method with a variable duty cycle. Optionally, the duty cycle of the VOOK modulation signal, that is, the first modulation signal, may be less than or equal to 0.5. The duty cycle may refer to the ratio of the number of codewords "1" in the codeword corresponding to a time unit to the total number of codewords corresponding to the time unit. As shown in Table 1, the duty cycle, communication efficiency and VOOK modulation signal are explained. In Table 1, d represents the original codeword, which can be codeword 0 or codeword 1, etc., without restriction. It should be pointed out that in this application, the original codeword can be a control signal, consisting of a high level or a binary digit 1. In the example of Table 1, after the original codeword is modulated by VOOK, the number of codewords is 10. For example, in the following Table 1, when the duty cycle is 0.5, the codeword after VOOK modulation is "dddddddddd". In this application, the original codeword is the control signal, high level 1, and when the duty cycle is 0.5, the codeword after VOOK modulation is "11111111111".

[0076] Table 1: VOOK modulation methods

[0077]

[0078] Optionally, the communication device may send a modulated signal, such as the aforementioned "1111111111", to the light source in the first time unit to control the light source to increase the irradiation power of the light source in the first time unit. Take the first time unit as time unit 2 and time unit 3 as an example. The processing device generates a control signal in time unit 2 and time unit 3 respectively. The control signal may be a binary number 1, and sends the control signal to the communication device in time unit 2 and time unit 3 respectively. The communication device modulates the control signal in time unit 2 to determine a first modulated signal. For example, the first modulated signal may be "1111111111". The communication device sends the first modulated signal to the light source, and the light source increases the irradiation power of the light source in time unit 2 according to the first modulated signal. The process of the communication device processing the control signal corresponding to time unit 3 is similar to the process of the aforementioned communication device processing the control signal corresponding to time unit 2, and will not be repeated here. When the light source receives the first modulated signal in time unit 2 or time unit 3, it divides time unit 2 or time unit 3 into smaller time units. For example, if it is divided into 10 smaller time units, then if the modulation signal corresponding to each of the above smaller time units is "1", the light source emits light, otherwise the light source does not emit light. Alternatively, if the modulation signal corresponding to each of the above smaller time units is "1", the light source emits light at the first power, otherwise the light source emits light at the second power, and the first power is greater than the second power. Taking the time unit as an example of time slots, in the above example, the first modulation signal is "11111111111", time slot 2 or time slot 3 can be divided into 10 parts, each corresponding to 0.1 time slots. In each 0.1 time slot, if the modulation signal corresponding to the 0.1 time slot is 1, the light source transmits, or transmits at the first power; or, if the modulation signal corresponding to the 0.1 time slot is 0, the light source does not emit light, or transmits at the second power, etc., without limitation. In other subsequent modulation methods, the processing process of the light source is similar. The difference is that for the same control signal, different modulation methods are used, and the first modulation signals obtained may be different.

[0079] Taking the MPPM modulation method as an example, the essence of MPPM is to map a k-bit PPM symbol into an M-bit symbol, 2k>M>k. As shown in Figure 4, the MPPM modulation method maps a 3-bit symbol into a 5-bit symbol, while the PPM modulation method maps it into an 8-bit symbol. The modulation efficiency of MPPM is higher. The communication device processes the MPPM modulation method in a similar way to the aforementioned VOOK modulation method. The difference is that in the VOOK modulation method, the communication device uses the VOOK modulation method to modulate the control signal into a first modulation signal. In the MPPM modulation method, the communication device uses the MPPM modulation method to modulate the control signal into a first modulation signal, etc. In the MPPM modulation method, the processing process after the control signal is modulated into the first modulation signal can refer to the aforementioned VOOK modulation method.

[0080] In another design, when the first time unit is an ROI time unit within multiple cycles, the communication device controls the light source to increase the irradiation power during the first time unit, including: the communication device determines, based on the first time unit, a second ROI time unit corresponding to each cycle within the multiple cycles; optionally, the number of second ROI time units corresponding to different cycles is the same or different, without limitation. The second ROI time unit may include one or more time units, without limitation. The process can be described as: the communication device maps the first time unit, i.e., the ROI time unit, to L0 cycles, where L0 is an integer greater than 1. The communication device modulates the control signal during the second ROI time unit of each cycle to determine a second modulation signal; and the communication device controls the light source to increase the irradiation power based on the second modulation signal.

[0081] For example, as shown in FIG5 , the determined first time unit (i.e., ROI time unit) includes 5 time slots, namely time slot 2 and time slot 3, and time slot 5 to time slot 7. According to the first design mentioned above, the communication device controls the light source to increase the irradiation power in the above 5 time slots. In the second design mentioned above, the 5 time slots can be mapped to 3 cycles. For example, the number of second ROI time units in each cycle is the same. For example, there are 5 / 3 time slots in each cycle, and the light source is controlled to increase the irradiation power. The 5 / 3 time slots in each cycle are the aforementioned second ROI time units. Optionally, the union of the 5 / 3 time slots corresponding to each of the three cycles can just cover the above 5 time slots. Taking a cycle of 16 time slots as an example, in the first cycle, the second ROI time unit determined is time slot 2 to time slot 7. In the second cycle, the second ROI time unit is determined to be the time slot to time slot 20, and time slot 21 to time slot In the third cycle, the second ROI time unit is determined to be the time slot To time slot 40, etc. For this mapping method, please refer to the VOOK modulation method in Figure 6. Alternatively, the number of second ROI time units in each cycle can be different. As shown in Figure 6, the 5 time slots included in the ROI time unit are mapped to 3 cycles. In the first cycle and the second cycle, it is mapped to 2 time slots. In the third cycle, it is mapped to 1 time slot. For this modulation method, please refer to the MPPM modulation method in Figure 6. For example, in the first cycle, the 2 time slots are time slot 2 and time slot 7 respectively. In the second cycle, the 2 time slots are time slot 21 and time slot 22 respectively. In the third cycle, the 1 time slot is time slot 35. For this mapping method, the union of the time slots mapped in the 3 cycles also covers the above 5 time slots.

[0082] Through the above design, it is possible to map the ROI time unit within one cycle to the ROI time unit within multiple cycles, thereby reducing the light intensity of the light source in each cycle. Remote vital sign monitoring can be achieved in situations that are imperceptible to the human eye, such as when the user is sleeping.

[0083] Optionally, the processing device may further determine a communication time unit based on the first time unit, where the communication time unit does not intersect with the first time unit. For example, as shown in Figure 3, a cycle includes 16 time slots, and the first time units are time slots 2 and 3. The communication time units may then be time slots 1, 4, 16, and so on. Optionally, the first time units may be referred to as ROI time units, and the communication time units may be referred to as non-ROI time units. The processing device may send a communication signal to the communication device in the communication time units. The communication device may modulate the communication signal in the communication time units to determine a third modulation signal, and the communication device may control the illumination of the light source based on the third modulation signal. Optionally, the communication signal may be modulated using a modulation scheme such as VOOK or MPPM, without limitation. After modulation, the communication signal still needs to be loaded into the non-ROI time units. In this design, loading the communication signal into the non-ROI time units enables the entire system to communicate with the outside world. Optionally, the communication time units within the aforementioned cycle may be mapped to the communication time units within L1 cycles. The communication time units within these L1 cycles can overlap the communication time units within one cycle. L1 is an integer greater than 1. The value of L1 can be the same as or different from the value of L0, without limitation. The specific process of mapping the communication time units of one cycle to the communication time units of L1 cycles can be found in the aforementioned process of mapping the ROI time units of one cycle to the ROI time units of L0 cycles, and will not be repeated here.

[0084] For example, the first time unit is called ROI time slot, and the communication time unit is called non-ROI time slot. The signal duty cycle in ROI time slot is recorded as c0; the signal duty cycle in non-ROI time slot is recorded as c1; the maximum duty cycle that the system can accept in one cycle is recorded as c max ; Let the number of ROI time slots in the current cycle be N0, and the number of non-ROI time slots in the current cycle be N1, then the following is satisfied:

[0085]

[0086] Optional, the maximum duty cycle c that the system can accept can be determined based on the environment and requirements max ; The maximum duty cycle c0 of the control signal in the ROI time slot, and c0≤c max The duty cycle c1 of the communication signal in the non-ROI time slot satisfies:

[0087]

[0088] Set the ROI time slot within one cycle to be mapped to the ROI time slot of L0 cycles; map the non-ROI time slot within one cycle to the ROI time slot of L1 cycles, then the duty cycle of the control signal satisfies:

[0089]

[0090] The duty cycle of the communication signal satisfies:

[0091]

[0092] Optionally, the processing device may further adjust the first time unit corresponding to the first light receiver unit. The processing device may send a notification message to the detector, light source, and communication device, etc., notifying the adjustment of the first time unit corresponding to the first light receiver unit. The detector, light source, and communication device, etc., may adjust the first time unit corresponding to the first light receiver unit based on the notification message. For example, the number of first time units corresponding to the first light receiver unit may be increased or decreased, the number of first time units corresponding to the first light receiver unit may be increased and then decreased, or the number of first time units corresponding to the first light receiver unit may be decreased and then increased, etc., without limitation.

[0093] For example, consider a detector with a light receiving array comprising 16 light receiver units, each corresponding to a time unit. Light receiver units 2 and 3 are identified as first light receiver units, used to collect information about the ROI region. For example, as shown in FIG3 , in the previous design, light receiver unit 2 corresponds to time unit 2, and light receiver unit 3 corresponds to time unit 3. The processing device can adjust the time units corresponding to light receivers 2 and 3. For example, as shown in FIG6 , the time units corresponding to light receiver unit 2 are adjusted to time units 2 and 3, and the time units corresponding to unit 3 are adjusted to time units 4 and 5. Because each light receiver unit is exposed or integrated in its corresponding time unit, it is used to collect user information. In the above design, increasing the number of time units corresponding to the ROI light receiver units can increase the exposure or integration time corresponding to the ROI light receiver units, thereby effectively utilizing the ROI light receiver units to collect information corresponding to the ROI region and improving monitoring accuracy.

[0094] Optionally, the processing device may also update the correspondence between the optical receiver units and the time units based on the adjusted first time unit corresponding to the first optical receiver unit. For example, in the previous design, as shown in FIG3 , each optical receiver unit corresponds to one time unit, the optical receiving array in the detector includes 16 optical receiver units, and one cycle includes 16 time units. Since the number of time units corresponding to the ROI optical receiver units has increased, for example, in the previous example, the time units corresponding to optical receiver unit 2 and optical receiver unit 3 are adjusted from corresponding to 1 time unit to corresponding to 2 time units respectively, the entire cycle will increase from 16 time units to 18 time units, and the correspondence between the optical receiver units and the time units will be changed to: optical receiver unit 1 corresponds to time unit 1, optical receiver unit 2 corresponds to time unit 2 and time unit 3, optical receiver unit 3 corresponds to time unit 4 and time unit 5, and optical receiver units 4 to 16 each correspond to one time unit, and the time units corresponding to optical receiver units 4 to 16 are time units 6 to 18, respectively. Optionally, after increasing the number of ROI time units, the total cycle length can be less than twice the original cycle length. For example, in the above example, the adjusted cycle length is 18 / 16 = 1.25 times the original cycle length. The adjusted cycle length is no different from the original cycle length by an order of magnitude, and the sampling frequency is not significantly reduced.

[0095] In this design, appropriately increasing the exposure or integration time of the ROI light receiver unit improves the quality of the information collected by the detector without significantly affecting the frame rate or sampling frequency. This approach also prevents the control signal from being distributed over a large number of cycles after adjustment, reducing the complexity of the image and signal processing algorithms.

[0096] The method of the process in Figure 2 above can be applied to the scenario of monitoring the physiological parameters of the user. For example, after step 205, it can also include: the first light receiver unit in the detector, that is, the ROI time unit, collects the information of the user's ROI area at the corresponding exposure time, and sends the collected ROI area information to the processing device. The processing device determines the blood flow characteristics of the user based on the ROI area information; based on the blood flow characteristics of the user, infers various physiological parameters of the user, and the physiological parameters include but are not limited to: respiration, blood pressure, blood volume, or other circulation conditions. The process of inferring the user's physiological parameters based on the ROI area information includes but is not limited to: signal processing (such as filtering or weighted averaging, etc.), deep learning algorithms, or artificial intelligence algorithms, etc.

[0097] Optionally, in addition to the light receiver unit, the detector also includes a complementary metal-oxide-semiconductor (CMOS) camera. The CMOS camera and light receiver array are combined to perform target recognition and tracking. After identifying the ROI area, the light receiver unit is used to collect signals within the ROI area. Optionally, the light receiver unit and the CMOS camera can form a binocular system to obtain three-dimensional (3D) depth information of the user. For example, the light receiver unit and the CMOS camera can collect user information and determine collected information, which includes at least one of the following: user reflected light information, user thermal radiation information, or user image information. The CMOS camera can determine the ROI area based on the collected information. That is, in this application, the entity that performs "determining the ROI area based on the collected information" can be a processing device in the CMOS camera. The processing device that performs the following process can be a processing device in the CMOS camera or other processing device, without limitation. The processing device determines the first time unit corresponding to the ROI region based on the correspondence between the light receiver units and the time units. The processing device then controls the light source to increase the illumination power during the first time unit. Optionally, the light receiver unit may collect user information during the first time unit and transmit this collected information to the processing device. The processing device may also be a processing device in a CMOS camera or other processing device, without limitation. Based on this collected information, the processing device determines the user's blood flow characteristics and, based on this blood flow characteristics, infers various physiological parameters of the user.

[0098] Optionally, a CMOS camera includes a photosensor, and the number of pixels is determined by the number of light-sensitive elements in the photosensor. One light-sensitive element corresponds to one pixel. Therefore, larger pixels mean more light-sensitive elements and correspondingly higher costs. In this application, the pixels of a CMOS camera are larger than the pixels of a light-receiving unit. For example, one light-receiving unit may correspond to N*N pixels in a CMOS camera, where N is an integer greater than 5. Because the pixels of a CMOS camera are larger than the pixels of a light-receiving unit, the CMOS camera has better recognition characteristics.

[0099] In the above design, the CMOS camera offers superior ROI recognition performance, while the optical receiver unit offers superior signal acquisition performance. Combining these two elements can meet requirements such as high sampling rates and high ROI region recognition. It should be noted that the above combination of the optical receiver unit and the CMOS camera is merely illustrative and does not limit the present application. For example, the optical receiver unit can be combined with other optical systems, such as a perspective lens and / or a micro-electro-mechanical system (MEMS) mirror, to improve signal acquisition sensitivity.

[0100] As shown in FIG7 , a monitoring system 700 is further provided, which at least includes: a processing device 701 and a communication device 702 .

[0101] The processing device 701 is configured to determine, based on the collected user information, a first light receiver unit in the detector for collecting the user's ROI information, and to determine, based on the correspondence between light receiver units and time units, a first time unit corresponding to the first light receiver unit. The communication device 702 is configured to control the light source to increase the illumination power during the first time unit.

[0102] Optionally, the system 700 may further include a detector 703 configured to collect user information and determine the collected information, wherein the collected information includes at least one of the following: reflected light information of the user, thermal radiation information of the user, or image information of the user. The detector 703 may include a light receiver array. Optionally, a CMOS camera may also be included. Optionally, the system 700 may further include a light source 704 configured to increase the illumination power in a first time unit according to control.

[0103] The specific execution process of each component in the monitoring system 700 can be found in the description of the aforementioned method and will not be repeated here. The components in the monitoring system 700 can be integrated into a single product or provided in different products, without limitation. The monitoring system 700 can be part or all of a single product, without limitation.

[0104] As shown in Figure 8, a specific example of a monitoring system is provided, including: a detector collects user information, determines the collected information, and transmits the collected information to a processing device; the processing device determines a ROI region based on the collected information and determines the ROI timeslot corresponding to the ROI region. The processing device generates a control signal and transmits the control signal to a communication device; the communication device loads the control signal into the ROI timeslot, modulates the control signal using a modulator in the ROI timeslot, and transmits the modulated signal (hereinafter referred to as the modulated signal) to a light source. Optionally, the light source may be a modulated light source. Based on the modulated signal, the light source controls the light source to increase its illumination power. Optionally, the processing device may also determine non-ROI timeslots based on the ROI timeslot, where the ROI timeslot and the non-ROI timeslot do not intersect. The processing device transmits a communication signal to the communication device, which loads the communication signal into the non-ROI timeslot, modulates the communication signal using a modulator, and transmits the modulated signal to the light source. The light source emits light based on the modulated signal. Optionally, the modulator may be an MPPM modulator or a VOOK modulator, without limitation. The control signal may be referred to as control signal 1, and the communication signal may be referred to as communication signal 2. Optionally, the detector, the processing device, and the modulatable light source may use the same clock signal, which may be generated by the processing device, thereby achieving clock synchronization between the transmitting end of the light source and the receiving end of the detector. Optionally, the operating frequency band of the detector, or the frequency band of perceptible light, may include any of the following frequency bands: visible light (360-830nm), near infrared (830-1550nm), or mid-infrared (6-14um), etc. The operating frequency band of the modulatable light source may be visible light or near infrared (360-1550nm), etc. Optionally, the detector may be a Hamamatsu silicon photodiode array S4111-35Q, a Hamamatsu silicon avalanche photodiode (APD) array S8550-02, or a Hamamatsu CMOS linear array image sensor S11639-01, etc. The light source may be an Osram LED-SFH5701A01, etc. The processing device may be a personal computer processing device series from Intel or AMD, or a mobile phone processing series from Apple, Huawei, or Qualcomm, etc. The communication device may be a pulse driver (Photline) electro-optical modulator-NIR-MX800-LN-10, etc.

[0105] By adopting the above monitoring system, it is possible to remotely monitor the user's vital signs without the human eye being able to detect them; at the same time, the monitoring system also has the ability to communicate with the outside world.

[0106] It is understandable that in order to implement the functions in the above embodiments, the processing device and the communication device end include hardware structures and / or software modules corresponding to the execution of each function. It should be readily apparent to those skilled in the art that, in combination with the units and method steps of each example described in the embodiments disclosed in this application, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application scenario and design constraints of the technical solution.

[0107] Figures 9 and 10 are schematic diagrams of possible monitoring devices provided in embodiments of the present application. These monitoring devices can be used to implement the functions of the processing device or communication device in the above method embodiments, thereby also achieving the beneficial effects of the above method embodiments.

[0108] As shown in Figure 9 , the monitoring device 900 includes a processing unit 910 and a transceiver unit 920. The monitoring device 900 is used to implement the functions of the processing device or the communication device in the method embodiment shown in Figure 2 above.

[0109] When the monitoring device 900 is used to implement the function of the processing device in the method embodiment shown in Figure 2: the transceiver unit 920 is used to receive the collected information from the detector, and the collected information includes at least one of the following: the user's reflected light information, the user's thermal radiation information, or the user's image information; the processing unit 910 is used to determine the first light receiver unit in the detector that collects the user's region of interest ROI information based on the collected information; determine the first time unit corresponding to the first light receiver unit based on the correspondence between the light receiver unit and the time unit; and increase the irradiation power of the light source in the first time unit.

[0110] When the monitoring device 900 is used to implement the function of the communication device in the method embodiment shown in Figure 2: the transceiver unit 920 is used to receive notification information from the processing device, and the notification information is used to notify the communication device to increase the irradiation power of the light source in the first region of interest ROI time unit; the processing unit 910 is used to control the light source to increase the irradiation power in the first time unit.

[0111] A more detailed description of the processing unit 910 and the transceiver unit 920 can be directly obtained by referring to the relevant description in the method embodiment shown in FIG2 , and is not repeated here.

[0112] As shown in Figure 10, monitoring device 1000 includes a processor 1010 and an interface circuit 1020. Processor 1010 and interface circuit 1020 are coupled to each other. It will be appreciated that interface circuit 1020 may be a transceiver or an input / output interface. Optionally, communication device 1000 may further include a memory 1030 for storing instructions executed by processor 1010, input data required by processor 1010 to execute instructions, or data generated by processor 1010 after executing instructions.

[0113] When the communication device 1000 is used to implement the method shown in FIG. 2 , the processor 1010 is used to implement the functions of the processing unit 910 , and the interface circuit 1020 is used to implement the functions of the transceiver unit 920 .

[0114] When the communication device is a chip or module implemented in a processing device, the chip or module of the processing device implements the functions of the processing device in the above-mentioned method embodiments. The chip or module of the processing device receives information from other modules in the processing device (such as a radio frequency module or antenna), and the information is sent by the communication device to the processing device; or the chip or module of the processing device sends information to other modules in the processing device (such as a radio frequency module or antenna), and the information is sent by the processing device to the communication device.

[0115] When the communication device is a chip or module used in a communication device, the communication device chip or module implements the functions of the communication device in the above method embodiments. The communication device chip or module receives information from other modules in the communication device (such as a radio frequency module or antenna), and the information is sent by the communication device to the processing device; or the communication device chip or module sends information to other modules in the communication device (such as a radio frequency module or antenna), and the information is sent by the communication device to the processing device.

[0116] It is understood that the processor in the embodiments of the present application may be a central processing unit (CPU), or may be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field programmable gate arrays (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. The general-purpose processor may be a microprocessor or any conventional processor.

[0117] The method steps in the embodiments of the present application can be implemented by hardware or by a processor executing software instructions. The software instructions can be composed of corresponding software modules, and the software modules can be stored in a random access memory, a flash memory, a read-only memory, a programmable read-only memory, an erasable programmable read-only memory, an electrically erasable programmable read-only memory, a register, a hard disk, a mobile hard disk, a CD-ROM or any other form of storage medium well known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be an integral part of the processor. The processor and the storage medium can be located in an ASIC. In addition, the ASIC can be located in a base station or a terminal. Of course, the processor and the storage medium can also exist in a base station or a terminal as discrete components.

[0118] In the above embodiments, all or part of the embodiments may be implemented using software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments may be implemented in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer program or instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are performed in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user device, or other programmable device. The computer program or instructions may be stored in a computer-readable storage medium or transferred from one computer-readable storage medium to another. For example, the computer program or instructions may be transferred from one website, computer, server, or data center to another website, computer, server, or data center via wired or wireless means. The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or data center that integrates one or more available media. The available medium may be a magnetic medium, such as a floppy disk, hard disk, or magnetic tape; an optical medium, such as a digital video disk; or a semiconductor medium, such as a solid-state drive. The computer-readable storage medium may be a volatile or nonvolatile storage medium, or may include both volatile and nonvolatile types of storage media.

[0119] In the various embodiments of the present application, unless otherwise specified or there is a logical conflict, the terms and / or descriptions between different embodiments are consistent and can be referenced by each other. The technical features in different embodiments can be combined to form new embodiments according to their inherent logical relationships.

[0120] In this application, "at least one" means one or more, and "more" means two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. In the text description of this application, the character " / " generally indicates that the previous and next associated objects are in an "or" relationship; in the formula of this application, the character " / " indicates that the previous and next associated objects are in a "division" relationship. "Including at least one of A, B and C" can mean: including A; including B; including C; including A and B; including A and C; including B and C; including A, B and C.

Claims

1. A monitoring method, characterized in that: include: receiving collected information from a detector, wherein the collected information includes at least one of the following: reflected light information of a user, thermal radiation information of the user, or image information of the user; Determining, based on the collected information, a first light receiver unit in the detector for collecting the user's region of interest (ROI) information; determining a first time unit corresponding to the first light receiver unit according to a correspondence between light receiver units and time units; During the first time unit, the irradiation power of the light source is increased.

2. The method according to claim 1, wherein Increasing the irradiation power of the light source during the first time unit includes: The communication device is controlled to increase the irradiation power of the light source during the first time unit.

3. The method according to claim 2, wherein The controlling the communication device to increase the irradiation power of the light source during the first time unit includes: Notification information is sent to the communication device, where the notification information is used to notify the communication device to increase the irradiation power of the light source during the first time unit.

4. The method according to any one of claims 1 to 3, characterized in that Determining, according to the collected information, a first optical receiver unit in the detector for collecting ROI information of the user, comprising: Determining at least one of the following information of the user based on the collected information: depth information, light intensity information, or temperature information, where the depth information includes distance information between the user and the detector; A first light receiver unit in the detector for collecting ROI information of the user is determined according to at least one of the depth information, the light intensity information or the temperature information of the user.

5. The method according to any one of claims 1 to 4, characterized in that Also includes: Determine a communication time unit according to the first time unit, where there is no intersection between the communication time unit and the first time unit; During the communication time unit, a communication signal is sent to the communication device.

6. The method according to any one of claims 1 to 5, characterized in that The first time unit is a time unit within one or more cycles, and the one cycle is determined according to the exposure time of the light receiver units included in the light receiving array in the detector.

7. The method according to any one of claims 1 to 6, characterized in that Also includes: adjusting a first time unit corresponding to the first optical receiver unit; Notification information is sent to the detector, the light source, and the communication device, where the notification information is used to notify adjustment of a first time unit corresponding to the first light receiver unit.

8. The method according to claim 7, wherein Also includes: The correspondence between the optical receiver unit and the time unit is updated according to the adjusted first time unit corresponding to the first optical receiver unit.

9. A monitoring method, characterized in that: include: receiving notification information from the processing device, wherein the notification information is used to notify the communication device to increase the illumination power of the light source in the first region of interest (ROI) time unit; During the first time unit, the light source is controlled to increase the irradiation power.

10. The method according to claim 9, wherein The first time unit is a time unit within one or more cycles, and the one cycle is determined according to the exposure time of the light receiver units included in the light receiving array in the detector.

11. The method according to claim 10, wherein When the first time unit is an ROI time unit within a cycle, controlling the light source to increase the irradiation power in the first time unit includes: In the first time unit, modulating the control signal to determine a first modulated signal; According to the first modulation signal, the light source is controlled to increase the irradiation power.

12. The method according to claim 10, wherein When the first time unit is an ROI time unit within a plurality of cycles, controlling the light source to increase the irradiation power in the first time unit includes: Determining, according to the first time unit, a second ROI time unit corresponding to each period in a plurality of periods; In the second ROI time unit of each cycle, the control signal is modulated to determine a second modulation signal; According to the second modulation signal, the light source is controlled to increase the illumination power.

13. The method according to any one of claims 9 to 12, characterized in that Also includes: receiving a communication signal from the processing device in a communication time unit, wherein no intersection exists between the communication time unit and the first time unit; In the communication time unit, modulating the communication signal to determine a third modulated signal; According to the third modulation signal, the light source is controlled to increase the illumination power.

14. The method according to any one of claims 9 to 13, characterized in that Also includes: receiving notification information from the processing device, where the notification information is used to adjust a first ROI time unit corresponding to the first optical receiver unit; According to the notification information, a first ROI time unit corresponding to the first optical receiver unit is adjusted.

15. A monitoring system, characterized in that: include: a processing device, configured to determine, based on the collected user information, a first light receiver unit in the detector for collecting region of interest (ROI) information of the user, and determine, based on a correspondence between light receiver units and time units, a first time unit corresponding to the first light receiver unit; The communication device is used to control the light source to increase the illumination power during the first time unit.

16. The system according to claim 15, wherein: Also includes: The detector is used to collect information of the user and determine collected information, where the collected information includes at least one of the following: reflected light information of the user, thermal radiation information of the user, or image information of the user.

17. The system according to claim 16, wherein: The detector includes a light receiver, which includes at least one light receiving array. The light receiving array includes a plurality of light receiving units. One cycle is determined according to the exposure time of the light receiving units included in the light receiving array.

18. The system according to claim 16 or 17, wherein: The detector further includes a complementary metal oxide semiconductor (CMOS) camera.

19. The system according to any one of claims 15 to 18, characterized in that Also includes: The light source is configured to increase the irradiation power in the first time unit according to the control.

20. The system according to any one of claims 15 to 19, characterized in that When the processing device determines the first time unit for collecting the ROI information of the user in the detector based on the collected user information, it is specifically configured to: Determining at least one of the following information of the user based on the collected information: depth information, light intensity information, or temperature information, where the depth information includes distance information between the user and the detector; A first light receiver unit in the detector for collecting ROI information of the user is determined according to at least one of the depth information, the light intensity information or the temperature information of the user.

21. The system according to any one of claims 15 to 20, characterized in that When the first time unit is an ROI time unit within a cycle, the communication device controls the light source to increase the irradiation power during the first time unit, including: In the first time unit, modulating the control signal to determine a first modulated signal; According to the first modulation signal, the light source is controlled to increase the irradiation power.

22. The system according to any one of claims 15 to 20, characterized in that When the first time unit is an ROI time unit within a plurality of cycles, the communication device controls the light source to increase the irradiation power during the first time unit, including: Determining, according to the first time unit, a second ROI time unit corresponding to each period in a plurality of periods; In the second ROI time unit of each cycle, the control signal is modulated to determine a second modulation signal; According to the second modulation signal, the light source is controlled to increase the illumination power.

23. The system according to any one of claims 15 to 22, characterized in that The processing device is further configured to determine a communication time unit based on the first time unit, and send a communication signal to the communication device during the communication time unit, wherein the first time unit and the communication time unit do not have any intersection.

24. The system of claim 23, wherein: The communication device is further configured to: modulate the communication signal in the communication time unit to determine a third modulation signal; and control the illumination of the light source according to the third modulation signal.

25. The system according to any one of claims 15 to 24, characterized in that The processing device is further used to: adjust the first time unit corresponding to the first light receiver unit, and send notification information to the detector, light source and communication device, wherein the notification information is used to notify the detector, light source and communication device to adjust the first time unit corresponding to the first light receiver unit.

26. The system of claim 25, wherein: The detector, the light source or the communication device is further configured to adjust a first time unit corresponding to the first light receiver unit according to the notification information.

27. A monitoring device, characterized in that: The method comprises a unit for performing the method according to any one of claims 1 to 8 or a unit for performing the method according to any one of claims 9 to 14.

28. A monitoring device, characterized in that: The device comprises a processor and an interface circuit, wherein the interface circuit is used to receive signals from devices other than the monitoring device and transmit them to the processor or send signals from the processor to devices other than the monitoring device, and the processor is used to implement the method according to any one of claims 1 to 8 or the method according to any one of claims 9 to 14 through logic circuits or execution of code instructions.

29. A computer-readable storage medium, characterized in that The storage medium stores a computer program or instruction. When the computer program or instruction is executed by the monitoring device, the method according to any one of claims 1 to 8 or the method according to any one of claims 9 to 14 is implemented.

Images