Invisible light index monitoring method and device, AR equipment and storage medium

By using lenses with different transmittances and compensation coefficient processing in AR devices, the problem of low accuracy in measuring invisible light in complex light environments is solved, and accurate measurement and real-time detection are achieved in multi-light hybrid scenarios.

CN119000013APending Publication Date: 2024-11-22ZHUHAI MOJIE TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410564907.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-05-08
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

Existing AR products cannot accurately measure invisible light in complex light or overlapping environments, resulting in low measurement accuracy. The sensor's reading abnormality in the mixed scene of visible and invisible light is unreliable, and real-time detection cannot be achieved.

Method used

At least two sensors are provided in the AR device, and lenses with different transmittance are arranged in front of each sensor. By reading the light index data measured by the sensor, the compensation coefficient is determined to compensate the data, and the invisible light index of the current environment is calculated. The value is determined based on the invisible light index value and is displayed on the AR device.

Benefits of technology

Through differentiated filtering of lenses, multiple scene compatibility is achieved, measurement accuracy is improved, invisible light can be accurately measured in light complex environments, and the credibility and real-time detection capabilities of the sensor are enhanced.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119000013A_ABST
    Figure CN119000013A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of AR measurement, and provides an invisible light index monitoring method and device, AR equipment and a storage medium. According to the method, lenses with different transmittances are arranged in front of sensors of the AR equipment, and light index measurement data measured by two target sensors on the lens sides are read; determining compensation coefficients of the two target sensors, and compensating the corresponding light index measurement data based on each compensation coefficient to obtain corresponding actual light index measurement data; and calculating an invisible light index measurement value of the current environment based on the two actual light index measurement data. In the method, the lenses with different transmittances are arranged to realize the differentiation of measurement data in a multi-light mixed scene due to the existence of the lenses, the compatibility of multiple scenes is realized based on the differentiation, and meanwhile, the measurement accuracy is also improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of AR measurement technology, and in particular to an invisible light index monitoring method, device, AR equipment and storage medium. Background Art

[0002] Augmented Reality (AR) technology is a technology that cleverly integrates virtual information with the real world. It is used to achieve various measurements, especially ultraviolet rays, infrared rays, etc. in the environment.

[0003] At present, in AR products, invisible light measurement and monitoring, such as ultraviolet light, are achieved by adding sensors. Existing sensors can measure ultraviolet light alone or simultaneously measure ultraviolet light and light. However, with the development trend of miniaturization of AR products, the perception of sensors on AR products cannot be too large, and the power consumption cannot be too high. In order to reduce costs, the transmittance of the film coated on the sensor surface is not good, that is, the light filtering performance is relatively poor, resulting in the current sensor readings being credible only in pure invisible light scenes. When in mixed scenes of visible and invisible light, different time periods, and different weather conditions, the sensor readings will be abnormal and unreliable, and real-time detection functions cannot be achieved. Summary of the invention

[0004] In view of this, the purpose of the present disclosure is to provide an invisible light index monitoring method, apparatus, AR device and storage medium to solve the problem of low accuracy in measuring invisible light in an environment with complex light or light overlapping.

[0005] In a first aspect, an embodiment of the present disclosure provides a method for monitoring an index of invisible light, which is applied to an AR device, wherein the AR device includes at least two sensors, and lenses with different transmittances are arranged in front of each sensor. The method includes:

[0006] Read the light index measurement data measured by two target sensors on the lens side;

[0007] Determining compensation coefficients of the two target sensors, and compensating corresponding light index measurement data based on the compensation coefficients to obtain corresponding actual light index measurement data;

[0008] The invisible light index measurement value of the current environment is calculated based on the two actual light index measurement data.

[0009] In one implementation of the first aspect of the present application, the step of reading the light index measurement data measured by two target sensors on the lens side includes:

[0010] Based on the strategy of the farthest plane distance, two sensors located on the same plane and the farthest from each other are randomly selected from the AR device as target sensors;

[0011] The light data of the light passing through the lens is measured by the two target sensors, and corresponding light index measurement data is calculated based on the light data.

[0012] In one implementation of the first aspect of the present application, the plane is perpendicular to the field of view of the AR device.

[0013] In an implementation of the first aspect of the present application, the step of determining the compensation coefficients of the two target sensors and compensating the corresponding light index measurement data based on the compensation coefficients to obtain the corresponding actual light index measurement data includes:

[0014] Determining attribute information of the two target sensors, and extracting compensation coefficients corresponding to the two target sensors from a preset invisible light compensation coefficient relationship library based on the attribute information;

[0015] The light index measurement data is multiplied by the corresponding compensation coefficient to obtain actual light index measurement data of the two target sensors for the current environment.

[0016] In an implementation of the first aspect of the present application, the step of calculating the invisible light index measurement value of the current environment based on the two actual light index measurement data includes:

[0017] The difference between the two actual light index measurement data is calculated to obtain the invisible light index measurement value of the current environment.

[0018] In an implementation manner of the first aspect of the present application, after the step of calculating the invisible light index measurement value of the current environment based on the two actual light index measurement data, the step further includes:

[0019] A corresponding index prompt level is determined based on the invisible light index measurement value, and a prompt is given on the AR device.

[0020] In an implementation of the first aspect of the present application, the invisible light index measurement value includes the invisible light wavelength and the invisible light intensity, and the step of determining the corresponding index prompt level based on the invisible light index measurement value and providing prompt data on the AR device includes:

[0021] Determine a corresponding invisible light index grading table based on the invisible light wavelength;

[0022] The invisible light intensity is matched with each prompt level range in the invisible light index grading table, and a prompt interface is generated based on the matching result and displayed on the AR device.

[0023] In one implementation of the first aspect of the present application, before the step of reading the light index measurement data measured by the two target sensors on the lens side, the step further includes:

[0024] Testing each sensor on the AR device based on different scenes and different light sources to obtain measurement data of each sensor under different scenes and different light sources;

[0025] The invisible light compensation coefficient of the sensor is calculated based on each of the measurement data and the corresponding actual light data, and a relationship library is constructed.

[0026] In an implementation of the first aspect of the present application, after the step of calculating the invisible light compensation coefficient of the sensor based on each of the measurement data and the corresponding actual light data, the method further includes:

[0027] Regression calculation is performed on the invisible light compensation coefficient of the sensor under different scenes and different light sources to obtain a common invisible light compensation coefficient that satisfies different scenes and different light sources.

[0028] In a second aspect, an embodiment of the present disclosure provides an invisible light index monitoring device, which is applied to an AR device, characterized in that the AR device includes at least two sensors, and lenses with different transmittances are arranged in front of each sensor, and the device includes:

[0029] A reading module, used for reading the light index measurement data measured by two target sensors on the lens side;

[0030] A compensation module, used to determine compensation coefficients of the two target sensors, and compensate corresponding light index measurement data based on the compensation coefficients to obtain corresponding actual light index measurement data;

[0031] A calculation module is used to calculate the invisible light index measurement value of the current environment based on the two actual light index measurement data.

[0032] In an implementation of the second aspect of the present application, the reading module includes:

[0033] A selection unit, configured to randomly select two sensors located on the same plane and farthest from each other from the AR device as target sensors based on a strategy of farthest plane distance;

[0034] The reading unit is used to measure the light data of the light passing through the lens through the two target sensors, and calculate the corresponding light index measurement data based on the light data.

[0035] In one implementation of the second aspect of the present application, the plane is perpendicular to the field of view of the AR device.

[0036] In one implementation of the second aspect of the present application, the compensation module includes:

[0037] an extraction unit, configured to determine attribute information of the two target sensors, and extract compensation coefficients corresponding to the two target sensors from a preset invisible light compensation coefficient relationship library based on the attribute information;

[0038] The compensation unit is used to multiply the light index measurement data by the corresponding compensation coefficient to obtain the actual light index measurement data of the two target sensors for the current environment.

[0039] In an implementation manner of the second aspect of the present application, the calculation module is specifically used for:

[0040] The difference between the two actual light index measurement data is calculated to obtain the invisible light index measurement value of the current environment.

[0041] In one implementation of the second aspect of the present application, the invisible light index monitoring device further includes a prompt module, which is used to:

[0042] A corresponding index prompt level is determined based on the invisible light index measurement value, and a prompt is given on the AR device.

[0043] In one implementation of the second aspect of the present application, the prompt module includes:

[0044] A determining unit, configured to determine a corresponding invisible light index grading table based on the invisible light wavelength;

[0045] A prompt unit is used to match the invisible light intensity with each prompt level range in the invisible light index grading table, and generate a prompt interface based on the matching result, and display it on the AR device.

[0046] In one implementation of the second aspect of the present application, the invisible light index monitoring device further includes a calibration module, which is used to:

[0047] Testing each sensor on the AR device based on different scenes and different light sources to obtain measurement data of each sensor under different scenes and different light sources;

[0048] The invisible light compensation coefficient of the sensor is calculated based on each of the measurement data and the corresponding actual light data, and a relationship library is constructed.

[0049] In one implementation of the second aspect of the present application, the invisible light index monitoring device further includes a regression module, which is used to:

[0050] Regression calculation is performed on the invisible light compensation coefficient of the sensor under different scenes and different light sources to obtain a common invisible light compensation coefficient that satisfies different scenes and different light sources.

[0051] In a third aspect, an embodiment of the present disclosure provides an AR device, including a processor and a memory, wherein the memory stores machine executable instructions that can be executed by the processor, and the processor executes the machine executable instructions to implement the invisible light index monitoring method provided above.

[0052] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, which stores machine-executable instructions. When the machine-executable instructions are called and executed by a processor, the machine-executable instructions prompt the processor to implement the invisible light index monitoring method provided above.

[0053] The embodiments of the present disclosure bring the following beneficial effects:

[0054] The above-mentioned invisible light index monitoring method, device, AR device and storage medium are provided with lenses with different transmittances in front of each sensor of the AR device, and the light index measurement data measured by two target sensors on the lens side are read; the compensation coefficients of the two target sensors are determined, and the corresponding light index measurement data are compensated based on each compensation coefficient to obtain the corresponding actual light index measurement data; the invisible light index measurement value of the current environment is calculated based on the two actual light index measurement data. In this method, lenses with different transmittances are set so that the light index measurement data measured by each sensor are different, and then the index measurement value of a single invisible light is obtained based on the difference between the light index measurement data and the compensation coefficient. This method is not limited to the scene of a single light. In the scene of mixed light, the measurement data is differentiated due to the presence of the lens, and the compatibility of multiple scenes is achieved based on this differentiation, while also improving the measurement accuracy.

[0055] Other features and advantages of the present disclosure will be described in the following description, and partly become apparent from the description, or understood by practicing the present disclosure. The purpose and other advantages of the present disclosure are realized and obtained by the structures particularly pointed out in the description, claims and drawings.

[0056] In order to make the above-mentioned objectives, features and advantages of the present disclosure more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] In order to more clearly illustrate the specific embodiments of the present disclosure or the technical solutions in the prior art, the drawings required for use in the specific embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without paying any creative work.

[0058] Figure 1 It is a schematic diagram of the spectrum of the existing two-in-one sensor during measurement;

[0059] Figure 2 A schematic diagram of a first embodiment of an invisible light index monitoring method provided by an embodiment of the present invention;

[0060] Figure 3 A schematic diagram of a second embodiment of the invisible light index monitoring method provided by the disclosed embodiment of the present invention;

[0061] Figure 4 A schematic diagram of a third embodiment of the invisible light index monitoring method provided by the disclosed embodiment of the present invention;

[0062] Figure 5 A schematic diagram of the structure of AR glasses provided by an embodiment of the present invention;

[0063] Figure 6 A schematic diagram showing the index level of ultraviolet rays provided in an embodiment disclosed in the present invention;

[0064] Figure 7 A schematic diagram of an invisible light index monitoring device provided by an embodiment of the present invention;

[0065] Figure 8 A schematic diagram of an AR device provided in an embodiment disclosed in the present invention. DETAILED DESCRIPTION

[0066] In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present disclosure, rather than all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present disclosure.

[0067] Setting up a sensor for detecting invisible light on the existing AR glasses can measure the index of various invisible lights. However, due to the interference between invisible lights such as ultraviolet rays and infrared rays, the spectrum collected by the sensor is inaccurate. Figure 1 As shown, the sensor collects ultraviolet UV, infrared IR and visible light ALS respectively. However, due to problems in the sensor manufacturing process or the coating process itself, when the sensor collects different lights, there will be some ultraviolet UV that has a bump on the infrared IR component, which will cause additional ultraviolet UV values ​​to be generated in scenes similar to pure A light (that is, there are a large number of IR components in the spectrum). As a result, in reality, a light source with very little ultraviolet UV component like pure A light has a large ultraviolet UV value, resulting in inaccurate ultraviolet detection function, or it can only be used in some specified scenes.

[0068] Based on the above problems, the embodiments of the present disclosure provide an invisible light index monitoring method, apparatus, AR device and storage medium, which can be applied to measure the invisible light index in scenes with a mixture of multiple lights.

[0069] In one embodiment of the present disclosure, the invisible light index monitoring method can be run on AR glasses or a server. When the invisible light index monitoring method is run on an AR device, the method can be implemented and executed based on a controller in the AR device, wherein the controller includes a processor and a memory, the memory stores a corresponding application, and the processor executes the application to collect and analyze data.

[0070] For ease of understanding, the specific process of the embodiment of the present disclosure is described below. Figure 2 The method can be applied to the AR device described above, such as AR glasses, wherein a plurality of sensors are provided on the AR device, and lenses with different transmittances are provided in front of each sensor, wherein the transmittance can be achieved by coating the lenses with films that transmit different light, and can be specifically determined according to the target light to be measured, where the target light refers to invisible light, such as ultraviolet rays, infrared rays, etc. An embodiment of the invisible light index monitoring method in the embodiment of the present disclosure includes the following steps:

[0071] Step 201 : reading the light index measurement data measured by two target sensors on the lens side.

[0072] In this step, the two target sensors are any two of the multiple sensors in the AR device, and the transmittance set in front of each sensor is different, that is, the index of light collected by each sensor will be different after being filtered by the lens. For example, the light in the current environment includes a variety of invisible light and visible light. After the multiple invisible lights are filtered by the lens, the proportions reflected on the sensor side will be different. For example, the lens on one target sensor can transmit UV, IR and ALS, so that the indices of UV, IR and ALS light can be measured, and the lens on the other target sensor can only transmit IR and ALS, so that the indices of IR and ALS light can be measured.

[0073] Then the controller of the AR device reads the measurement values ​​of the two target sensors through the IIC control line to generate a set of light index measurement data groups, through which the UV index measurement can be achieved.

[0074] In another embodiment, due to the limitation of the coating process, the lens cannot completely filter out a certain light, but can only weaken the index of a certain light. In this regard, the light index measured by each target sensor is still the index of all light, but the ratio of the values ​​measured by each target sensor will be different, and the ratio is specifically determined according to the degree of weakening. For example, the lenses on the two target sensors can both transmit UV, IR and ALS, but one target sensor can measure the index of 100% UV, 100% IR and 100% ALS light, and the other target sensor can measure the index of 30% UV, 100% IR and 100% ALS light. Then, based on the data of these two target sensors, IR and ALS can be filtered out, and the final result is only UV, thereby realizing the measurement and calculation of UV.

[0075] In actual applications, two target sensors are selected based on the monitored invisible light, that is, by receiving and parsing the monitoring instructions to obtain the target invisible light, and then selecting two sensors that can measure the target invisible light from the AR device as target sensors based on the target invisible light to read the readings in the two target sensors.

[0076] Furthermore, the coating parameters of the lenses paired with each sensor in the AR device are retrieved, and the filtering ratios of the lenses to different types of light are determined based on the coating parameters. The filtering ratios of the lenses are paired to select two sensors that can measure the target invisible light as target sensors.

[0077] Of course, after the AR device collects the measurement data of all sensors, it is also possible to analyze the ratio of different types of light indices in the measurement data, perform combined screening based on the analysis results and the target invisible light, and screen out two measurement data as target data, that is, screen out two light index measurement data.

[0078] Step 202 : determining compensation coefficients of two target sensors, and compensating corresponding light index measurement data based on the compensation coefficients to obtain corresponding actual light index measurement data.

[0079] Among them, the compensation coefficient of each sensor in the AR device is different. The difference can be understood as the compensation coefficients of different scenes are different, or it can be understood as the compensation coefficients of different types of light are different. Such differences are mainly caused by the manufacturing process of the sensor.

[0080] In one embodiment, the corresponding compensation coefficients are queried from the compensation coefficient relationship library based on the attribute information of the two target sensors. Specifically, the calibration records with consistent name or ID information are queried from the compensation coefficient relationship library through the names or ID information of the two target sensors, and the compensation coefficients are extracted from the calibration records. For example, the compensation coefficient of sensor 1 is K1, and the compensation coefficient of sensor 2 is K2. Then, the light index measurement data of the corresponding target sensors are compensated and calculated using the compensation coefficients K1 and K2 to obtain actual light index measurement data.

[0081] After querying the calibration record with consistent name or ID information, it also includes: analyzing the light index measurement data to determine the type of light therein, and collecting environmental information where the AR device is located, determining the scene type based on the environmental information, extracting at least one matching compensation coefficient from the calibration record based on the light type and / or scene type, and then using the at least one compensation coefficient to compensate the light index measurement data.

[0082] Furthermore, if multiple compensation coefficients that meet the conditions of the sensor are extracted from the calibration record, the multiple compensation coefficients are fused and calculated to obtain a comprehensive value, and the light index measurement data is compensated based on the comprehensive value. The specific fusion calculation can be a regression calculation or a weight calculation, such as a weight ratio of the scene type and the light type.

[0083] Step 203: Calculate the invisible light index measurement value of the current environment based on the two actual light index measurement data.

[0084] Specifically, the actual light index measurement data of the two sensors are subtracted to obtain the index measurement value of the target invisible light, wherein the index measurement value is the light intensity or wavelength, or even other values.

[0085] In another embodiment, if the index contents contained in the data measured by the two target sensors are the same, after calculating the index measurement value of the target invisible light, it also includes: determining the proportional compensation coefficient based on the proportion of the contents of the index. For example, one target sensor can measure the index of 100% UV, 100% IR and 100% ALS light, and another target sensor can measure the index of 30% UV, 100% IR and 100% ALS light. After subtracting the two indexes, an index of 70% UV is obtained, and then the subtracted index is compensated based on the 70% weight to obtain the actual complete UV index.

[0086] The invisible light index monitoring method is to set lenses with different transmittances in front of each sensor of the AR device, and read the light index measurement data measured by two target sensors on the lens side; determine the compensation coefficients of the two target sensors, and compensate the corresponding light index measurement data based on each compensation coefficient to obtain the corresponding actual light index measurement data; and calculate the invisible light index measurement value of the current environment based on the two actual light index measurement data. This solves the problem of low accuracy in measuring invisible light in an environment with complex light or light overlap.

[0087] See also Figure 3 , which is a second embodiment of the invisible light index monitoring method provided by an embodiment of the present invention, the method comprises the following steps:

[0088] Step 301 : Based on the strategy of the farthest plane distance, two sensors located on the same plane and farthest from each other are randomly selected from the AR device as target sensors.

[0089] As an example but not limitation, the strategy for the farthest plane distance is the farthest vertical distance and the farthest line distance, which is specifically achieved by constructing a plane for each sensor on the AR device, wherein the plane is constructed based on the position coordinates of the sensor, a plane perpendicular to the field of view of the AR device is constructed, and then the spatial relationship between the plane and other sensors is detected, and the sensor whose spatial relationship is on the plane is selected to obtain two target sensors.

[0090] Furthermore, when no sensor belonging to the same plane can be found through plane screening, screening can also be conducted based on a plane parallel to the plane, and a sensor with the farthest distance between the two in the vertical field of view direction is screened to obtain two target sensors.

[0091] In another embodiment, after screening out the two target sensors with the farthest distance, the method further includes: determining the target visible light based on the measurement instruction, and then performing comparative analysis on the transmittances of the lenses on the two target sensors to determine whether the transmittances of the two target sensors only differ by the target invisible light; if not, continue screening from other parallel planes until two target sensors that meet both the distance and the target invisible light difference are screened out.

[0092] Step 302: measure light data of light passing through the lens by two target sensors, and calculate corresponding light index measurement data based on the light data.

[0093] After determining the two target sensors, the two target sensors are controlled by measurement instructions to respectively collect signals of light passing through the front lens, such as a light signal curve, and then the light signal curve is analyzed to obtain light index measurement data, such as light intensity, wavelength, etc.

[0094] Step 303 : determining the attribute information of the two target sensors, and extracting compensation coefficients corresponding to the two target sensors from a preset invisible light compensation coefficient relationship library based on the attribute information.

[0095] As an example but not limitation, the attribute information is the sensor name, ID, communication address, location coordinates on the AR device, etc.

[0096] In this embodiment, the preset invisible light compensation coefficient relationship library is specifically a relationship library obtained by testing and calibration when the AR device is on the production line, and then saved in the AR device. When used, the compensation coefficient of the corresponding sensor is obtained by querying the relationship library through attribute information as an index. The compensation coefficient is specifically a light intensity compensation coefficient of invisible light, such as compensation coefficients for ultraviolet rays, infrared rays, etc.

[0097] In another embodiment, the compensation coefficient of each sensor may be one or more. When there is only one compensation coefficient, it is tested through different scenes and / or different light sources during the calibration process, and a comprehensive value is taken to obtain a compensation coefficient compatible with different scenes and light sources.

[0098] When there are multiple AR devices, different compensation coefficients are calibrated based on different scenes. Therefore, when extracting the compensation coefficient from the relationship library, it also includes identifying the scene type of the environment in which the AR device is currently located, such as indoors, outdoors, weather, mixed types of light, etc.; based on the scene type and the attribute information of the sensor, the records in the relationship library are queried as indexes to extract the compensation coefficients in the records.

[0099] In this embodiment, the relationship library recording the compensation coefficients of different sensors is specifically obtained in the following manner: each sensor on the AR device is tested based on different scenes and different light sources to obtain measurement data of each sensor under different scenes and different light sources; based on each of the measurement data and the corresponding actual light data, the invisible light compensation coefficient of the sensor is calculated, and a relationship library is constructed.

[0100] Specifically, when producing AR devices, the AR devices are tested on the production line by placing them in different scenes and giving them different types of light, and the compensation coefficients of each sensor are calculated based on the test results.

[0101] Furthermore, in the process of testing and building the relationship library, the measurement results of each sensor are collected and compared with the results measured by professional instruments, and the ratio is calculated to obtain the corresponding compensation coefficient.

[0102] The compensation coefficients here have corresponding compensation coefficients for different scenes or different light sources. Therefore, in order to achieve uniformity and compatibility of compensation, all the compensation coefficients calculated for the same sensor are regressed to obtain a common compensation coefficient, and then a corresponding relationship is established to generate a relationship library.

[0103] Specifically, regression calculation is performed on the invisible light compensation coefficient of the sensor under different scenes and different light sources to obtain a common invisible light compensation coefficient that satisfies different scenes and different light sources.

[0104] Step 304: multiply the light index measurement data by the corresponding compensation coefficient to obtain actual light index measurement data of the two target sensors for the current environment.

[0105] Step 305: perform difference calculation on two actual light index measurement data to obtain the invisible light index measurement value of the current environment.

[0106] Step 306: determine a corresponding index prompt level based on the invisible light index measurement value, and provide a prompt on the AR device.

[0107] Specifically, a division table of the invisible light index prompt level is obtained, the invisible light index measurement value is matched with each level in the division table, the level is determined based on the matching result, and then the corresponding area on the division table is marked to obtain a prompt table, which is displayed on the AR device. Of course, it can also be displayed in a way of generating prompt information.

[0108] In another embodiment, invisible light is further divided into different types, and the classification criteria corresponding to different types of invisible light are different. Therefore, when determining the prompt level display, the corresponding invisible light index grading table is determined based on the invisible light wavelength; the invisible light intensity is matched with each prompt level range in the invisible light index grading table, and a prompt interface is generated based on the matching result and displayed on the AR device.

[0109] Through the implementation of this embodiment, lenses with different transmittances are set to make the light index measurement data measured by each sensor different, and then the index measurement value of a single invisible light is obtained based on the difference between the light index measurement data and the compensation coefficient. This method is not limited to the scene of a single light. In the scene of mixed light, the measurement data can be differentiated due to the presence of lenses. Based on this differentiation, compatibility with multiple scenes is achieved, and the measurement accuracy is also improved.

[0110] See also Figure 4-6 , the invisible light index monitoring method provided by the present invention is described in detail in combination with a specific scenario. This embodiment uses AR glasses as the execution subject and takes the measurement of the ultraviolet index as an example. Figure 5 As shown, the AR glasses include a glasses frame 510, a first sensor 520 and a second sensor 530. A data display lens 540 is provided on the glasses frame 510. The first sensor 520 and the second sensor 530 are arranged at one end of the two glasses legs of the glasses frame 510 close to the lens. A first lens 550 is provided in front of the first sensor 520, and a second lens 560 is provided in front of the second sensor 530. The transmittance of the first lens 550 and the second lens 560 are different. The transmittance is specifically achieved by coating. After coating, the first lens 550 can transmit three kinds of light, UV, IR and ALS. After coating, the second lens 560 can transmit two kinds of light, IR and ALS. However, in the actual coating process, the second lens 560 will still have some UV. Based on the structure of the AR glasses, the method provided in this embodiment includes the following steps:

[0111] Step 401: Test the first ultraviolet compensation coefficient of the first sensor and the second ultraviolet compensation coefficient of the second sensor on the AR glasses by means of calibration test.

[0112] Specifically, each sensor on the AR device is tested based on different scenes and different light sources to obtain the ultraviolet measurement index of each sensor under different scenes and different light sources; and the ultraviolet compensation coefficient of the sensor is calculated based on each ultraviolet measurement index and the corresponding ultraviolet actual index.

[0113] Furthermore, regression calculation is performed on the ultraviolet compensation coefficient of the sensor in different scenes and different light sources to obtain a common ultraviolet compensation coefficient that satisfies different scenes and different light sources.

[0114] As an example but not a limitation, the first sensor and the second sensor on the AR glasses are respectively placed at the left and right symmetrical positions of the AR glasses, that is, on the two temples, and the lenses in front of the sensors are respectively coated, and the coating requirements are as follows:

[0115] The transmittance requirements of the coating on the lens surface of the first sensor are: 550nm: 10%±3, 350nm: 10%±3, 940nm: >85%.

[0116] The transmittance requirements of the coating on the lens surface of the second sensor are: 550nm: 10%±3, 350nm: 0%±2, 940nm: >85%.

[0117] By simulating multiple scenes and placing the AR glasses in the simulated scenes to measure the index of invisible light, the index measured by the first sensor and the second sensor on the AR glasses is read, and then the read index is compared with the index of the actual light source in the scene, and the ratio is calculated to obtain the corresponding compensation coefficient.

[0118] In actual applications, during testing, different scenes are first simulated, and then different light sources are given in each scene. Then measurements are taken, and the corresponding compensation coefficient is calculated by combining the index of the actual light source with the information of the scene.

[0119] As an example but not a limitation, CVF light source, D56 light source and A light source are selected to calibrate the first sensor and the second sensor in turn. Taking the calibration test of the first sensor as an example, the calibration test of the first sensor is performed using the above three light sources. First, different orders of magnitude of IR values ​​corresponding to different types of light are obtained. By switching different light sources and brightness, the readings of the first sensor are obtained respectively, and the ratio of the actual light source brightness to the reading of the first sensor is obtained, and the compensation coefficients of different light sources are obtained. For example, the first sensor and the second sensor simultaneously read their respective UV readings A and B under the ultraviolet intensity of 2w / ㎡, and the compensation coefficients of the first sensor and the second sensor are obtained as a=A / 2 and b=B / 2 respectively.

[0120] The calibration test is completed on the production line of AR glasses. The calibration test process also uses professional instruments to assist in improving the accuracy of the calculated compensation coefficient. Specifically, the AR glasses are first calibrated and measured to read the index light intensity of the ultraviolet rays of the two sensors as C1 and D1. Then, the ultraviolet intensity obtained by using professional instruments in the same scene is C2 and D2. Finally, the ratio of the light intensity is calculated to determine the difference between the AR glasses reading and the actual value and the reading of the professional instrument, so as to obtain the compensation coefficient. For example, the ratio of the reading of the AR glasses to the theoretical index of the light source is first calculated to obtain the first compensation coefficient, and then the ratio of the reading of the AR glasses to the reading of the professional instrument is calculated to obtain the second compensation coefficient. The first compensation coefficient and the second compensation coefficient are fused to obtain the compensation coefficient of the sensor, such as regression calculation.

[0121] Step 402 : measuring a first light intensity and a second light intensity of light in a target environment by using a first sensor and a second sensor on the AR glasses.

[0122] The target environment is a multi-light mixed scene, specifically, three types of light, UV, IR and ALS, exist simultaneously. The first sensor measures a first light intensity of the target environment that is a mixture of the three types of light, UV, IR and ALS, and the second sensor measures a second light intensity of the target environment that is a mixture of the two types of light, IR and ALS.

[0123] In practical applications, the second light intensity measured by the second sensor may also include UV light intensity, but the UV light intensity is only partial at this time because the UV light intensity is partially weakened in the coated lens.

[0124] Step 403: multiply the first light intensity by the first ultraviolet compensation coefficient, and multiply the second light intensity by the second ultraviolet compensation coefficient.

[0125] The multiplication here is mainly to eliminate the differences in measurement data caused by differences in the manufacturing process and environment of AR glasses. At the same time, the UV value in the IR component during measurement can be subtracted to obtain the actual UV value under the UV channel.

[0126] Step 404, performing a difference calculation on the two actual light intensities obtained after multiplication to obtain the ultraviolet light intensity.

[0127] Step 405: determine a corresponding index prompt level based on the ultraviolet light intensity, and provide a prompt on the AR device.

[0128] In this embodiment, the collected ultraviolet rays are also classified, that is, the type of ultraviolet rays is determined based on the wavelength of the collected ultraviolet rays, a matching ultraviolet index classification is selected or constructed based on the type, and then the currently measured ultraviolet light intensity is matched with the light intensity interval of each level to obtain a matching prompt level, and finally the prompt information of the ultraviolet rays in the environment is generated. Specifically, the prompt information is replaced as follows Figure 6 The table shown.

[0129] The above invisible light index monitoring method is to set lenses with different transmittances in front of each sensor of the AR device, and read the light index measurement data measured by two target sensors on the lens side; determine the compensation coefficients of the two target sensors, and compensate the corresponding light index measurement data based on each compensation coefficient to obtain the corresponding actual light index measurement data; and calculate the invisible light index measurement value of the current environment based on the two actual light index measurement data. By setting lenses with different transmittances, the light index measurement data measured by each sensor is different, and then the index measurement value of a single invisible light is obtained based on the difference between the light index measurement data and the compensation coefficient, thereby realizing the measurement of the corresponding invisible light index in a multi-light mixed scene.

[0130] Corresponding to the above method embodiment, see Figure 7 The invisible light index monitoring device shown is applied to an AR device, wherein the AR device includes at least two sensors, and lenses with different transmittances are arranged in front of each sensor. The device includes:

[0131] A reading module 710 is used to read the light index measurement data measured by two target sensors on the lens side;

[0132] A compensation module 720, configured to determine compensation coefficients of the two target sensors, and compensate corresponding light index measurement data based on the compensation coefficients to obtain corresponding actual light index measurement data;

[0133] The calculation module 730 is used to calculate the invisible light index measurement value of the current environment based on the two actual light index measurement data.

[0134] Optionally, the reading module 710 includes:

[0135] A selection unit 711 is configured to randomly select two sensors located on the same plane and farthest from each other as target sensors from the AR device based on a strategy of farthest plane distance;

[0136] The reading unit 712 is used to measure the light data of the light passing through the lens through the two target sensors, and calculate the corresponding light index measurement data based on the light data.

[0137] Optionally, the plane is perpendicular to a field of view of the AR device.

[0138] Optionally, the compensation module 720 includes:

[0139] An extraction unit 721, configured to determine attribute information of the two target sensors, and extract compensation coefficients corresponding to the two target sensors from a preset invisible light compensation coefficient relationship library based on the attribute information;

[0140] The compensation unit 722 is used to multiply the light index measurement data by the corresponding compensation coefficient to obtain the actual light index measurement data of the two target sensors for the current environment.

[0141] Optionally, the calculation module 730 is specifically used for:

[0142] The difference between the two actual light index measurement data is calculated to obtain the invisible light index measurement value of the current environment.

[0143] Optionally, the invisible light index monitoring device further includes a prompt module 740, which is used to:

[0144] A corresponding index prompt level is determined based on the invisible light index measurement value, and a prompt is given on the AR device.

[0145] Optionally, the prompt module 740 includes:

[0146] A determining unit 741 is used to determine a corresponding invisible light index grading table based on the invisible light wavelength;

[0147] The prompt unit 742 is used to match the invisible light intensity with each prompt level range in the invisible light index grading table, and generate a prompt interface based on the matching result, and display it on the AR device.

[0148] Optionally, the invisible light index monitoring device further includes a calibration module 750, which is used to:

[0149] Testing each sensor on the AR device based on different scenes and different light sources to obtain measurement data of each sensor under different scenes and different light sources;

[0150] The invisible light compensation coefficient of the sensor is calculated based on each of the measurement data and the corresponding actual light data, and a relationship library is constructed.

[0151] Optionally, the invisible light index monitoring device further includes a regression module 760, which is used to:

[0152] Regression calculation is performed on the invisible light compensation coefficient of the sensor under different scenes and different light sources to obtain a common invisible light compensation coefficient that satisfies different scenes and different light sources.

[0153] This embodiment also provides an AR device, including a processor and a memory, wherein the memory stores machine executable instructions that can be executed by the processor, and the processor executes the machine executable instructions to implement the invisible light index monitoring method provided above.

[0154] See also Figure 8 As shown, the AR device includes a processor 800 and a memory 801 , wherein the memory 801 stores machine executable instructions that can be executed by the processor 800 , and the processor 800 executes the machine executable instructions to implement the invisible light index monitoring method provided above.

[0155] Further, Figure 8 The AR device shown further includes a bus 802 and a communication interface 803 , and the processor 800 , the communication interface 803 and the memory 801 are connected via the bus 802 .

[0156] The memory 801 may include a high-speed random access memory (RAM), and may also include a non-volatile memory, such as at least one disk storage. The communication connection between the system network element and at least one other network element is realized through at least one communication interface 803 (which may be wired or wireless), and the Internet, wide area network, local area network, metropolitan area network, etc. may be used. The bus 802 may be an ISA bus, a PCI bus, or an EISA bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 8 Only one bidirectional arrow is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0157] The processor 800 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit or software instructions in the processor 800. The above processor 800 can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The disclosed methods, steps and logic block diagrams in the embodiments of the present disclosure can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in conjunction with the embodiments of the present disclosure can be directly embodied as a hardware decoding processor for execution, or a combination of hardware and software modules in the decoding processor for execution. The software module can be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 801, and the processor 800 reads the information in the memory 801 and completes the invisible light index monitoring method provided in the above embodiment in combination with its hardware.

[0158] By extracting non-text information from the content displayed by AR glasses and using the Internet to query the corresponding related text information, data display of AR glasses when reading books is realized. The displayed content can also be analyzed in real time to provide users with more detailed and specific descriptions, so as to solve the problem that existing AR glasses are unable to perform secondary analysis of the displayed information in reading scenarios, thereby reducing the user's reading experience using AR glasses.

[0159] This embodiment also provides a machine-readable storage medium, which stores machine-executable instructions. When the machine-executable instructions are called and executed by a processor, the machine-executable instructions prompt the processor to implement the invisible light index monitoring method provided in the above embodiment.

[0160] The invisible light index monitoring method, AR glasses and computer program products of storage media provided in the embodiments of the present disclosure include a computer-readable storage medium storing program codes. The instructions included in the program codes can be used to execute the methods described in the previous method embodiments. For specific implementations, please refer to the method embodiments, which will not be repeated here.

[0161] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the system and device described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0162] In addition, in the description of the embodiments of the present disclosure, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For those skilled in the art, the specific meanings of the above terms in the present disclosure can be understood according to specific circumstances.

[0163] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present disclosure, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present disclosure. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0164] In the description of the present disclosure, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc., indicating the orientation or positional relationship, are based on the orientation or positional relationship shown in the drawings, and are only for the convenience of describing the present disclosure and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation of the present disclosure. In addition, the terms "first", "second", and "third" are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance.

[0165] Finally, it should be noted that the above embodiments are only specific implementation methods of the present disclosure, which are used to illustrate the technical solutions of the present disclosure, rather than to limit them. The protection scope of the present disclosure is not limited thereto. Although the present disclosure is described in detail with reference to the above embodiments, those skilled in the art should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above embodiments within the technical scope disclosed in the present disclosure, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present disclosure, and should be included in the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be based on the protection scope of the claims.

Claims

1. A method for monitoring an index of invisible light, applied to an AR device, characterized in that: The AR device includes at least two sensors, and lenses with different transmittances are arranged in front of each sensor. The method includes: Read the light index measurement data measured by two target sensors on the lens side; Determining compensation coefficients of the two target sensors, and compensating corresponding light index measurement data based on the compensation coefficients to obtain corresponding actual light index measurement data; The invisible light index measurement value of the current environment is calculated based on the two actual light index measurement data.

2. The invisible light index monitoring method according to claim 1, characterized in that: The step of reading the light index measurement data measured by two target sensors on the lens side includes: Based on the strategy of the farthest plane distance, two sensors located on the same plane and the farthest from each other are randomly selected from the AR device as target sensors; The light data of the light passing through the lens is measured by the two target sensors, and corresponding light index measurement data is calculated based on the light data.

3. The invisible light index monitoring method according to claim 2, characterized in that: The plane is perpendicular to the field of view of the AR device.

4. The invisible light index monitoring method according to claim 1, characterized in that: The step of determining the compensation coefficients of the two target sensors and compensating the corresponding light index measurement data based on the compensation coefficients to obtain the corresponding actual light index measurement data includes: Determining attribute information of the two target sensors, and extracting compensation coefficients corresponding to the two target sensors from a preset invisible light compensation coefficient relationship library based on the attribute information; The light index measurement data is multiplied by the corresponding compensation coefficient to obtain actual light index measurement data of the two target sensors for the current environment.

5. The invisible light index monitoring method according to claim 1, characterized in that: The step of calculating the invisible light index measurement value of the current environment based on the two actual light index measurement data comprises: The difference between the two actual light index measurement data is calculated to obtain the invisible light index measurement value of the current environment.

6. The invisible light index monitoring method according to any one of claims 1 to 5, characterized in that: After the step of calculating the invisible light index measurement value of the current environment based on the two actual light index measurement data, the method further includes: A corresponding index prompt level is determined based on the invisible light index measurement value, and a prompt is given on the AR device.

7. The invisible light index monitoring method according to claim 6, characterized in that: The invisible light index measurement value includes the invisible light wavelength and the invisible light intensity. The step of determining the corresponding index prompt level based on the invisible light index measurement value and providing prompt data on the AR device includes: Determine a corresponding invisible light index grading table based on the invisible light wavelength; The invisible light intensity is matched with each prompt level range in the invisible light index grading table, and a prompt interface is generated based on the matching result and displayed on the AR device.

8. The invisible light index monitoring method according to claim 6, characterized in that: Before the step of reading the light index measurement data measured by the two target sensors on the lens side, the method further includes: Testing each sensor on the AR device based on different scenes and different light sources to obtain measurement data of each sensor under different scenes and different light sources; The invisible light compensation coefficient of the sensor is calculated based on each of the measurement data and the corresponding actual light data, and a relationship library is constructed.

9. The invisible light index monitoring method according to claim 8, characterized in that: After the step of calculating the invisible light compensation coefficient of the sensor based on each of the measurement data and the corresponding actual light data, the method further includes: Regression calculation is performed on the invisible light compensation coefficient of the sensor under different scenes and different light sources to obtain a common invisible light compensation coefficient that satisfies different scenes and different light sources.

10. An invisible light index monitoring device, applied to AR equipment, characterized in that: The AR device includes at least two sensors, and lenses with different transmittances are arranged in front of each sensor. The device includes: A reading module, used for reading the light index measurement data measured by two target sensors on the lens side; A compensation module, used to determine compensation coefficients of the two target sensors, and compensate corresponding light index measurement data based on the compensation coefficients to obtain corresponding actual light index measurement data; A calculation module is used to calculate the invisible light index measurement value of the current environment based on the two actual light index measurement data.

11. An AR device, characterized in that: It comprises a processor and a memory, wherein the memory stores machine executable instructions that can be executed by the processor, and the processor executes the machine executable instructions to implement the invisible light index monitoring method according to any one of claims 1 to 9.

12. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores machine-executable instructions, and when the machine-executable instructions are called and executed by the processor, the machine-executable instructions prompt the processor to implement the invisible light index monitoring method according to any one of claims 1 to 9.