Optical signal processing system for calibration of head-mounted display device

Abstract

An optical signal processing system for calibration of a head-mounted display device, relating to the technical field of virtual reality. The optical signal processing system for calibration of a head-mounted display device comprises: an optical signal receiving unit, configured to receive an optical signal sent by a head-mounted display device to be calibrated; an optical signal transmission unit, connected to the optical signal receiving unit and configured to effectively transmit the received optical signal; and an optical signal detection unit, connected to the optical signal transmission unit and configured to detect the transmitted optical signal and generate a quantitative characterization value.

Description

Optical signal processing system for head-mounted device calibration

[0001] Cross-reference to Related Applications

[0002] The present application is based on the Chinese patent application No. 202410703882.1, filed on May 31, 2024, and claims the priority of the Chinese patent application No. 202410703882.1, the whole content of which is incorporated herein by reference. TECHNICAL FIELD

[0003] The present application relates to the field of virtual reality technology, in particular to an optical signal processing system for head-mounted device calibration. BACKGROUND

[0004] With the development of virtual extended reality technology, head-mounted devices are increasingly widely used in people's daily life. In the related art, when calibrating a head-mounted device, the head-mounted device is mainly calibrated by a person wearing the head-mounted device, which may cause discomfort to the wearer and affect the user experience and calibration effect. SUMMARY

[0005] The present application aims to at least solve one of the technical problems in the related art. To this end, the present application provides an optical signal processing system for head-mounted device calibration, which optimizes optical transmission, reduces light loss and scattering, improves user experience, and improves calibration efficiency, accuracy and precision of calibration results.

[0006] In a first aspect, the present application provides an optical signal processing system for head-mounted device calibration, comprising:

[0007] an optical signal receiving unit configured to receive optical signals emitted by a head-mounted device to be calibrated;

[0008] an optical signal transmission unit connected to the optical signal receiving unit and configured to effectively transmit the received optical signals;

[0009] an optical signal detection unit connected to the optical signal transmission unit and configured to detect the transmitted optical signals and generate quantized representation values.

[0010] The optical signal processing system for head-mounted device calibration provided by the embodiments of the present application achieves effective transmission of optical signals by providing an optical signal transmission unit to transmit optical signals emitted by a head-mounted device to be calibrated, reduces the loss of optical signals during transmission, and enables more optical signals to reach the optical signal detection unit, thereby enabling calibration of the head-mounted device to be calibrated based on the quantized representation values generated by the optical signal detection unit.

[0011] The light signal processing system for head-mounted device calibration in one embodiment of the present application, the light signal transmission unit includes a reflecting surface, for reflecting the light signal to the light signal detection unit.

[0012] The light signal processing system for head-mounted device calibration in one embodiment of the present application, the light signal transmission unit includes a reflecting channel, the reflecting surface is arranged on the inner wall of the reflecting channel, and the exit end of the reflecting channel is directed to the light signal detection unit.

[0013] The light signal processing system for head-mounted device calibration in one embodiment of the present application, the reflecting channel is used to totally reflect the light signal to the light signal detection unit.

[0014] The light signal processing system for head-mounted device calibration in one embodiment of the present application, the light signal transmission unit includes a filtering device, the filtering device is arranged before the light signal detection unit, and is used to transmit the light signal of a target wavelength to the light signal detection unit.

[0015] The light signal processing system for head-mounted device calibration in one embodiment of the present application, the light signal detection unit includes an image sensor or a photoelectric sensor.

[0016] The light signal processing system for head-mounted device calibration in one embodiment of the present application, further includes at least one condenser, the at least one condenser is arranged between the head-mounted device to be calibrated and the light signal detection unit, and is used to enhance the intensity of the light signal.

[0017] The light signal processing system for head-mounted device calibration in one embodiment of the present application, the at least one condenser is arranged based on at least one of the following ways:

[0018] Between the light signal transmission unit and the light signal detection unit;

[0019] Between the light signal receiving unit and the head-mounted device to be calibrated;

[0020] In the light signal receiving unit.

[0021] In a second aspect, the present application provides a head-mounted device calibration system, comprising:

[0022] A light signal receiving unit, for receiving the light signal emitted by the head-mounted device to be calibrated;

[0023] A light signal transmission unit, connected with the light signal receiving unit, for effectively transmitting the received light signal;

[0024] A light signal detection unit, connected with the light signal transmission unit, for detecting the transmitted light signal and generating a quantitative characterization value.

[0025] The control unit, connected to the optical signal detection unit, is used to control the position or angle of the optical signal receiving unit based on the quantized characterization value, so as to achieve the calibration of the head-mounted display device.

[0026] According to the head-mounted display calibration system provided in the embodiments of this application, the control unit analyzes and processes the quantitative characterization value generated by the optical signal detection unit, and can calibrate the head-mounted display device to be calibrated based on the analysis results, thereby improving the accuracy and precision of the calibration.

[0027] According to one embodiment of the head-mounted display device calibration system of this application, the control unit further includes a storage module and a processing module for storing and processing the quantization characterization values, wherein the storage module is disposed between the optical signal detection unit and the processing module.

[0028] Thirdly, this application provides an optical signal processing apparatus for calibrating a head-mounted display device, comprising:

[0029] Simulated eyeballs are used to receive light signals emitted by the head-mounted display device to be calibrated.

[0030] A guiding mechanism, in conjunction with the simulated eyeball, transmits the light signal received by the simulated eyeball backward;

[0031] A photosensitive device, located at the rear end of the guidance mechanism, generates a quantized value of the luminous flux of the light signal guided and transmitted by the guidance mechanism for use in head-mounted display device calibration.

[0032] According to the optical signal processing device for head-mounted display device calibration provided in the embodiments of this application, by setting a guiding mechanism in the simulated eyeball, the optical signal can be transmitted to the photosensitive device more effectively and accurately through the guidance of the guiding mechanism, thereby optimizing the optical path transmission, reducing light loss and scattering, and generating a quantitative characterization value of luminous flux through the photosensitive device. The head-mounted display device can be calibrated based on the quantitative characterization value, which improves the user experience, calibration efficiency, and the accuracy and precision of the calibration results.

[0033] One embodiment of this application provides an optical signal processing apparatus for calibrating a head-mounted display device, wherein the guiding mechanism guides and transmits the optical signal using a reflection method.

[0034] One embodiment of this application provides an optical signal processing apparatus for calibrating a head-mounted display device, wherein the guiding mechanism uses total internal reflection to guide and transmit the optical signal.

[0035] One embodiment of this application provides an optical signal processing apparatus for calibrating a head-mounted display device, wherein the guiding mechanism utilizes wavelength selectivity to guide and transmit optical signals.

[0036] One embodiment of this application provides an optical signal processing device for calibrating a head-mounted display device. The simulated eyeball has a reflection channel, and the inner wall of the reflection channel is a reflective layer that guides and transmits the optical signal received by the simulated eyeball through reflection. The guiding mechanism includes the reflection channel.

[0037] One embodiment of this application provides an optical signal processing apparatus for calibrating a head-mounted display device, wherein the guidance mechanism includes an optical fiber connected to the simulated eyeball to transmit the optical signal received by the simulated eyeball.

[0038] One embodiment of this application provides an optical signal processing apparatus for calibrating a head-mounted display device, wherein the emitting end of the optical fiber is fixed in a relative position to the photosensitive device.

[0039] An embodiment of the optical signal processing apparatus for head-mounted display device calibration further includes a reflector disposed between the optical fiber and the photosensitive device to guide the optical signal guided by the optical fiber to the photosensitive device after reflection.

[0040] One embodiment of this application provides an optical signal processing device for calibrating a head-mounted display device, wherein the reflector is a cylindrical structure and the inner wall of the reflector is made of reflective material.

[0041] One embodiment of this application provides an optical signal processing apparatus for calibrating a head-mounted display device, wherein the cross-sectional sizes at both ends of the reflective device are different.

[0042] An embodiment of the optical signal processing apparatus for calibrating a head-mounted display device further includes a first condenser lens, which is disposed between the emitting end of the guiding mechanism and the photosensitive device to improve the intensity of the optical signal.

[0043] One embodiment of this application provides an optical signal processing apparatus for calibrating a head-mounted display device, wherein the principal plane of the first condenser lens is perpendicular to the emission direction of the guiding mechanism.

[0044] An embodiment of the optical signal processing apparatus for calibrating a head-mounted display device according to this application further includes a second condenser lens, which is disposed between the simulated eyeball and the head-mounted display device to be calibrated to increase the intensity of the optical signal.

[0045] One embodiment of this application provides an optical signal processing apparatus for calibrating a head-mounted display device, wherein the principal plane of the second condenser lens is perpendicular to the incident direction of the guiding mechanism.

[0046] One embodiment of the optical signal processing apparatus for calibrating a head-mounted display device further includes a third condenser lens disposed within the simulated eyeball to enhance the intensity of the optical signal.

[0047] One embodiment of this application provides an optical signal processing apparatus for calibrating a head-mounted display device, wherein the principal plane of the third condenser lens is perpendicular to the incident direction of the guiding mechanism.

[0048] One embodiment of this application provides an optical signal processing apparatus for calibrating a head-mounted display device, wherein the photosensitive device includes an image sensor or a photoelectric sensor.

[0049] An embodiment of the optical signal processing apparatus for head-mounted display device calibration in this application further includes a screen disposed between the guide mechanism and the photosensitive device, wherein the area of ​​the screen is larger than the projection area of ​​the optical signal on the plane of the screen.

[0050] One embodiment of this application provides an optical signal processing apparatus for calibrating a head-mounted display device, wherein the simulated eyeball is rotatable.

[0051] One embodiment of this application provides an optical signal processing apparatus for calibrating a head-mounted display device, wherein, when the guidance mechanism includes an optical fiber, the input end of the optical fiber is placed inside the simulated eyeball and can rotate synchronously with the simulated eyeball.

[0052] One embodiment of this application provides an optical signal processing apparatus for calibrating a head-mounted display device, wherein the photosensitive device can rotate synchronously with the simulated eyeball.

[0053] Fourthly, this application provides a head-mounted display device calibration apparatus, comprising:

[0054] Simulated eyeballs are used to receive light signals emitted by the head-mounted display device to be calibrated.

[0055] A guiding mechanism, in conjunction with the simulated eyeball, transmits the light signal received by the simulated eyeball backward;

[0056] A photosensitive device, located at the rear end of the guidance mechanism, generates a quantitative representation value of the light flux of the light signal guided and transmitted by the guidance mechanism for use in head-mounted display device calibration.

[0057] A control device is connected to both the simulated eyeball and the photosensitive device. The control device controls the rotation of the simulated eyeball based on the quantized value of the light flux transmitted by the photosensitive device, so as to calibrate the head-mounted display device to be calibrated.

[0058] According to the head-mounted display device calibration apparatus provided in the embodiments of this application, the control device analyzes and processes the quantitative characterization values ​​generated by the photosensitive device, and can calibrate the head-mounted display device to be calibrated based on the analysis results, thereby improving the accuracy and precision of the calibration.

[0059] The above-described one or more technical solutions in the embodiments of this application have at least one of the following technical effects:

[0060] By setting a guidance mechanism inside the simulated eyeball, the light signal can be transmitted to the photosensitive device more effectively and accurately through the guidance mechanism. This optimizes the light path transmission, reduces light loss and scattering, and generates a quantitative characterization value of the light flux through the photosensitive device. The head-mounted display device can be calibrated based on the quantitative characterization value. This not only improves the user experience but also increases calibration efficiency and the accuracy and precision of the calibration results.

[0061] Furthermore, by setting a first condenser lens between the output end of the guide mechanism and the photosensitive device, the intensity of the light signal emitted through the guide mechanism can be enhanced, thereby improving the signal-to-noise ratio of the light signal collected by the photosensitive device and improving the final calibration accuracy.

[0062] Furthermore, by placing a second condenser between the simulated eyeball and the head-mounted display device to be calibrated, or by placing a third condenser inside the simulated eyeball, more light signals generated by the head-mounted display device to be calibrated can be collected into the guidance mechanism, thereby improving the intensity and signal-to-noise ratio of the light signals collected by the photosensitive device.

[0063] Furthermore, by keeping the emitting end of the optical fiber fixed relative to the photosensitive device, even when simulating eye movement, the emitted light beam from the emitting end of the optical fiber can still reach the photosensitive device. This eliminates the need for image sensors with a large field of view or photoelectric sensors with a large photosensitive area, thus reducing costs.

[0064] Additional aspects and advantages of this application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of this application. Attached Figure Description

[0065] The above and / or additional aspects and advantages of this application will become apparent and readily understood from the description of the embodiments taken in conjunction with the following drawings, in which:

[0066] Figure 1 is a schematic diagram of one of the optical signal processing devices for head-mounted display device calibration provided in an embodiment of this application;

[0067] Figure 2 is a second schematic diagram of the optical signal processing device for head-mounted display device calibration provided in an embodiment of this application;

[0068] Figure 3 is a third schematic diagram of the optical signal processing device for head-mounted display device calibration provided in an embodiment of this application;

[0069] Figure 4 is a fourth structural schematic diagram of the optical signal processing device for head-mounted display device calibration provided in the embodiments of this application;

[0070] Figure 5 is a fifth schematic diagram of the optical signal processing device for head-mounted display device calibration provided in the embodiments of this application;

[0071] Figure 6 is a schematic diagram of the optical signal processing device for head-mounted display device calibration provided in an embodiment of this application;

[0072] Figure 7 is a seventh structural schematic diagram of the optical signal processing device for head-mounted display device calibration provided in the embodiments of this application;

[0073] Figure 8 is a schematic diagram of the optical signal processing device for head-mounted display device calibration provided in an embodiment of this application.

[0074] Figure 9 is a schematic diagram of the optical signal processing device for head-mounted display device calibration provided in an embodiment of this application.

[0075] Figure 10 is a schematic diagram of the optical signal processing device for head-mounted display device calibration provided in an embodiment of this application.

[0076] Figure 11 is an eleventh schematic diagram of the optical signal processing device for head-mounted display device calibration provided in an embodiment of this application;

[0077] Figure 12 is a schematic diagram of the optical signal processing device for head-mounted display device calibration provided in an embodiment of this application;

[0078] Figure 13 is a schematic diagram of the optical signal processing device for head-mounted display device calibration provided in an embodiment of this application.

[0079] Figure 14 is a schematic diagram of the optical signal processing device for head-mounted display device calibration provided in an embodiment of this application;

[0080] Figure 15 is a schematic diagram of the optical signal processing device for head-mounted display device calibration provided in an embodiment of this application;

[0081] Figure 16 is a schematic diagram of the optical signal processing device for head-mounted display device calibration provided in the embodiments of this application.

[0082] Reference numerals: Simulated eyeball 110; Simulated pupil 120; Guiding mechanism 130; Photosensitive device 140; First condenser lens 150; Screen 160; Reflector 170; Reflection channel 180; Second condenser lens 190; Third condenser lens 200; Head-mounted display device to be calibrated 210. Detailed Implementation

[0083] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0084] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0085] 1. In the description of this application, it should be understood that the terms "upper", "lower", "front", "rear", "left", "right", "inner", "outer", etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are only for the convenience of describing this application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on this application.

[0086] 2. In the description of this application, "multiple" means two or more.

[0087] This application provides an optical signal processing system for head-mounted display device calibration, including: an optical signal receiving unit, an optical signal transmission unit, and an optical signal detection unit.

[0088] In this embodiment, the optical signal receiving unit is used to receive the optical signal emitted by the head-mounted display device to be calibrated.

[0089] The optical signal transmission unit is connected to the optical signal receiving unit to effectively transmit the received optical signal.

[0090] Optical signal transmission units may include materials or structures that have the functions of transmitting light and / or guiding light paths, such as optical fibers, optical waveguides, optical crystals, and light-transmitting channels.

[0091] In some embodiments, the optical signal transmission unit may use reflection to guide and transmit the optical signal, and the reflection may be total internal reflection; of course, the optical signal transmission unit may also use wavelength selectivity to guide and transmit the optical signal.

[0092] In some embodiments, the optical signal transmission unit may include a reflective surface.

[0093] In this embodiment, the reflective surface can be a high-reflectivity film, a reflective mirror, or a surface formed of other reflective materials.

[0094] For example, an optical signal transmission unit may include an optical fiber, which includes a cladding that can provide a reflective surface for the transmission of optical signals.

[0095] The reflective surface can reflect the light signal to the light signal detection unit.

[0096] In some embodiments, the optical signal transmission unit may include a reflection channel.

[0097] In this embodiment, the inner wall of the reflection channel can be a reflective surface. For example, the inner wall of the reflection channel can be plated with reflective materials such as aluminum or silver.

[0098] The exit end of the reflection channel faces the optical signal detection unit so as to reflect the optical signal to the optical signal detection unit.

[0099] Reflective surfaces or reflective channels can enable efficient transmission of optical signals, thereby improving the transmission efficiency of optical signals.

[0100] In some embodiments, the optical signal transmission unit may include a filtering device.

[0101] In this embodiment, the filtering device is disposed before the optical signal detection unit. For example, the filtering device may be disposed at the tail end of the optical signal transmission unit, or at the front end of the optical signal transmission unit, or at other locations. This application does not limit the location.

[0102] The filtering device is used to transmit the optical signal of the target wavelength to the optical signal detection unit and block the transmission of optical signals of other wavelengths.

[0103] The optical signal detection unit is connected to the optical signal transmission unit and is used to detect the transmitted optical signal and generate a quantized characterization value. This quantized characterization value is used to measure the amount of light received by the optical signal receiving unit.

[0104] In some embodiments, the light signal detection unit may include an image sensor or a photoelectric sensor. An image sensor is used to convert light signals into digital image or video signals. In this embodiment, the image sensor may include a camera, etc. A photoelectric sensor can convert light signals into electrical signals.

[0105] According to the optical signal processing system for head-mounted display device calibration provided in the embodiments of this application, by setting up an optical signal transmission unit to transmit the optical signal emitted by the head-mounted display device to be calibrated, the optical signal is effectively transmitted, the loss of the optical signal during transmission is reduced, and more optical signal reaches the optical signal detection unit, thereby enabling the head-mounted display device to be calibrated to be calibrated based on the quantitative characterization value generated by the optical signal detection unit.

[0106] In some embodiments, the optical signal processing system for head-mounted display device calibration may further include at least one condenser lens.

[0107] In this embodiment, at least one condenser lens is disposed between the head-mounted display device to be calibrated and the optical signal detection unit.

[0108] In some embodiments, the condenser lens may be located between the optical signal receiving unit and the head-mounted display device to be calibrated; in some embodiments, the condenser lens may be part of the optical signal receiving unit; in some embodiments, the condenser lens may be disposed between the optical signal transmission unit and the optical signal detection unit. Specific arrangements vary and will not be listed here, but ultimately, by setting up the condenser lens, it can be used to enhance the intensity of the optical signal.

[0109] This application provides a head-mounted display device calibration system, including: an optical signal receiving unit, an optical signal transmission unit, an optical signal detection unit, and a control unit.

[0110] In this embodiment, the control unit is connected to the optical signal detection unit and is used to control the position or angle of the optical signal receiving unit based on the quantized characterization value in order to achieve calibration of the head-mounted display device.

[0111] In some embodiments, the control unit may include a storage module and a processing module.

[0112] In this embodiment, the storage module can be located between the optical signal detection unit and the processing module.

[0113] The storage module stores the quantized values ​​output by the optical signal detection unit. The processing module analyzes and processes these quantized values.

[0114] According to the head-mounted display calibration system provided in the embodiments of this application, the control unit analyzes and processes the quantitative characterization value generated by the optical signal detection unit, and can calibrate the head-mounted display device to be calibrated based on the analysis results, thereby improving the accuracy and precision of the calibration.

[0115] As shown in Figures 1 and 15, this application provides an optical signal processing device for head-mounted display device calibration. The optical signal processing device for head-mounted display device calibration includes: a simulated eyeball 110, a guidance mechanism, and a photosensitive device 140.

[0116] In this embodiment, the simulated eyeball 110 is used to receive the light signal emitted by the head-mounted display device 210 to be calibrated. Figure 16 illustrates a side view of a head-mounted display device calibration system, where the head-mounted display device 210 to be calibrated can be an XR or other head-mounted display device.

[0117] In this embodiment, a simulated eyeball 110, a guidance mechanism 130, and a photosensitive device 140 are used to simulate a human eye. The simulated eyeball 110 is positioned in front of the screen of the head-mounted display device 210 to be calibrated. In some embodiments, the simulated eyeball 110 includes a simulated pupil 120. The simulated pupil 120 is located inside the simulated eyeball 110 and close to the screen.

[0118] In some embodiments, the simulated pupil 120 may be made of a transparent material, such as polycarbonate or polyethylene, which are light-transmitting materials. Alternatively, the simulated pupil 120 may be made of a non-transparent material, such as metal or rubber, which are opaque materials.

[0119] In some embodiments, different guide mechanisms 130 may be set based on the material used to make the simulated pupil 120.

[0120] In some embodiments, the guiding mechanism 130 can guide and transmit the optical signal using a reflection method. For example, in some embodiments, a reflective surface, such as a mirror or a reflector made of a special material, can be provided along the path of the guiding mechanism 130. When the optical signal shines on the reflective surface, the optical signal can change direction according to the law of reflection, thereby propagating along a predetermined path.

[0121] In some embodiments, a reflection channel 180 may be provided inside the simulated eyeball 110.

[0122] In this embodiment, the inner wall of the reflection channel 180 is a reflective layer that can guide and transmit the light signal received by the simulated eyeball 110 through reflection. In this case, the guidance mechanism 130 may include the reflection channel 180.

[0123] As shown in Figure 11, when the simulated pupil 120 is made of a transparent material and can transmit light, the reflection channel 180 can be set behind the simulated pupil 120. For example, inside the simulated eyeball 110, a channel is cut out from the rear end of the simulated pupil 120 toward the photosensitive device 140 to form the reflection channel 180, and a reflective material is provided on the inner wall of the reflection channel 180 to form the guide mechanism 130.

[0124] When the simulated pupil 120 is made of a non-transparent material, a portion of the reflection channel 180 can be set inside the simulated pupil 120. For example, a channel can be cut out from the simulated pupil 120 toward the photosensitive device 140 to form the reflection channel 180.

[0125] The inner wall of the reflection channel 180 can be coated with a high-reflection film. For example, the inner wall of the reflection channel 180 can be coated with reflective materials such as aluminum or silver.

[0126] The reflection channel 180 can be cylindrical or frustum-shaped, and can be customized by the user; this application does not impose any limitations on it.

[0127] When the reflection channel 180 is frustum-shaped, the cross section of the reflection channel 180 near the simulated pupil 120 can be larger or smaller than the cross section away from the simulated pupil 120; this application does not impose any limitation on this.

[0128] For example, when the light signal emitted by the head-mounted display device 210 to be calibrated is strong, or when the photosensitive device 140 is sensitive, the cross section of the reflection channel 180 near the simulated pupil 120 can be set to be larger than the cross section far from the simulated pupil 120.

[0129] In actual operation, the light signal emitted by the head-mounted display device 210 to be calibrated can be completely reflected to the photosensitive device 140 through the simulated eyeball 110, thereby achieving accurate measurement.

[0130] According to the optical signal processing device for head-mounted display device calibration provided in the embodiments of this application, a guide mechanism 130 is formed by setting a reflection channel 180 inside the simulated eyeball 110, which simplifies the optical path design, reduces the complexity and assembly difficulty of the system, and reduces the loss of optical signals in the optical path transmission.

[0131] The guiding mechanism 130 can cooperate with the simulated eyeball 110 to transmit the light signal received by the simulated eyeball 110 backward. The guiding mechanism 130 is used to guide the light path so that the light signal can be transmitted to the photosensitive device 140 via the guiding mechanism 130.

[0132] In some embodiments, the incident end of the guiding mechanism 130 faces the simulated pupil 120. In some embodiments, the guiding mechanism 130 is disposed between the photosensitive device 140 and the simulated pupil 120. In some embodiments, the exit end of the guiding mechanism 130 faces the photosensitive device 140.

[0133] In some embodiments, the guiding mechanism 130 may include materials or mechanisms that have the functions of transmitting light and / or guiding light paths, such as optical fibers, optical waveguides, optical crystals, and light-transmitting channels.

[0134] As shown in Figure 11, in some embodiments, the guiding mechanism 130 can guide and transmit the light signal using total internal reflection. In this embodiment, the light signal can be totally internally reflected by the guiding mechanism 130 to the photosensitive device 140 via the simulated eyeball 110.

[0135] In some embodiments, the guiding mechanism 130 can utilize wavelength selectivity to guide the transmission of optical signals.

[0136] In this embodiment, the guiding mechanism 130 can selectively transmit or reflect optical signals of a specific wavelength. For example, the guiding mechanism 130 may include a filter, etc. The filter may include a light filter, a prism, or a dichroic mirror, etc.

[0137] Filters can selectively transmit, refract, or reflect light signals of specific wavelengths while blocking light signals of other wavelengths. Their wavelength selectivity can be controlled by adjusting the filter's structure and materials. For example, prisms utilize the different refractive indices of different wavelengths of light in a medium, causing light of different wavelengths to be deflected at different angles after passing through the prism. Dichroic mirrors can transmit light signals of specific wavelengths while reflecting light signals of other wavelengths.

[0138] The head-mounted display device 210 to be calibrated can emit light signals of different wavelengths. For example, the head-mounted display device 210 to be calibrated can emit red light, blue light or other wavelengths of light, which is not limited in this application.

[0139] When the head-mounted display device 210 to be calibrated emits light signals of different wavelengths, the guidance mechanism 130 can guide and transmit the light signals according to the wavelength selectivity characteristics.

[0140] As shown in Figure 14, the launch end of the guidance mechanism 130 is provided with a detection surface.

[0141] For example, if the guidance mechanism 130 includes an optical fiber, the detection surface can capture the optical signal emitted from the optical fiber, ensuring that the optical signal can be effectively received and further processed.

[0142] In some embodiments, the simulated eyeball 110 is rotatable. Referring again to FIG14, in this embodiment, when the simulated eyeball 110 rotates, the projection area of ​​the light beam emitted through the guide mechanism 130 on the detection surface is also different.

[0143] As shown in Figure 1, in some embodiments, the guidance mechanism 130 may include an optical fiber connected to the simulated eyeball 110 to transmit the optical signals received by the simulated eyeball 110.

[0144] In this embodiment, the optical fiber may include a high-refractive-index core and a low-refractive-index cladding.

[0145] The core of the optical fiber can be silicon dioxide (SiO2) or a similar material, and the cladding of the optical fiber can be a fluorinated polymer, etc.

[0146] As shown in Figure 14, the light beam emitted by the head-mounted display device 210 to be calibrated, which meets the transmission conditions, can enter the input end of the optical fiber, be transmitted through the optical fiber to the output end of the optical fiber, and then reach the detection surface.

[0147] According to the head-mounted display device calibration system provided in the embodiments of this application, by setting the guide mechanism 130 as an optical fiber, the emission direction of the optical fiber can be flexibly adjusted and controlled to adapt to different optical requirements, thereby improving the flexibility and controllability of the guide mechanism 130; and the optical fiber has low optical loss, thereby reducing light loss and scattering by guiding the optical signal through the optical fiber.

[0148] In some embodiments, when the simulated eyeball 110 is rotatable, the input end of the optical fiber can be placed inside the simulated eyeball 110 and can rotate synchronously with the simulated eyeball 110.

[0149] In this embodiment, when the simulated eyeball 110 rotates, the input end of the optical fiber can rotate synchronously with the rotation of the simulated eyeball 110, so that the light signal emitted by the head-mounted display device 210 to be calibrated can still enter the optical fiber input end, thereby transmitting the light signal backward.

[0150] As shown in Figure 7, in some embodiments, the emitting end of the optical fiber is kept in a fixed relative position to the photosensitive device 140.

[0151] In this embodiment, the emitting end of the optical fiber can be fixed by an external structure so that the emitting direction of the optical fiber always points in the direction of the photosensitive device 140.

[0152] As shown in Figure 8, by fixing the output end of the optical fiber, when the simulated eyeball 110 rotates, it can be ensured that the output beam through the output end of the optical fiber can still reach the photosensitive device 140 and form a light spot on the photosensitive device 140.

[0153] In some embodiments, when the photosensitive device 140 rotates synchronously with the simulated eyeball 110, the fixed position of the emitting end of the optical fiber can be adjusted so that the emitting end of the optical fiber and the photosensitive device 140 maintain a fixed relative position.

[0154] In this application, by setting the output end of the optical fiber to maintain a fixed relative position with the photosensitive device 140, even when the simulated eyeball 110 rotates, the output beam from the optical fiber can still reach the photosensitive device 140. This eliminates the need for an image sensor with a large field of view or a photoelectric sensor with a large photosensitive area, thus reducing costs.

[0155] In the embodiments of this application, the photosensitive device 140 is located at the rear end of the guiding mechanism 130. The photosensitive device 140 is used to generate a quantitative characterization value of the luminous flux of the light signal guided and transmitted by the guiding mechanism 130. The quantitative characterization value of the luminous flux is used to measure the amount of light entering the simulated eyeball 110.

[0156] As shown in Figure 3, the photosensitive area of ​​the photosensitive device 140 can cover all areas of the detection surface corresponding to the beam emitted by the guide mechanism 130 within the entire range of rotation of the simulated eyeball 110.

[0157] As shown in Figure 4, when the rotation angle of the simulated eyeball 110 reaches the maximum rotation angle, the photosensitive device 140 can also collect the light signal from the output end of the guide mechanism 130.

[0158] In embodiments of this application, the photosensitive device 140 may be fixed in place. In some embodiments, the photosensitive device 140 may be connected to a simulated eyeball 110 so that the photosensitive device 140 rotates synchronously with the simulated eyeball 110, thereby maximizing lossless transmission of light signals.

[0159] In some embodiments, the photosensitive device 140 includes an image sensor or a photoelectric sensor. An image sensor is used to convert light signals into digital image or video signals. A photoelectric sensor can convert light signals into electrical signals.

[0160] Image sensors can include cameras, etc. Photoelectric sensors can include photodiodes (PDs), avalanche photodiodes (APDs), or photomultiplier tubes (PMTs), etc. Among these, photodiodes (photosensitive diodes or photodiodes) are semiconductor devices.

[0161] The working principle of a photodiode is the photoelectric effect: when light shines on the surface of the photodiode, it excites charge carriers (electrons and holes) in the semiconductor material, generating a photocurrent. The magnitude of the photocurrent is proportional to the intensity of the light shining on the photodiode, allowing the photodiode to detect changes in light intensity.

[0162] In actual execution, after the image sensor set behind the simulated eyeball 110 completes the exposure and focus parameter settings, it captures the light signal emitted by the head-mounted display device 210 to be calibrated and imaged by the optical components, obtains the quantized characterization value of the light flux, and transmits the quantized characterization value of the light flux to the control unit, which then performs subsequent image processing.

[0163] It is understandable that different photosensitive devices 140 may have different quantitative representations of their luminous flux.

[0164] For example, for image sensors, the brightness of the image acquired by the image sensor can be used as a standard to measure luminous flux, that is, the quantization value is determined as the average brightness of the region in the image.

[0165] For example, for photoelectric sensors, the electrical signal they generate can be used as a standard for measuring luminous flux, that is, the quantized characterization value is determined as the magnitude of the electrical signal.

[0166] Of course, in other embodiments, the quantification value can also be expressed in other forms, which will not be elaborated here.

[0167] It should be noted that the light signals guided by the simulated eyeball 110 at different angles may vary, and the quantitative representation value of the light flux may also change accordingly.

[0168] It should be noted that, as shown in Figure 1, the dashed line represents a schematic incident light beam emitted by the head-mounted display device 210 to be calibrated, which can enter the guidance mechanism 130 and be successfully transmitted to the detection surface, and analyzed by the photosensitive device 140. The light beam shown in the figure is the light beam that meets the transmission conditions of the guidance mechanism 130.

[0169] According to the optical signal processing device for head-mounted display device calibration provided in the embodiments of this application, by setting a guiding mechanism 130 in the simulated eyeball 110, the optical signal can be transmitted to the photosensitive device 140 more effectively and accurately through the guidance of the guiding mechanism 130, thereby optimizing the optical path transmission, reducing light loss and scattering, and generating a quantitative characterization value of luminous flux through the photosensitive device 140. The head-mounted display device can be calibrated based on the quantitative characterization value, which improves the user experience, calibration efficiency, and the accuracy and precision of the calibration results.

[0170] As shown in Figure 5, in some embodiments, the optical signal processing device for head-mounted display device calibration may further include a first condenser lens 150. In this embodiment, the first condenser lens 150 is disposed between the emitting end of the guiding mechanism 130 and the photosensitive device 140. The optical signal can reach the first condenser lens 150 via the emitting end of the guiding mechanism 130.

[0171] The emission direction of the guiding mechanism 130 can be set to be perpendicular to the principal plane of the first condenser lens 150, meaning the first condenser lens 150 always remains coaxial with the emission end of the guiding mechanism 130. This ensures that even when the guiding mechanism 130 changes position as the simulated eyeball 110 rotates, the light signal can still be converged to the first condenser lens 150 via the guiding mechanism 130. The principal plane is the plane perpendicular to the optical axis corresponding to the condenser lens.

[0172] The light signal can form a strong light spot on the detection surface through the first condenser lens 150, and the light-sensing device 140 can collect the light spot.

[0173] The photosensitive area of ​​the photosensitive device 140 needs to cover all areas of the detection surface corresponding to the beam emitted by the guide mechanism 130 within the entire rotation range of the simulated eyeball 110.

[0174] As shown in Figure 6, when simulating the rotation of the eyeball 110, the position of the first condenser lens 150 can change with the emission direction of the emission end of the guide mechanism 130, that is, the first condenser lens 150 and the emission end of the guide mechanism 130 need to be kept coaxial.

[0175] In actual execution, the first condenser lens 150 can be fused at the tail end of the guide mechanism 130, or the first condenser lens 150 can be fixed by an external structure. This can be based on user customization and is not limited in this application.

[0176] According to the optical signal processing device for head-mounted display device calibration provided in the embodiments of this application, by setting a first condenser lens 150 between the emitting end of the guide mechanism 130 and the photosensitive device 140, the intensity of the optical signal emitted through the guide mechanism 130 can be enhanced, thereby improving the signal-to-noise ratio of the optical signal collected by the photosensitive device 140 and improving the final calibration accuracy.

[0177] As shown in Figure 12, in some embodiments, the optical signal processing device for head-mounted display calibration may further include a second condenser lens 190. In this embodiment, the second condenser lens 190 may be disposed between the simulated eyeball 110 and the head-mounted display device 210 to be calibrated. The optical signal emitted by the head-mounted display device 210 to be calibrated can reach the guidance mechanism 130 via the second condenser lens 190.

[0178] The main plane of the second condenser lens 190 can be set to be perpendicular to the incident direction of the guide mechanism 130, that is, the incident port of the guide mechanism 130 is coaxial with the second condenser lens 190. When the simulated eyeball 110 rotates, the relative position between the second condenser lens 190 and the incident port of the guide mechanism 130 does not shift or tilt, and the light signal can also reach the guide mechanism 130 through the second condenser lens 190.

[0179] As shown in Figure 13, in some embodiments, the optical signal processing device for calibrating the head-mounted display device may further include a third condenser lens 200. In this embodiment, the third condenser lens 200 may be disposed within the simulated eyeball 110. For example, a simulated pupil 120 may be disposed within the simulated pupil 120. The optical signal emitted by the head-mounted display device 210 to be calibrated can reach the guiding mechanism 130 via the third condenser lens 200.

[0180] The main plane of the third condenser lens 200 can be set to be perpendicular to the incident direction of the guide mechanism 130, that is, the incident port of the guide mechanism 130 is coaxial with the third condenser lens 200. When the simulated eyeball 110 rotates, the relative position between the third condenser lens 200 and the incident port of the guide mechanism 130 does not shift or tilt, and the light signal can also reach the guide mechanism 130 through the third condenser lens 200.

[0181] According to the optical signal processing device for head-mounted display device calibration provided in the embodiments of this application, by setting a second condenser lens 190 between the simulated eyeball 110 and the head-mounted display device 210 to be calibrated, or by setting a third condenser lens 200 in the simulated eyeball 110, more optical signals generated by the head-mounted display device 210 to be calibrated can be collected into the guiding mechanism 130, thereby improving the intensity and signal-to-noise ratio of the optical signals collected by the photosensitive device 140.

[0182] In some embodiments, as shown in FIG10, the optical signal processing apparatus for head-mounted display device calibration may further include a reflector 170. In this embodiment, the reflector 170 is disposed between the optical fiber and the photosensitive device 140.

[0183] The reflector 170 can be a cylindrical structure, for example, a reflector cup. Furthermore, the cross-sectional sizes at the two ends of the reflector 170 can be different. For example, the cross-section of the reflector 170 closer to the optical fiber can be smaller than the cross-section of the end farther from the optical fiber.

[0184] The smaller opening end of the reflector 170 is close to the optical fiber, and the larger opening end of the reflector 170 is close to the photosensitive device 140, and the direction of the light beam reflected by the reflector 170 is towards the photosensitive device 140.

[0185] The inner wall of the reflective device 170 is made of reflective material. For example, the inner wall of the reflective device 170 can be plated with reflective materials such as aluminum or silver.

[0186] In actual operation, the end of the optical fiber can be inserted into the reflector 170 so that the emitted light beam from the optical fiber can be reflected by the reflector 170 and reach the photosensitive device 140.

[0187] It should be noted that, as shown in Figures 5 and 6, when the guiding mechanism 130 is an optical fiber, a first condenser lens 150 can also be set between the emitting end of the optical fiber and the photosensitive device 140.

[0188] As shown in Figure 10, when a reflector 170 is provided between the optical fiber and the photosensitive device 140, a first condenser lens 150 can be positioned between the reflector 170 and the photosensitive device 140. Alternatively, a second condenser lens 190 can be provided between the simulated pupil 120 and the head-mounted display device 210 to be calibrated, allowing the light signal emitted by the head-mounted display device 210 to enter the optical fiber through the second condenser lens 190. Or, a third condenser lens 200 can be provided within the simulated pupil 120; this application does not limit the scope of the application.

[0189] When the guiding mechanism 130 is made of optical fiber, a first condenser 150, a reflector 170, a second condenser 190, or a third condenser 200 can be set according to user needs, and this application does not limit them.

[0190] As shown in Figure 1, in some embodiments, the optical signal processing device for head-mounted display calibration may further include a screen 160. In this embodiment, the screen 160 may be disposed between the guide mechanism 130 and the photosensitive device 140.

[0191] In some embodiments, the area of ​​the screen 160 is larger than the projection area of ​​the light signal on the plane of the screen 160. The area of ​​the screen 160 needs to cover all areas of the beam emitted from the guide mechanism 130 that are projected onto the screen 160 within the entire range of rotation of the simulated eyeball 110.

[0192] As shown in Figure 2, when the simulated eyeball 110 rotates to its maximum rotation angle, the emitted light beam can also be projected onto the screen 160.

[0193] As shown in Figure 9, in some embodiments, a first condenser lens 150 may be provided between the guide mechanism 130 and the curtain 160. As for the placement of the second condenser lens 190 and the third condenser lens 200, etc., in this embodiment, they can also be designed or selected according to the specific situation, which will not be elaborated here.

[0194] The light signal can reach the first condenser lens 150 through the output end of the guiding mechanism 130, and then form a light spot with a high signal-to-noise ratio on the screen 160 through the first condenser lens 150. The photosensitive device 140 can collect the light spot on the screen 160.

[0195] In actual execution, the light signal can be projected onto the screen 160 through the output end of the guiding mechanism 130, thereby forming a light spot on the screen 160. The photosensitive device 140 can take a picture of the light spot on the screen 160 to obtain the image to be tested, and then analyze and calculate the image to be tested to obtain the brightness corresponding to the image to be tested.

[0196] This application provides a head-mounted display (HMD) calibration device. The HMD calibration device includes an optical signal processing device and a control device as described in any of the above embodiments for HMD calibration.

[0197] In this embodiment, the control device is connected to the simulated eyeball 110 and the photosensitive device 140, respectively.

[0198] The control device can control the rotation of the simulated eyeball 110 based on the quantized characterization value of the light flux transmitted by the photosensitive device 140, so as to calibrate the head-mounted display device 210 to be calibrated.

[0199] According to the head-mounted display device calibration apparatus provided in this application embodiment, the control device analyzes and processes the quantitative characterization value generated by the photosensitive device 140, and can calibrate the head-mounted display device 210 to be calibrated based on the analysis results, thereby improving the accuracy and precision of the calibration.

[0200] In this application, a head-mounted display calibration system is set up to simulate the human eye. During the calibration process, the head-mounted display 210 to be calibrated is worn by the head-mounted display calibration system. The control unit can control the simulated eyeball 110 in the head-mounted display calibration system to rotate in the corresponding direction and angle according to the change in the amount of light entering the head-mounted display before and after the calibration system. This is repeated until the position with the maximum amount of light entering the head-mounted display is found, and this position is taken as the calibration completion point. This achieves eye-tracking calibration without the need for manual wearing and is simple and easy to operate. While improving the user experience, it also improves the calibration efficiency and the accuracy and precision of the calibration results.

[0201] This application also provides a head-mounted display device calibration method.

[0202] The calibration method for this head-mounted display includes:

[0203] S1. Control the photosensitive device to collect the light signal emitted by the head-mounted display device to be calibrated and guided by the simulated eyeball, and obtain the first quantitative characterization value of the light flux;

[0204] S2. Control the simulated eyeball to rotate until the first quantitative characterization value meets the first set condition, and then complete the center calibration. The center calibration is used to align the gaze point of the head-mounted display calibration system with the center of the screen of the head-mounted display to be calibrated.

[0205] S3. Control the simulated eye movement to track the second light source point displayed on the screen of the head-mounted display device to be calibrated, and obtain the second quantitative characterization value of the luminous flux;

[0206] S4. When the second quantitative representation value is found to meet the second set condition, control the simulated eyeball to stop rotating.

[0207] In this embodiment, the head-mounted display device calibration method can be applied to a head-mounted display device calibration system.

[0208] By simulating the eyeball and cooperating with the photosensitive device, light energy from the head-mounted display can be transmitted to the photosensitive device through the simulated eyeball with as little loss as possible, so as to facilitate subsequent rotation control. Of course, the photosensitive device can be fixed relative to the simulated eyeball, or it can be made to rotate synchronously with the simulated eyeball in order to maximize the lossless transmission of light information. That is, in some embodiments, the photosensitive device can move in response to the movement of the simulated eyeball.

[0209] The fixation point is the intersection of the line of sight of the simulated eyeball and the screen of the head-mounted display device to be calibrated, that is, the intersection of the line connecting the center of the simulated eyeball and the simulated pupil with the screen.

[0210] The first setting condition can be that the first quantitative representation value of the luminous flux reaches a large or maximum value.

[0211] The first set of conditions can be based on user-defined criteria.

[0212] If the first quantitative representation value of luminous flux meets the first set condition, it is considered that the amount of light entering the simulated eyeball in the current pose is relatively large, and can be approximately considered to have reached the maximum value.

[0213] For example, taking the image brightness as the first quantization representation of luminous flux, after the host computer receives the image, it automatically delineates the region of interest (ROI) to be analyzed, which is the part containing the complete focal point. The image is then converted to grayscale, and the average brightness within the ROI is used as the first quantization representation of the currently received luminous flux. The ROI is the area on which the first light source is most likely to be projected, determined based on the range of human eye movement.

[0214] It should be noted that the light signals guided by the simulated eyeball at different angles may vary, and the first quantitative representation value of the luminous flux may also change accordingly.

[0215] Each time the simulated eyeball rotates, the first quantitative representation value of the luminous flux corresponding to the light signal guided at the current rotation angle should be collected.

[0216] By comparing the first quantized value of the light flux collected after each rotation, when it is determined that the first quantized value of the light flux reaches its maximum after a certain rotation, it can be considered that the simulated eyeball is aligned with the center of the screen of the head-mounted display device to be calibrated. Thus, the head-mounted display device calibration system and the head-mounted display device to be calibrated are centered based on the angle corresponding to the current simulated eyeball.

[0217] After completing the central calibration, you can proceed to the eye-tracking calibration stage.

[0218] The second light source is the point to be tracked.

[0219] The second light source can be randomly displayed at any position on the screen.

[0220] The second quantitative characterization value of luminous flux is used to measure the amount of light entering the simulated eyeball. Its form of expression can be the same as that of the first quantitative characterization value, which will not be described in detail here.

[0221] In actual execution, the simulated eyeball is controlled to rotate in order to track the point to be tracked displayed on the screen. It is understandable that, with the position of the second light source point on the screen remaining unchanged, the amount of light sensed by the photosensitive device will vary depending on the position of the simulated eyeball on the screen. Moreover, the closer the gaze point of the simulated eyeball is to the position of the second light source point, the greater the amount of light sensed by the photosensitive device.

[0222] The second setting condition can be that the second quantitative representation value of luminous flux in a certain area reaches a large or maximum value.

[0223] When the second quantitative representation value of the luminous flux of the currently scanned area sensed by the photosensitive device meets the second set condition, it can be approximately assumed that the gaze point of the simulated eyeball has coincided with the second light source point, thereby controlling the simulated eyeball to stop rotating and completing eye movement calibration.

[0224] Then, another second light source point is randomly displayed on the screen to repeat S3 to S4 until eye-tracking calibration of all points to be tracked is completed.

[0225] According to the head-mounted display device calibration method provided in the embodiments of this application, by setting up a head-mounted display device calibration system for simulating the human eye, the optical components are controlled to rotate based on the change in the amount of light received before and after the head-mounted display device calibration system, so that the position where the amount of light received is larger is taken as the calibration completion point. This not only improves the user experience, but also improves the calibration efficiency and the accuracy and precision of the calibration results.

[0226] The head-mounted display device calibration apparatus provided in this application is described below. The head-mounted display device calibration apparatus described below can be referred to in correspondence with the head-mounted display device calibration method described above.

[0227] The head-mounted display (HMD) calibration method provided in this application can be executed by a HMD calibration device. This application uses an HMD calibration device executing the calibration method as an example to illustrate the HMD calibration device provided in this application.

[0228] This application also provides a head-mounted display (HMD) device calibration apparatus. This HMD device calibration apparatus is applied to a HMD device calibration system, which includes a rotatable simulated eyeball and a photosensitive device. The HMD device to be calibrated is disposed within the HMD device calibration system, and the simulated eyeball is disposed between the HMD device to be calibrated and the photosensitive device.

[0229] The head-mounted display calibration device includes: a control module.

[0230] The control module is used to obtain a first quantized characterization value of luminous flux based on the light signal emitted by the head-mounted display device to be calibrated and guided by the simulated eyeball, which is collected by the photosensitive device; and to control the rotation of the simulated eyeball based on the first quantized characterization value until the center calibration is completed; and

[0231] The simulated eyeball is controlled to rotate in order to track the second light source point displayed on the screen of the head-mounted display device to be calibrated, thereby obtaining a second quantitative characterization value of the luminous flux. When the second quantitative characterization value of the luminous flux is found to meet a second set condition, the simulated eyeball is controlled to stop rotating.

[0232] According to the head-mounted display device calibration device provided in the embodiments of this application, by setting up a head-mounted display device calibration system for simulating the human eye, the simulated eyeball rotation is controlled based on the change in the amount of light received before and after the head-mounted display device calibration system, so that the position where the amount of light received is the largest is taken as the calibration completion point. This not only improves the user experience, but also improves the calibration efficiency and the accuracy and precision of the calibration results.

[0233] In some embodiments, the control module can also be used for:

[0234] Control the rotation of the simulated eyeball and control the photosensitive device to re-acquire the light signal, updating the first quantitative characterization value of the light flux;

[0235] Based on the first quantized characterization value of luminous flux before and after the update, a first target adjustment variable is determined; the first target adjustment variable includes adjustment angle and adjustment direction.

[0236] The steps are: controlling the simulated eye movement based on the first target adjustment variable, returning to execute the control photosensitive device to re-acquire the light signal, and updating the first quantitative characterization value of the light flux.

[0237] In some embodiments, the control module can also be used for:

[0238] If the first quantization value of the updated luminous flux is greater than the first quantization value of the luminous flux before the update, and the difference between the first quantization value of the updated luminous flux and the first quantization value of the luminous flux before the update is not less than the first threshold, the rotation direction corresponding to the last rotation of the simulated eyeball is determined as the adjustment direction.

[0239] If the first quantization value of the updated luminous flux is not greater than the first quantization value of the luminous flux before the update, and the difference between the first quantization value of the updated luminous flux and the first quantization value of the luminous flux before the update is not less than the first threshold, the opposite direction of the rotation direction corresponding to the last rotation of the simulated eyeball is determined as the adjustment direction.

[0240] If the difference between the first quantized representation value of the updated luminous flux and the first quantized representation value of the luminous flux before the update is less than the first threshold, the first target adjustment variable is determined to not exceed the fourth set threshold.

[0241] In some embodiments, the control module can also be used for:

[0242] The second light source point is tracked using a cross-sweep tracking method until the second quantized representation value of the luminous flux meets the second set condition, at which point the simulated eyeball is controlled to stop rotating.

[0243] In some embodiments, the control module can also be used for:

[0244] The second quantized representation value of luminous flux corresponding to each sub-region within the motion area is traversed, and the sub-region whose second quantized representation value of luminous flux satisfies the second set condition is determined as the target sub-region.

[0245] Starting from the center point of the target sub-region, the gaze point is controlled to scan in a cross direction, and the region corresponding to the second quantization value of the light flux of each scanned region satisfies the second set condition is determined as the location of the second light source point.

[0246] Control the simulated eyeball to stop rotating.

[0247] In some embodiments, the control module can also be used for:

[0248] Starting from the center point of the target sub-region, the photosensitive device is controlled to collect light signals to obtain the second quantitative characterization value of the light flux;

[0249] The simulated eyeball is controlled to rotate to control the gaze point to scan the target direction in the horizontal and vertical directions, and the photosensitive device is controlled to re-acquire light signals and update the second quantitative characterization value of light flux.

[0250] Based on the second quantized characterization value of the luminous flux before and after the update, the second target adjustment variable is determined; the second target adjustment variable includes the adjustment angle and the adjustment direction.

[0251] Based on the second target adjustment variable, the simulated eye movement is controlled until the second quantitative representation value of the luminous flux meets the second set condition. Then, the gaze point is controlled to scan in a direction other than the target direction in the horizontal and vertical directions until the second quantitative representation value of the luminous flux obtained in the other direction meets the second set condition. At this time, the area corresponding to this time is determined to be the location of the second light source point.

[0252] In some embodiments, the control module can also be used for:

[0253] Before the control photosensitive device collects the light signal emitted by the head-mounted display device to be calibrated and guided by a simulated eyeball to obtain the first quantitative characterization value of the light flux, the control photosensitive device collects the light signal emitted by the head-mounted display device to be calibrated and guided by a simulated eyeball to obtain the third quantitative characterization value of the light flux.

[0254] Based on the category of the head-mounted display device to be calibrated, the target component is rotated until the third quantization value of the light flux meets the third set condition, and then the IPD adjustment is completed.

[0255] In some embodiments, the control module can also be used for...

[0256] When the category is adjustable IPD of head-mounted display, the simulated IPD corresponding to the head-mounted display calibration system is determined to be the average value of human eye, and the head-mounted display IPD is determined to be the target component;

[0257] When the head-mounted display IPD is not adjustable, the IPD motor shaft corresponding to the head-mounted display calibration system is identified as the target component.

[0258] The head-mounted display (HMD) calibration device in this application embodiment can be a HMD calibration system or a component within the HMD calibration system, such as an integrated circuit or chip. The HMD calibration system can be a terminal or other devices besides a terminal. For example, the HMD calibration system can be a mobile phone, tablet computer, laptop computer, PDA, in-vehicle HMD calibration system, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), television (TV), ATM, or self-service machine, etc. This application embodiment does not specifically limit the specific device.

[0259] The head-mounted display device calibration device in this application embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit it.

[0260] The head-mounted display device calibration apparatus provided in this application embodiment can realize all the processes implemented in the head-mounted display device calibration method embodiment, and will not be described again here to avoid repetition.

[0261] On the other hand, this application also provides a computer program product, which includes a computer program stored on a non-transitory computer-readable storage medium. The computer program includes program instructions. When the program instructions are executed by a computer, the computer can execute the various processes of the above-described head-mounted display device calibration method embodiments and achieve the same technical effect. To avoid repetition, it will not be described again here.

[0262] In another aspect, this application also provides a non-transitory computer-readable storage medium storing a computer program thereon. When the computer program is executed by a processor, it implements the various processes of the above-described head-mounted display device calibration method embodiments and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0263] On another note, this application also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-described head-mounted display device calibration method embodiments, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0264] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[0265] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0266] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the parts that contribute to the related technology, can be embodied in the form of software products. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0267] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. An optical signal processing system for calibrating head-mounted display devices, characterized in that, The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system.

2. The optical signal processing system for calibration of a head-mounted device of claim 1, wherein, The application relates to a head-mounted device calibration system.

3. The optical signal processing system for calibration of a head-mounted device of claim 2, wherein, The application relates to a head-mounted device calibration system.

4. The optical signal processing system for calibration of a head-mounted device of claim 3, wherein, The application relates to a head-mounted device calibration system.

5. The optical signal processing system for head-mounted device calibration of claim 3, wherein, The application relates to a head-mounted device calibration system.

6. The optical signal processing system for calibration of a head-mounted device of any of claims 1-5, wherein, The application relates to a head-mounted device calibration system.

7. The optical signal processing system for calibration of a head-mounted device of any of claims 1-6, wherein, The application relates to a head-mounted device calibration system.

8. The optical signal processing system for head-mounted display device calibration according to claim 7, characterized in that, The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system.

9. A head-mounted device calibration system, comprising: The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system.

10. The head-mounted device calibration system of claim 9, wherein, The application relates to a head-mounted device calibration system.

11. An optical signal processing device for head-mounted device calibration, the device comprising: The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system.

12. The light signal processing apparatus for calibration of a head-mounted device according to claim 11, wherein, The application relates to a head-mounted device calibration system.

13. The optical signal processing device for calibration of a head-mounted device according to claim 12, wherein, The application relates to a head-mounted device calibration system.

14. The optical signal processing device for head-mounted device calibration of claim 11, wherein, The application relates to a head-mounted device calibration system.

15. The optical signal processing device for head-mounted device calibration of claim 11, wherein, The application relates to a head-mounted device calibration system.

16. The optical signal processing device for head-mounted device calibration of claim 13, wherein, The application relates to a head-mounted device calibration system.

17. The optical signal processing device for calibration of a head-mounted device according to claim 16, wherein, The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application relates to a head-mounted device calibration system. The application 18. The optical signal processing device for head-mounted device calibration of claim 16, wherein, The light reflection device is arranged between the optical fiber and the light sensing device to guide the light signal guided by the optical fiber to the light sensing device after reflection.

19. The optical signal processing device for calibration of a head-mounted device according to claim 18, wherein, The light reflection device is in a cylindrical structure, and the inner wall of the light reflection device is made of light reflection material.

20. The optical signal processing device for head-mounted device calibration of claim 18, wherein, The cross section of the light reflection device at two ends is different in size.

21. The light signal processing apparatus for calibration of a head-mounted device according to any one of claims 11-20, wherein, A first condenser is arranged between the exit end of the guiding mechanism and the light sensing device to improve the intensity of the light signal.

22. The optical signal processing device for head-mounted device calibration of claim 21, wherein, The main plane of the first condenser is perpendicular to the exit direction of the guiding mechanism.

23. The light signal processing apparatus for calibration of a head-mounted device according to any one of claims 11-22, wherein, A second condenser is arranged between the simulated eyeball and the head-mounted device to be calibrated to improve the intensity of the light signal.

24. The optical signal processing device for head-mounted device calibration of claim 23, wherein, The main plane of the second condenser is perpendicular to the incident direction of the guiding mechanism.

25. The light signal processing apparatus for calibration of a head-mounted device according to any one of claims 11-24, wherein, A third condenser is arranged in the simulated eyeball to improve the intensity of the light signal.

26. The optical signal processing device for head-mounted device calibration of claim 25, wherein, The main plane of the third condenser is perpendicular to the incident direction of the guiding mechanism.

27. The light signal processing apparatus for calibration of a head-mounted device according to any one of claims 11-26, wherein, The light sensing device includes an image sensor or a photoelectric sensor.

28. The optical signal processing device for calibration of a head-mounted device according to any of claims 11-27, wherein, A curtain is arranged between the guiding mechanism and the light sensing device, and the area of the curtain is greater than the projection area of the light signal on the plane where the curtain is located.

29. The light signal processing apparatus for calibration of a head-mounted device according to any one of claims 11-28, wherein, The simulated eyeball is rotatable.

30. The optical signal processing device for calibration of a head-mounted device of claim 29, wherein, In the case where the guiding mechanism includes an optical fiber, the input end of the optical fiber is arranged in the simulated eyeball and can rotate synchronously with the simulated eyeball.

31. The optical signal processing apparatus for calibrating a head-mounted display device according to claim 29, characterized in that, The light sensing device can rotate synchronously with the simulated eyeball.

32. A head-mounted device calibration apparatus, comprising: It comprises: a simulated eyeball for receiving a light signal emitted by a head-mounted device to be calibrated; a guiding mechanism cooperating with the simulated eyeball to transmit the light signal received by the simulated eyeball backward; a light sensing device located at the rear end of the guiding mechanism to generate a quantitative representation value of light flux of the light signal guided and transmitted by the guiding mechanism for calibration of the head-mounted device; a control device connected with the simulated eyeball and the light sensing device respectively, the control device controls the rotation of the simulated eyeball based on the quantitative representation value of the light flux transmitted by the light sensing device to calibrate the head-mounted device to be calibrated.

Images