Thermal out-of-focus compensation method and system

By monitoring the luminous flux of the projection device lens in real time, calculating the accumulated thermal effect and performing focus compensation, the problem of thermal loss of the projection device is solved, and the accuracy of compensation and user experience are improved.

CN119071447APending Publication Date: 2024-12-03BENQ INTELLIGENT TECH (SHANGHAI) CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411049186.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-01
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

During use, existing projection equipment has increased temperature due to the lens absorbing radiation, resulting in thermal loss of focus. Existing compensation methods such as temperature sensor detection and image capturing analysis of camera modules have problems with accuracy and user experience.

Method used

By monitoring the luminous flux of the lens in real time, calculating the accumulated thermal effect, and determining whether to perform focus compensation based on the preset value to ensure the picture clarity, the luminous flux sensor and the lens driving module are used to achieve thermal out-of-focus compensation.

Benefits of technology

It effectively improves the accuracy and reliability of thermal out-of-focus compensation, avoids interruption of user experience, and can accurately determine the thermal out-of-focus state of the lens at different brightness levels, and maintains picture clarity.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119071447A_ABST
    Figure CN119071447A_ABST
Patent Text Reader

Abstract

The invention provides a thermal out-of-focus compensation method and a thermal out-of-focus compensation system. The thermal out-of-focus compensation method comprises the following steps: S1, obtaining real-time luminous flux passing through a lens; s2, calculating the accumulated luminous flux passing through the lens at the current moment, and converting the accumulated luminous flux into the accumulated heat effect of the lens; s3, judging whether the accumulated heat effect of the lens at the current moment exceeds a preset value or not; and if yes, judging that the projection equipment is in a thermal out-of-focus state, and driving the lens to move so as to realize thermal out-of-focus compensation.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of projection technology, and in particular to a method and system for compensating thermal defocus of a projection device. Background Art

[0002] A projector requires a light source to work, and these light sources are high heat radiators. Therefore, after the projector has been used for a period of time, the lenses and structural parts in its projection lens absorb radiation, the temperature rises, and thus deforms, causing the position of the best projection image to move, making the projection image unclear and out of focus, affecting the user experience.

[0003] In the prior art, there are two main ways to compensate for thermal defocus of projection equipment lenses: (1) Using a temperature sensor to detect the temperature change of the lens and then perform focus compensation; however, since it is not convenient to install a temperature sensor on the lens body, and the temperature sensors at other locations around the lens cannot accurately simulate the temperature change of the lens when the temperature change of the lens is very different when the projection screen is brighter or darker, it is easy to cause the lens focus compensation to be inadequate and affect the picture clarity. (2) Using a camera module to capture a specific projection screen, analyze its picture clarity, and then perform focus compensation on the lens; however, this method requires the camera to capture a specific projection screen, which will affect the user's continuous viewing experience.

[0004] Therefore, it is necessary to design a new thermal defocus compensation method and system to improve the above defects. Summary of the invention

[0005] The purpose of the present invention is to provide a method and system for thermal defocus compensation, which evaluates the thermal defocus state of the projection device by real-time monitoring of the lens luminous flux, and then adjusts the focus of the lens to maintain the resolution performance of the picture; this method will not interrupt the user's continuous viewing experience, and when the projected playback picture is at different brightness levels, it can determine whether the lens has thermal defocus, effectively improving the reliability of thermal defocus compensation.

[0006] To achieve the above objectives, the present invention provides a novel thermal defocus compensation method and system. The thermal defocus compensation method comprises the following steps:

[0007] S1. Obtain the real-time luminous flux passing through the lens;

[0008] S2, calculating the cumulative luminous flux passing through the lens at the current moment, and converting the cumulative luminous flux into the cumulative thermal effect of the lens;

[0009] S3, determining whether the cumulative thermal effect of the lens at the current moment exceeds a preset value;

[0010] If so, it is determined that the projection device is in a thermal defocus state, and the lens is driven to move to achieve thermal defocus compensation.

[0011] Preferably, step S1 specifically includes:

[0012] S11, obtaining a real-time input image frame received by the projection device;

[0013] S12, determining the brightness level of the real-time input image frame according to the brightness level of the all-white input image frame and the real-time input image frame;

[0014] S13: Determine the real-time light flux passing through the lens based on the brightness level of the real-time input image frame.

[0015] Preferably, the step S1 specifically includes: sensing the light flux passing through the lens in real time based on a light flux sensor.

[0016] Preferably, in step S2, the cumulative luminous flux is converted into the cumulative thermal effect of the lens, specifically including: based on a first corresponding relationship between the luminous flux passing through the lens, the thermal effect of the lens and the clarity of the projection image, obtaining the cumulative thermal effect corresponding to the cumulative luminous flux of the lens.

[0017] Preferably, the step S3 further includes determining the preset value of the cumulative thermal effect based on the correlation between the thermal effect of the lens and the definition of the projection image in the first corresponding relationship.

[0018] Preferably, in step S3, driving the lens to move to achieve thermal defocus compensation specifically includes:

[0019] Based on the second corresponding relationship between the focusing parameter of the lens driving module and the definition of the projection picture, the focusing parameter corresponding to the projection picture with the highest definition is obtained, and the focusing parameter is used to control the lens driving module to drive the lens to move for focusing;

[0020] The focusing parameters include the focusing driving current and the angular displacement of the lens driving module.

[0021] Preferably, a second corresponding relationship between the focusing parameters of the lens driving module and the projection picture clarity is obtained in advance at least based on the optical characteristics of the lens, the cumulative thermal effect, the projection distance from the lens to the projection screen and the real-time detected projection picture clarity.

[0022] Preferably, a thermal defocus compensation system comprises:

[0023] A monitoring module is used to monitor the real-time light flux passing through the lens;

[0024] A conversion module, used to calculate the cumulative luminous flux passing through the lens at the current moment, and convert the cumulative luminous flux into a cumulative thermal effect of the lens;

[0025] A judging module, used to judge whether the projection device is in a thermal defocus state according to whether the accumulated thermal effect of the lens at the current moment exceeds a preset value; and

[0026] The thermal defocus compensation module is used to control the movement of the lens to achieve thermal defocus compensation when it is determined that the projection device is in a thermal defocus state.

[0027] Preferably, the monitoring module is configured to obtain real-time input image frames received by the projection device;

[0028] The monitoring module is also configured to determine the brightness level of the real-time input image frame according to the brightness level of the all-white input image frame and the real-time input image frame, and the monitoring module determines the real-time luminous flux passing through the lens based on the brightness level of the real-time input image frame.

[0029] Preferably, the monitoring module includes a light flux sensor, and the light flux sensor is used to sense the light flux passing through the lens in real time.

[0030] Preferably, the conversion module is used to obtain the cumulative thermal effect corresponding to the cumulative light flux of the lens based on a first corresponding relationship among the light flux passing through the lens, the thermal effect of the lens and the definition of the projection image.

[0031] Preferably, the thermal defocus compensation module is used to obtain the focusing parameters corresponding to the projection image with the highest clarity based on the second corresponding relationship between the focusing parameters of the lens driving module and the clarity of the projection image, and use the focusing parameters to control the lens driving module to drive the lens to move for focusing.

[0032] Preferably, the focusing parameters include a focusing driving current and an angular displacement of the lens driving module.

[0033] Compared with the prior art: the thermal defocus compensation method provided by the present invention determines the current cumulative thermal effect of the projection device lens by real-time monitoring of the lens luminous flux, and evaluates whether the projection device is in a thermal defocus state according to whether the cumulative thermal effect of the lens at the current moment exceeds a preset value. When it is determined that the projection device is in a thermal defocus state, the lens is focused and compensated to maintain the clarity of the picture. The reliability and accuracy of the thermal defocus compensation are effectively improved without interrupting the user's continuous viewing experience. The thermal defocus condition of the lens can also be accurately determined when the projection playback picture is dynamically at different brightness levels. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 A schematic diagram of a flow chart of a thermal defocus compensation method proposed in one embodiment of the present invention;

[0035] Figure 2 This is a schematic diagram of a specific flow chart of step S1 in the thermal defocus compensation method proposed in one embodiment of the present invention;

[0036] Figure 3 This is a schematic diagram of a specific flow chart of step S1 in the thermal defocus compensation method proposed in one embodiment of the present invention;

[0037] Figure 4 It is a schematic structural diagram of a thermal defocus compensation system proposed in one embodiment of the present invention. DETAILED DESCRIPTION

[0038] In order to provide a further understanding of the purpose, structure, features, and functions of the present invention, the following detailed description is given in conjunction with the embodiments.

[0039] Certain words are used in the specification and claims to refer to specific components. Those with ordinary knowledge in the field should understand that manufacturers may use different terms to refer to the same component. This specification and claims do not use differences in names as a way to distinguish components, but rather use differences in components' functions as the criteria for distinction. The term "including" mentioned throughout the specification and claims is an open-ended term and should be interpreted as "including but not limited to".

[0040] See also Figure 1 , Figure 1 A schematic flow chart of a thermal defocus compensation method according to one embodiment of the present invention is disclosed, wherein the thermal defocus compensation method is used to perform thermal defocus compensation on a lens module in a projection device, wherein the lens module includes a lens and a lens driving module (such as a focus motor) for driving the lens to move. Figure 1 As shown, the thermal defocus compensation method is performed according to the following steps: Step S1, obtaining the real-time luminous flux passing through the lens. Step S2, based on the real-time luminous flux, calculating the cumulative luminous flux passing through the lens at the current moment, and converting the cumulative luminous flux into the cumulative thermal effect of the lens.

[0041] Step S3, judging whether the cumulative thermal effect of the lens at the current moment exceeds the preset value; if not, judging that the projection device is not currently thermally defocused. If so, judging that the projection device is currently in a thermally defocused state, and controlling the lens drive module to drive the lens to move, so as to achieve thermal defocus compensation. It can be understood that the cumulative luminous flux passing through the lens at the current moment is preferably the cumulative luminous flux passing through the lens from the initial moment (for example, the moment when the projection device is turned on or the moment when the thermal defocus compensation is completed last time) to the current moment.

[0042] That is to say, the above-mentioned thermal defocus compensation method monitors the real-time light flux passing through the lens, and then converts the cumulative light flux passing through the lens at the current moment into the cumulative thermal effect of the lens, thereby evaluating whether the projection device is currently in a thermal defocus state. When it is determined that the projection device is in a thermal defocus state, the lens is focused and compensated to maintain the resolution performance of the picture. There is no need to focus the lens based on the sensing value of the temperature sensor or the specific projection picture captured by the camera module, and the user's continuous viewing experience will not be interrupted. Moreover, it can be determined whether the lens is thermally defocused when the projection playback picture is at different brightness levels, thereby effectively improving the reliability and accuracy of thermal defocus compensation.

[0043] Please refer to Figure 2 As shown, in one embodiment, the specific method of obtaining the real-time luminous flux passing through the lens in step S1 includes:

[0044] Step S11: obtaining a real-time input image frame received by the projection device.

[0045] Step S12, according to the brightness level of the all-white input image frame and the above-mentioned real-time input image frame, the brightness level of the real-time input image frame is determined. Specifically, white controls the brightness of the brightest position area in the input image frame, and the above-mentioned all-white input image frame is the input image frame with the preset brightest level. In this way, the brightness level of the real-time input image frame can be determined by comparing the three primary color components of each pixel point of the above-mentioned all-white input image frame with the three primary color components of each corresponding pixel point in the real-time input image frame received by the projection device. Among them, the three primary color components are red component, green component and blue component respectively.

[0046] Step S13: Determine the real-time luminous flux passing through the lens according to the brightness level of the real-time input image frame.

[0047] In another embodiment, please refer to Figure 3 As shown, the specific method for obtaining the real-time luminous flux passing through the lens is: based on the luminous flux sensor, the luminous flux passing through the lens is sensed in real time. In addition, in some other embodiments, the thermal effect of the projection device and whether it is in a thermal defocus state can be evaluated by monitoring the changes of other parameters related to the luminous flux in the projection device, but the present invention is not limited thereto.

[0048] In one embodiment, in the above step S2, the specific method of converting the cumulative luminous flux of the lens into the cumulative thermal effect includes: based on the first correspondence between the luminous flux passing through the lens, the thermal effect of the lens and the clarity of the projection image, obtaining the cumulative thermal effect corresponding to the cumulative luminous flux of the lens. The first correspondence is pre-established, and the first correspondence is presented by a model, a function, a lookup table, a comparison table, etc., and the present invention is not limited thereto.

[0049] Furthermore, in the above step S3, the preset value of the cumulative thermal effect is determined based on the correlation between the thermal effect of the lens and the projection picture clarity in the above first corresponding relationship, and the correlation is, for example, presented by a relationship model between the thermal effect of the lens and the projection picture clarity.

[0050] In one of the embodiments, in the above step S3, it is determined that the projection device is in a thermal defocus state, and the lens is driven to move to achieve thermal defocus compensation, which specifically includes: based on the second corresponding relationship between the focusing parameters of the lens driving module and the clarity of the projection picture, the focusing parameters corresponding to the projection picture with the highest clarity are obtained, and the lens driving module is controlled by the above focusing parameters to drive the lens to move so that the lens is focused. Among them, the second corresponding relationship can be pre-established based on the optical characteristics of the lens (such as focal length, field of view and relative aperture), related parameters (including focal length, aperture coefficient, depth of field, spectral characteristics, resolution, aperture, etc.), the cumulative thermal effect of the lens, the projection distance from the above lens to the projection screen (such as ranging method) and the real-time detection of the projection picture clarity (such as image analysis method), and the present invention is not limited to this. The above second corresponding relationship is also pre-established, and the second corresponding relationship is presented by a model, a function, a lookup table, a comparison table, etc., and the present invention is not limited to this. The focusing parameters include but are not limited to the focusing driving current, running time and angular displacement of the lens driving module. When the lens driving module is a focusing motor, the focusing parameters may also include the number of steps of the focusing motor.

[0051] It can be seen that the thermal defocus compensation method provided by the present invention evaluates the thermal defocus state of the projection equipment lens by real-time monitoring of the lens luminous flux, and then performs focusing compensation on the lens to maintain the resolution performance of the picture without affecting the user's continuous viewing experience, thereby effectively improving the accuracy and reliability of thermal defocus compensation.

[0052] like Figure 4 As shown, the present invention also proposes a thermal defocus compensation system, which executes the above thermal defocus compensation method. The thermal defocus compensation system includes: a monitoring module M1, a conversion module M2, a judgment module M3 and a thermal defocus compensation module M4.

[0053] The light emitted by the light source in the projection device is incident on the DMD (digital micromirror device), and the DMD controls part of the light to be reflected into the lens based on the input signal, and the part of the light is emitted from the lens. The monitoring module M1 is used to monitor and obtain the real-time light flux passing through the lens.

[0054] Specifically, in one embodiment, the monitoring module M1 is configured to obtain the real-time input image frame received by the projection device, and the monitoring module M1 is also used to determine the brightness level of the real-time input image frame based on the brightness level of the all-white input image frame and the real-time input image frame, and the monitoring module M1 determines the real-time luminous flux passing through the lens based on the brightness level of the real-time input image frame. The all-white input image frame is the input image frame with the preset brightest level, so that by comparing the three primary color components of each pixel point of the all-white input image frame with the three primary color components of each corresponding pixel point in the real-time input image frame received by the projection device, the brightness level of the real-time input image frame can be quickly determined.

[0055] In another embodiment, the monitoring module M1 includes a luminous flux sensor, which is used to sense the luminous flux passing through the lens in real time. The luminous flux sensor is arranged on the light-emitting surface side or the light-entering surface side of the lens to sense the luminous flux passing through the lens in real time. In addition, in some preferred embodiments, the luminous flux sensor can also be arranged on a bypass light surface related to the lens light flux to obtain the luminous flux information of the lens and avoid light loss, but the present invention is not limited thereto. In some other embodiments, the monitoring module M1 can also obtain the real-time luminous flux passing through the lens by monitoring the changes in other parameters related to the luminous flux in the projection device, but the present invention is not limited thereto.

[0056] The conversion module M2 is used to calculate the cumulative light flux passing through the lens from the initial moment to the current moment based on the real-time light flux passing through the lens, and convert the cumulative light flux into the cumulative thermal effect of the lens.

[0057] In one embodiment, the conversion module M2 is configured to obtain the cumulative thermal effect corresponding to the cumulative luminous flux of the lens based on a first correspondence between the luminous flux passing through the lens, the thermal effect of the lens and the clarity of the projection image (for example, presented through a model, a function, a lookup table, etc.).

[0058] The judgment module M3 is used to determine whether the projection device is in a thermally defocused state according to whether the cumulative thermal effect of the lens at the current moment exceeds a preset value. If the cumulative thermal effect of the lens at the current moment exceeds the preset value, the projection device is determined to be in a thermally defocused state. The preset value of the cumulative thermal effect is determined based on the correlation between the thermal effect of the lens and the clarity of the projection picture in the first corresponding relationship, and the correlation is presented, for example, by a relationship model between the thermal effect of the lens and the clarity of the projection picture.

[0059] The thermal defocus compensation module M4 is used to control the lens driving module to drive the lens to move and focus the lens when determining that the projection device is in a thermal defocus state, so as to achieve thermal defocus compensation. In one embodiment, the thermal defocus compensation module M4 is used to obtain the focusing parameters corresponding to the projection picture with the highest clarity based on the second corresponding relationship between the focusing parameters of the lens driving module and the clarity of the projection picture, and use the focusing parameters to control the lens driving module to drive the lens to move and focus the lens.

[0060] Preferably, the focusing parameters include but are not limited to the focusing driving current, running time and angular displacement of the lens driving module. When the lens driving module is a focusing motor, the focusing parameters also include the number of steps of the focusing motor. In addition, the above-mentioned second corresponding relationship can be pre-established based on the optical characteristics of the lens, related parameters (including focal length, aperture coefficient, depth of field, spectral characteristics, resolution, aperture, etc.), the cumulative thermal effect of the lens, the projection distance from the above-mentioned lens to the projection screen (such as ranging method) and the real-time detection of the projection picture clarity (such as image analysis method), but the present invention is not limited to this.

[0061] In summary, the present invention provides a thermal defocus compensation method and system, which monitors the lens luminous flux in real time, converts the cumulative luminous flux passing through the lens at the current moment into the cumulative thermal effect of the lens, and then evaluates the thermal defocus state of the projection device lens. When it is determined that the projection device is in a thermal defocus state, the lens is focused and compensated to maintain the clarity of the picture without interrupting the user's continuous viewing experience. Moreover, when the projected playback picture is dynamic and has different brightness levels, it can be determined whether the lens is thermally defocused, thereby effectively improving the reliability and accuracy of thermal defocus compensation.

[0062] The present invention has been described by the above-mentioned relevant embodiments, however, the above-mentioned embodiments are only examples for implementing the present invention. It must be pointed out that the disclosed embodiments do not limit the scope of the present invention. On the contrary, changes and modifications made without departing from the spirit and scope of the present invention are all within the scope of patent protection of the present invention.

Claims

1. A thermal defocus compensation method, characterized in that: The following steps are involved: S1. Obtain the real-time luminous flux passing through the lens; S2, calculating the cumulative luminous flux passing through the lens at the current moment, and converting the cumulative luminous flux into the cumulative thermal effect of the lens; S3, determining whether the cumulative thermal effect of the lens at the current moment exceeds a preset value; If so, it is determined that the projection device is in a thermal defocus state, and the lens is driven to move to achieve thermal defocus compensation.

2. The thermal defocus compensation method according to claim 1, characterized in that: The step S1 specifically includes: S11, obtaining a real-time input image frame received by the projection device; S12, determining the brightness level of the real-time input image frame according to the brightness level of the all-white input image frame and the real-time input image frame; S13: Determine the real-time light flux passing through the lens based on the brightness level of the real-time input image frame.

3. The thermal defocus compensation method according to claim 1, characterized in that: The step S1 specifically includes: sensing the light flux passing through the lens in real time based on a light flux sensor.

4. The thermal defocus compensation method according to claim 1, characterized in that: In step S2, the cumulative luminous flux is converted into the cumulative thermal effect of the lens, specifically including: based on a first corresponding relationship between the luminous flux passing through the lens, the thermal effect of the lens and the clarity of the projection picture, obtaining the cumulative thermal effect corresponding to the cumulative luminous flux of the lens.

5. The thermal defocus compensation method according to claim 4, characterized in that: The step S3 also includes determining the preset value of the cumulative thermal effect based on the correlation between the thermal effect of the lens and the definition of the projection image in the first corresponding relationship.

6. The thermal defocus compensation method according to claim 1, characterized in that: In step S3, the lens is driven to move to achieve thermal defocus compensation, which specifically includes: Based on the second corresponding relationship between the focusing parameter of the lens driving module and the definition of the projection picture, the focusing parameter corresponding to the projection picture with the highest definition is obtained, and the focusing parameter is used to control the lens driving module to drive the lens to move for focusing; The focusing parameters include the focusing driving current and the angular displacement of the lens driving module.

7. The thermal defocus compensation method according to claim 6, characterized in that: A second corresponding relationship between the focusing parameters of the lens driving module and the projection picture clarity is obtained in advance at least based on the optical characteristics of the lens, the cumulative thermal effect, the projection distance from the lens to the projection screen and the real-time detected projection picture clarity.

8. A thermal defocus compensation system, characterized in that: include: A monitoring module is used to monitor the real-time light flux passing through the lens; A conversion module, used to calculate the cumulative luminous flux passing through the lens at the current moment, and convert the cumulative luminous flux into a cumulative thermal effect of the lens; A judgment module, used to determine whether the projection device is in a thermal defocus state according to whether the accumulated thermal effect of the lens at the current moment exceeds a preset value; as well as The thermal defocus compensation module is used to control the movement of the lens to achieve thermal defocus compensation when it is determined that the projection device is in a thermal defocus state.

9. The thermal defocus compensation system according to claim 8, characterized in that: The monitoring module is configured to obtain a real-time input image frame received by the projection device; The monitoring module is also configured to determine the brightness level of the real-time input image frame according to the brightness level of the all-white input image frame and the real-time input image frame, and the monitoring module determines the real-time luminous flux passing through the lens based on the brightness level of the real-time input image frame.

10. The thermal defocus compensation system according to claim 8, characterized in that: The monitoring module includes a light flux sensor, and the light flux sensor is used for real-time sensing of the light flux passing through the lens.

11. The thermal defocus compensation system according to claim 8, characterized in that: The conversion module is used for obtaining the cumulative thermal effect corresponding to the cumulative light flux of the lens based on a first corresponding relationship among the light flux passing through the lens, the thermal effect of the lens and the definition of the projection picture.

12. The thermal defocus compensation system according to claim 9, characterized in that: The thermal defocus compensation module is used to obtain the focusing parameters corresponding to the projection picture with the highest clarity based on the second corresponding relationship between the focusing parameters of the lens driving module and the clarity of the projection picture, and use the focusing parameters to control the lens driving module to drive the lens to move for focusing.

13. The thermal defocus compensation system according to claim 12, characterized in that: The focusing parameters include the focusing driving current and the angular displacement of the lens driving module.