Projection equipment and intelligent interaction method

Through the combination of light source components, light modulation components, first dichroic elements and infrared image sensors, the problems of large computing resource usage and unstable delay in projector touch interaction are solved, and efficient touch response and improved user experience are achieved.

CN116382017BActive Publication Date: 2025-09-26CHENGDU XGIMI TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202111532936.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-12-15
Publication Date
2025-09-26
Estimated Expiration
2041-12-15

AI Technical Summary

Technical Problem

When existing projectors implement touch interaction in office and education scenarios, they use camera recognition, which results in large computing resource usage, unstable delays, and poor user experience.

Method used

A combination of a light source component, a light modulation component, a first dichroic element and an infrared image sensor is adopted to detect touch events using infrared light, and an image processor is combined to determine the user's action position, thereby reducing the complexity of the image matching algorithm and the consumption of computing resources.

Benefits of technology

This ensures that the projection device does not occupy computing resources when there is no touch event, responds to touch messages in a timely manner, and improves user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116382017B_ABST
    Figure CN116382017B_ABST
Patent Text Reader

Abstract

This application discloses a projection device and intelligent interaction method. The projection device includes a light source assembly, a light modulation assembly, a first dichroic element, an infrared image sensor, and a projection lens. The light modulation assembly is used to modulate the light beam generated by the light source assembly, and the modulated light beam is projected onto the projection area through the projection lens. The first dichroic element is used to transmit light of a wavelength corresponding to the modulated light of at least one spatial light modulator in the light modulation assembly and reflect infrared light. The infrared image sensor is used to collect infrared light from the first dichroic element. This application ensures that the projected image and the interactively collected image have the same coordinate system, reducing the algorithm complexity of image matching and saving computing resources. At the same time, the projection device can detect and respond to touch messages in a timely manner, and does not occupy computing resources when no touch events occur, thereby ensuring the efficient use of resources by the projection device itself and improving the user experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of projection technology, and in particular to a projection device and an intelligent interaction method. Background Art

[0002] Currently, projectors on the market can be categorized by display method: LCD (Liquid Crystal Display), LCOS (Liquid Crystal on Silicon), and DLP (Digital Light Processor). LCD projectors use a transmissive LCD panel as a spatial light modulator. LCOS projection technology is a new type of reflective micro-liquid crystal projection technology that uses a CMOS integrated circuit chip coated with liquid crystal silicon as the substrate for the reflective LCD. DLP projectors use a DMD (Digital Micromirror Device) chip as the spatial light modulator. Depending on the number of spatial light modulators used, DLP projectors can be classified into single-chip, two-chip, and three-chip types, such as single-chip LCOS projectors, two-chip LCOS projectors, and three-chip LCOS projectors. Summary of the Invention

[0003] When projectors are used in office and educational scenarios, they can support touch interaction functions, and this is usually achieved by using camera recognition or infrared transceivers to determine touch events and locations. Camera recognition requires the deployment of additional cameras, which obtain image data containing the image of the projection surface, crop and match it, and then perform feature extraction to analyze and determine whether a touch event has occurred, as well as the location where the touch has occurred. Image analysis also needs to be performed periodically, which not only requires a large amount of data to be calculated and occupies a large amount of computing resources, but also requires that images be acquired and analyzed in a certain cycle even when no touch occurs. The delay is also unstable, especially for touch events that occur just after the previous cycle. The delay in detection and response is even greater, resulting in a poor user experience. In view of this, the embodiments of the present application provide a projection device and an intelligent interaction method to solve at least one of the above problems.

[0004] In a first aspect, an embodiment of the present application provides a projection device, including a light source component, a light modulation component, a first dichroic element, an infrared image sensor, and a projection lens, wherein:

[0005] The light source assembly is used to generate the light beam required for projection;

[0006] The light modulation component is used to modulate the light beam generated by the light source component, and the modulated light beam is projected to the projection area through the projection lens;

[0007] The first dichroic element is used to transmit light of a wavelength corresponding to the modulated light of at least one spatial light modulator in the light modulation assembly and reflect infrared light;

[0008] The infrared image sensor is used to collect infrared light from the first dichroic element;

[0009] The modulated light of at least one spatial light modulator in the light modulation component is transmitted to the projection lens through the first dichroic element; the infrared light in the projection area is emitted into the projection device and passes through the projection lens, and the infrared light passing through the projection lens is reflected by the first dichroic element to the infrared image sensor.

[0010] In a possible implementation, the incident light of the spatial light modulator in the light modulation component is incident vertically, and the infrared light is incident vertically on the infrared image sensor.

[0011] In one possible implementation, the light beam generated by the light source assembly includes a first laser, a second laser, and a third laser, wherein the first laser, the second laser, and the third laser are lasers having a first wavelength, a second wavelength, and a third wavelength, respectively, and the first laser has a different polarization state than the second laser and the third laser;

[0012] The light modulation component includes a first LCOS modulator, a second LCOS modulator, a third LCOS modulator, a first polarization beam splitter and a second dichroic element, wherein:

[0013] The first LCOS modulator is used to modulate the first laser into a first modulated light and reflect the first modulated light to the first polarization beam splitter;

[0014] The second LCOS modulator is used to modulate the second laser into a second modulated light and reflect the second modulated light to the second dichroic element;

[0015] a third LCOS modulator configured to modulate the third laser light into a third modulated light and reflect the third modulated light to the second dichroic element;

[0016] The first polarization beam splitter is used to guide the first laser light in the light beam provided by the light source assembly to the first LCOS modulator, and to guide the second laser light and the third laser light in the light beam provided by the light source assembly to the second dichroic element, and to guide the first modulated light, the second modulated light, and the third modulated light to be emitted in the same direction;

[0017] The second dichroic element is used to guide the second laser light to the second LCOS modulator, guide the third laser light to the third LCOS modulator, and guide the second modulated light and the third modulated light to the first polarization beam splitter;

[0018] The first modulated light, the second modulated light, and the third modulated light emitted by the first polarization beam splitter are all transmitted to the projection lens through the first dichroic element, and the infrared light passing through the projection lens is directly reflected to the infrared image sensor through the first dichroic element; or, one or both of the first modulated light, the second modulated light, and the third modulated light emitted by the first polarization beam splitter are transmitted to the projection lens through the first dichroic element, and the infrared light passing through the projection lens is transmitted to the first dichroic element through the first polarization beam splitter and then reflected to the infrared image sensor by the first dichroic element; or, one of the first modulated light, the second modulated light, and the third modulated light emitted by the first polarization beam splitter is transmitted to the projection lens through the first dichroic element, and the infrared light passing through the projection lens is transmitted to the first dichroic element through the first polarization beam splitter and the second dichroic element in sequence and then reflected to the infrared image sensor by the first dichroic element.

[0019] In a possible implementation, the first polarizing beam splitter and the second dichroic element have surfaces located on planes perpendicular or parallel to each other, and the first dichroic element and the first polarizing beam splitter have surfaces located on planes perpendicular or parallel to each other.

[0020] In one possible implementation, the light beam generated by the light source assembly includes a first laser, a second laser, and a third laser, wherein the first laser, the second laser, and the third laser are lasers having a first wavelength, a second wavelength, and a third wavelength, respectively, and the first laser has a different polarization state than the second laser and the third laser;

[0021] The light modulation component includes a first LCOS modulator, a second LCOS modulator, a third LCOS modulator, a second polarization beam splitter, a third dichroic element and a fourth dichroic element, wherein:

[0022] The first LCOS modulator is used to modulate the first laser into a first modulated light and reflect the first modulated light to the second polarization beam splitter;

[0023] The second LCOS modulator is used to modulate the second laser into a second modulated light and reflect the second modulated light to the second polarization beam splitter;

[0024] The third LCOS modulator is used to modulate the third laser into a third modulated light and reflect the third modulated light to the second polarization beam splitter;

[0025] The third dichroic element is used to guide the first laser light in the light beam provided by the light source assembly to the first optical path and incident on the second polarization beam splitter, and to guide the second laser light and the third laser light in the light beam provided by the light source assembly to the second optical path and incident on the second polarization beam splitter;

[0026] The second polarization beam splitter is used to guide the first laser light to the first LCOS modulator, guide the second laser light to the second LCOS modulator, guide the third laser light to the third LCOS modulator, and guide the first modulated light, the second modulated light and the third modulated light to the fourth dichroic element;

[0027] The fourth dichroic element is used to guide the first modulated light, the second modulated light and the third modulated light to be emitted in the same direction;

[0028] The first modulated light, the second modulated light, and the third modulated light emitted by the fourth dichroic element are all transmitted through the first dichroic element to the projection lens, and the infrared light passing through the projection lens is directly reflected through the first dichroic element to the infrared image sensor; alternatively, the first dichroic element and the fourth dichroic element are the same dichroic element, and the infrared light passing through the projection lens is reflected through the fourth dichroic element to the second polarizing beam splitter, and then reflected from the second polarizing beam splitter to the infrared image sensor.

[0029] In one possible implementation, the third dichroic element and the fourth dichroic element are located in the same plane, which is perpendicular to the plane where the surface of the second polarizing beam splitter is located, and the third dichroic element and the fourth dichroic element are located on opposite sides of the second polarizing beam splitter.

[0030] In a possible implementation, the light beam generated by the light source assembly is incident at an angle of 45 degrees to the element in the light modulation assembly that receives the light beam.

[0031] In a possible implementation, the infrared light in the projection area includes infrared light of 0.75-2.5 microns.

[0032] In a possible implementation, a first image processor is further included, and the first image processor is used to determine the user's action position according to the acquisition result of the infrared image sensor and the projection image information.

[0033] In a possible implementation, the 0.75-2.5 micron infrared light includes infrared light with a polarization state.

[0034] In one possible implementation, the infrared image sensor includes an infrared thermal imaging detector, which is used to collect infrared light with a wavelength of 3-6 microns or a wavelength of 7-15 microns;

[0035] The projection device also includes a second image processor, which is used to obtain the temperature of the detected object based on the acquisition results of the infrared thermal imaging detector. If the obtained temperature of the detected object is higher than or equal to a preset threshold, the projection device is controlled to perform a first preset operation.

[0036] In a possible implementation, the second image processor is further configured to:

[0037] If the temperature of the detected object is continuously obtained to be less than the preset threshold, the projection device is controlled to perform a second preset operation.

[0038] In a second aspect, an embodiment of the present application provides an intelligent interaction method, which is applied to the projection device described in the first aspect or a possible implementation of the first aspect, and the method includes:

[0039] Acquiring infrared light collection results, where the infrared light includes infrared light emitted by a handheld interactive device;

[0040] Determining the user's active position based on the acquisition results and the projection image information;

[0041] A target operation is performed according to the user's action position.

[0042] In a possible implementation, the handheld interaction device further emits visible light.

[0043] This application combines the image sensor with the light modulation component so that the projected image and the interactively captured image have the same coordinate system, reducing the algorithm complexity of image matching between different devices and saving computing resources. At the same time, the projection device can detect and respond to touch messages in a timely manner, and will not occupy computing resources when no touch event occurs, thereby ensuring the resource utilization efficiency of the projection device itself and improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] The above and other purposes, features and advantages of the present application will become more apparent by describing the embodiments of the present application in more detail in conjunction with the accompanying drawings. The accompanying drawings are used to provide a further understanding of the embodiments of the present application and constitute a part of the specification. Together with the embodiments of the present application, they are used to explain the present application and do not constitute a limitation of the present application. In the accompanying drawings, the same reference numerals generally represent the same components. Among them:

[0045] Figure 1Schematic diagram of application scenarios provided by embodiments of the present application;

[0046] Figure 2 A schematic diagram of the acquisition results of the infrared image sensor provided in an embodiment of the present application;

[0047] Figure 3 A schematic structural diagram of an optical modulation component provided in an embodiment of the present application;

[0048] Figure 4 A schematic structural diagram of another optical modulation component provided in an embodiment of the present application;

[0049] Figure 5 A schematic structural diagram of another optical modulation component provided in an embodiment of the present application;

[0050] Figure 6 A schematic structural diagram of a projection device provided in an embodiment of the present application;

[0051] Figure 7 A schematic structural diagram of another projection device provided in an embodiment of the present application;

[0052] Figure 8 A schematic structural diagram of another projection device provided in an embodiment of the present application;

[0053] Figure 9 A schematic structural diagram of another projection device provided in an embodiment of the present application;

[0054] Figure 10 A schematic structural diagram of a light source assembly provided in an embodiment of the present application;

[0055] Figure 11 A schematic structural diagram of another light source assembly provided in an embodiment of the present application;

[0056] Figure 12 A schematic structural diagram of another light source assembly provided in an embodiment of the present application;

[0057] Figure 13 Schematic diagram of the acquisition results of the infrared thermal imaging detector provided in an embodiment of the present application.

[0058] 100-light source assembly; 111-red laser light source; 112-green laser light source; 113-blue laser light source; 121-dichroic element; 122-dichroic element; 131-reflector; 171-wave plate; 200-light modulation assembly; 211-LCOS modulator; 212-LCOS modulator; 213-LCOS modulator; 221-dichroic element; 222-polarization beam splitter; 223-dichroic element; 300-projection lens; 41-dichroic element; 42-infrared image sensor; 51-handheld interactive device. DETAILED DESCRIPTION

[0059] In order to enable those skilled in the art to better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work should fall within the scope of protection of this application. In addition, although the disclosure in the present application is introduced according to one or several exemplary examples, it should be understood that each aspect of these disclosures can also constitute a complete technical solution separately. In the absence of conflict, the features in the following embodiments and embodiments can be combined with each other.

[0060] In this application, "at least one" means one or more, and "more" means two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships can exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the associated objects are in an "or" relationship. "Include" or "comprising" and similar words mean that the element or object appearing before the word includes the elements or objects listed after the word and their equivalents, but does not exclude other elements or objects. In addition, to facilitate the clear description of the technical solutions of the embodiments of the present application, the embodiments of the present application use words such as "first" and "second" to distinguish between identical or similar items with basically the same functions and effects. Those skilled in the art will understand that words such as "first" and "second" do not limit the quantity or execution order. The descriptions such as first and second in the embodiments of the present application are only for illustration and to distinguish the described objects. There is no distinction in order, nor does it indicate a special limitation on the number of devices in the embodiments of the present application, and cannot constitute any limitation on the embodiments of the present application. Terms such as "upper," "lower," "inner," "outer," "front," and "back" are used only to facilitate description and simplify the present application and do not have any suggestive or indicative meanings. Therefore, they should not be construed as limiting the present application. Furthermore, in this context, it should be understood that when an element is referred to as being "on" or "under" another element, it can be connected not only directly "on" or "under" the other element, but also indirectly "on" or "under" the other element through an intermediate element.

[0061] Throughout this application, words like "exemplarily" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described in this application as "exemplarily" or "for example" should not be construed as preferred or advantageous over other embodiments or designs. Rather, the use of words like "exemplarily" or "for example" is intended to present the relevant concepts in a concrete manner.

[0062] In order to fully understand the present application, a detailed description will be provided below to illustrate the technical solution of the present application. The preferred embodiments of the present application are described in detail below. However, in addition to these detailed descriptions, the present application may also have other implementation methods.

[0063] Figure 1 This is a schematic diagram of an application scenario provided by an embodiment of the present application. Figure 1 As shown, the projection system may include a light source component 100, a light modulation component 200 and a projection lens 300. The light source component 100 generates a light beam required for projection, and the light beam is incident on the light modulation component 200. The light modulation component 200 can modulate the light beam, and the modulated light is projected to the projection area (AB) through the projection lens 300.

[0064] Continue reading Figure 1 In the embodiment of the present application, a dichroic element 41 is introduced between the light modulation component 200 and the projection lens 300. The dichroic element 41 can transmit the output light of the light modulation component 200 and reflect infrared light. The output light of the light modulation component 200 is transmitted to the projection lens 300 through the dichroic element 41; the infrared light within the projection area enters the projection device and passes through the projection lens 300. The infrared light passing through the projection lens 300 is reflected by the dichroic element 41 to the infrared image sensor 42. By combining the image sensor with the light modulation device, the embodiment of the present application makes the projected image and the interactively captured image have the same coordinate system, reducing the algorithm complexity of image matching between different devices and saving computing resources.

[0065] It should be understood that a dichroic element (such as a dichroic mirror) transmitting the first light and reflecting the second light is equivalent to reflecting the first light and transmitting the second light. This is a characteristic of the dichroic element. Therefore, the dichroic element 41 described in the embodiment of the present application transmits the outgoing light of the light modulation component 200 and reflects infrared light, including the situation where the dichroic element 41 reflects the outgoing light of the light modulation component 200 and transmits infrared light.

[0066] When interaction is required, the user can use a handheld interactive device 51 that can emit infrared light (such as a laser pen) to illuminate the interactive position in the projection area. For example, the handheld interactive device 51 can emit infrared light with a wavelength of 0.75-2.5 microns. Optionally, the handheld interactive device 51 can also emit ordinary visible light. The ordinary visible light can be reflected to allow the user to see whether it is illuminated at the touch interaction position, and the infrared light is reflected to enter the projection lens 300.

[0067] The projection area and the light modulation component satisfy the object-image conjugate relationship. Therefore, in the projection device of the embodiment of the present application, the optical path from the image sensor to the projection surface and the optical path from the light modulation component to the projection surface are roughly the same, and there is no element that changes the light convergence angle or divergence angle on the different optical paths of the incident infrared light and the light emitted by the light modulation component.

[0068] After the infrared light emitted by the handheld interactive device 51 enters the projection lens 300, it is reflected by the dichroic element 41 to the infrared image sensor 42. The processor of the projection device can obtain the position of the handheld interactive device 51 by reading the acquisition results of the infrared image sensor 42. For example, the image obtained by the infrared image sensor 42 is shown as follows: Figure 2 As shown. Because the infrared light emitted by the handheld interactive device 51 hits point C, while other areas of the projection screen do not reflect infrared light, point C will read grayscale data containing infrared light. Furthermore, the infrared image sensor and the light modulation assembly use the same projection lens, thus achieving the same viewing angle as the projection surface. Therefore, the coordinate position of the infrared image sensor is proportional to the projected image. The position of point C in the image obtained by the infrared image sensor, as determined by the processor, is linearly related to the position of point C in the projected image. That is, the angles connecting point C and the image vertices (A1, B1, A2, and B2) are the same, and the distances are proportional. Optionally, the incident light from the spatial light modulator in the light modulation assembly can be perpendicular, and the infrared light can enter the infrared image sensor perpendicularly, simplifying the aforementioned proportional relationship. Based on the obtained position of point C and the projected image information (the projected image information is internal to the processor and does not need to be obtained externally via a camera), it is determined whether there is a module that responds to touch at that location in the projected image. If not, no response is performed. If so, the specified response action is performed according to the preset module response action.

[0069] The projection device in the embodiment of the present application can be a single-chip, two-chip or three-chip type, that is, the light modulation component 200 can include one spatial light modulator, two spatial light modulators or three spatial light modulators, such as Figure 3-Figure 5 As shown. The spatial light modulator in the embodiment of the present application can be an LCD panel, a DMD chip, an LCOS, etc. The following description is made by taking the spatial light modulator as an LCOS light modulator as an example.

[0070] See Figure 3 In a monolithic LCOS optical modulation assembly, laser light with an S-polarization state passes through a polarization beam splitter or a polarization beam splitter prism and is incident on the LCOS optical modulator for modulation. This converted reflected light into a P-polarization state is then emitted from the polarization beam splitter or the polarization beam splitter prism along a different optical path from the incident light and exits the projection lens. This example uses the incident S-polarization laser light as an example; the incident light can also be P-polarized light, and this description will not be repeated in this embodiment.

[0071] See Figure 4 In the two-chip LCOS optical modulation component, after the laser passes through the polarization beam splitter or polarization beam splitter prism, the laser with polarization state P and the laser with polarization state S are respectively incident on two mutually perpendicular LCOS optical modulators through transmission and reflection. After the polarization state is converted through modulation, it is reflected to the polarization beam splitter or polarization beam splitter prism.

[0072] See Figure 5 In a traditional three-chip LCOS optical modulator, laser light with an S-polarization state is separated into red, green, and blue light by a dichroic mirror. Each beam path passes through a polarization beam splitter or a polarization beam splitter prism before being incident on the LCOS optical modulator for modulation. The modulated light, converted to a P-polarization state, is then emitted from the polarization beam splitter or polarization beam splitter prism along a different optical path from the incident light and then exits the beam combining prism. After the combined optical paths, it is incident on the projection lens. This example uses the incident S-polarization laser light; the incident light can also be P-polarized light, and this description will not be repeated in this embodiment.

[0073] In some embodiments, the optical modulation component 200 may also be an enhanced three-chip LCOS optical modulation component, such as Figure 6-Figure 9 As shown. Figure 6-Figure 9In the illustrated embodiment, the light beam generated by the light source assembly 100 includes a first laser, a second laser, and a third laser, wherein the first laser, the second laser, and the third laser are lasers having a first wavelength, a second wavelength, and a third wavelength, respectively, and the first laser has a different polarization state than the second laser and the third laser. The first laser, the second laser, and the third laser can be selected from red laser, green laser, and blue laser, and the polarization states of the three can be selected from P-state and S-state. The light modulation assembly 200 includes three LCOS optical modulators, namely, LCOS modulator 211, LCOS modulator 212, and LCOS modulator 213, which modulate the first laser, the second laser, and the third laser, respectively. The light modulated by the LCOS modulator can have the same wavelength as the light before modulation, but the polarization states of the light before and after modulation will change. For example, after a red laser in the P-state is modulated by the LCOS modulator, a red laser in the S-state is obtained, after a green laser in the S-state is modulated by the LCOS modulator, a green laser in the P-state is obtained, and after a blue laser in the S-state is modulated by the LCOS modulator, a blue laser in the P-state is obtained. In these embodiments, the three-chip LCOS light modulation component does not require a beam splitter prism, which can reduce the volume of the light modulation component, and the dichroic element 41 can be embedded in the light modulation component 200, thereby further reducing the volume of the projection device.

[0074] like Figure 6As shown, the optical modulation component 200 includes an LCOS modulator 211, an LCOS modulator 212, an LCOS modulator 213, a polarization beam splitter 222, and a dichroic element 221. In this embodiment, the polarization beam splitter 222 is configured to transmit P-polarized light and reflect S-polarized light; the dichroic element 221 is configured to reflect green light and transmit blue light. The light beam provided by the light source assembly 100 is incident on the polarization beam splitter 222. The red laser light in the P-state is transmitted through the polarization beam splitter 222 and is incident on the LCOS modulator 211. The red laser light in the S-state is modulated by the LCOS modulator 211 and is reflected along the incident light path to the polarization beam splitter 222. The green laser light and the blue laser light in the S-state are reflected by the polarization beam splitter 222 to the dichroic element 221. The green light is reflected by the dichroic element 221 to the LCOS modulator 213. The green light is modulated by the LCOS modulator 213 to the green modulated light in the P-state and is reflected along the incident light path to the dichroic element 2 21, is reflected by the dichroic element 221 to the polarizing beam splitter 222, and is transmitted to the light outlet through the polarizing beam splitter 222; the blue light is transmitted by the dichroic element 221 to the LCOS modulator 212, modulated by the LCOS modulator 212 into blue modulated light in the P vibration state and reflected along the incident light path to the dichroic element 221, is transmitted by the dichroic element 221 to the polarizing beam splitter 222, and is transmitted to the light outlet through the polarizing beam splitter 222; the outgoing light of the polarizing beam splitter 222 is transmitted to the projection lens 300 through the dichroic element 41; the infrared light incident through the projection lens 300 is directly reflected by the dichroic element 41 to the infrared image sensor 42.

[0075] Continue reading Figure 6 , the polarization beam splitter 222 and the dichroic element 221 are arranged at a certain angle, that is, the planes where the surfaces of the polarization beam splitter 222 and the dichroic element 221 are located intersect, such as the planes where the surfaces of the two are perpendicular to each other, to optimize the light path. Optionally, the polarization beam splitter 222 is arranged in contact with the dichroic element 221, and further, the two can be arranged in an L-shape, but the angle between the two can be an acute angle, a right angle or an obtuse angle, thereby reducing the space required for the light modulation component 200. In other embodiments, the two can also be arranged separately. It should be noted that the surface of the element mentioned in the embodiment of the present application refers to the light incident surface or the light emitting surface of the element. In some embodiments, the light beam provided by the light source assembly 100 is incident on the polarization beam splitter 222 at an angle of 45 degrees, and further, the polarization beam splitter 222 is arranged perpendicular to the dichroic element 221. Optionally, the dichroic element 41 is arranged perpendicular to the polarization beam splitter 222, such as Figure 6 As shown, in other embodiments, the dichroic element 41 may also be arranged in parallel with the polarization beam splitter 222 , which is not limited in this embodiment of the present application.

[0076] See Figure 7The light modulation component 200 includes an LCOS modulator 211, an LCOS modulator 212, an LCOS modulator 213, a polarization beam splitter 222, and a dichroic element 221. In this embodiment, the dichroic element 221 is also used to reflect green light and transmit blue light. It should be noted that in other embodiments, the dichroic element 221 can also be used to transmit green light and reflect blue light. Figure 6 The difference between the illustrated embodiment and the polarization beam splitter 222 is that the polarization beam splitter 222 is used to transmit S-state polarized light and reflect P-state polarized light. That is, after the light beam provided by the light source assembly 100 is incident on the polarization beam splitter 222, green and blue laser lights will be transmitted through the polarization beam splitter 222, while only red laser light will be reflected, and the dichroic element 41 is embedded in the light modulation assembly 200.

[0077] Specifically, the light beam provided by the light source assembly 100 is incident on the polarization beam splitter 222, the red laser light in the P-state is reflected by the polarization beam splitter 222 and is incident on the dichroic element 41, and is transmitted to the LCOS modulator 211 at the dichroic element 41, and is modulated by the LCOS modulator 211 into the red modulated light in the S-state and is reflected along the incident light path to the dichroic element 41, and is transmitted to the polarization beam splitter 222 at the dichroic element 41, and is transmitted to the light outlet at the polarization beam splitter 222; the green laser light and the blue laser light in the S-state are transmitted through the polarization beam splitter 222 to the dichroic element 221, and the green light is reflected from the dichroic element 221 to the LCOS modulator 213, and is transmitted through the LCOS modulator 213 The green light is modulated into the P-state and reflected along the incident light path to the dichroic element 221, reflected by the dichroic element 221 to the polarization beam splitter 222, and reflected by the polarization beam splitter 222 to the light outlet. The blue light is transmitted through the dichroic element 221 to the LCOS modulator 212, modulated by the LCOS modulator 212 into the blue light in the P-state and reflected along the incident light path to the dichroic element 221, transmitted by the dichroic element 221 to the polarization beam splitter 222, and reflected by the polarization beam splitter 222 to the light outlet. The infrared light incident through the projection lens 300 is transmitted through the polarization beam splitter 222 to the dichroic element 41, and reflected by the dichroic element 41 to the infrared image sensor 42.

[0078] See Figure 8 The light modulation component 200 includes an LCOS modulator 211, an LCOS modulator 212, an LCOS modulator 213, a polarization beam splitter 222, and a dichroic element 221. Figure 6 Compared with the embodiment shown, the polarization beam splitter 222 and the dichroic element 221 in this embodiment have the same function, that is, the polarization beam splitter 222 is used to transmit P-state polarized light and reflect S-state polarized light, and the dichroic element 221 is used to reflect green light and transmit blue light. Figure 6The difference from the embodiment shown is that the polarization beam splitter 222 is arranged in parallel with the dichroic element 221, that is, the planes where the surfaces of the two are located are parallel to each other, and the position of the LCOS modulator is adaptively adjusted; and Figure 8 In the illustrated embodiment, the dichroic element 41 is embedded in the light modulation assembly 200. Only the optical path of the blue laser passes through the dichroic element 41. The infrared light incident through the projection lens 300 is transmitted through the polarization beam splitter 222 and the dichroic element 221 to the dichroic element 41, and then reflected by the dichroic element 41 to the infrared image sensor 42.

[0079] See Figure 9 The optical modulation component 200 includes an LCOS modulator 211, an LCOS modulator 212, an LCOS modulator 213, a polarization beam splitter 222, a dichroic element 221, and a dichroic element 223. In this embodiment, the polarization beam splitter 222 is configured to transmit P-polarized light and reflect S-polarized light; the dichroic element 221 is configured to reflect green and red light and transmit blue light; and the dichroic element 223 is configured to transmit green and red light and reflect blue light.

[0080] Specifically, the light beam provided by the light source assembly 100 is incident on the dichroic element 221, and the blue laser is transmitted to the polarization beam splitter 222. Since the blue laser is S-state polarized light, it is reflected from the polarization beam splitter 222 to the LCOS modulator 212, modulated into a blue modulated light of P vibration state by the LCOS modulator 212 and reflected along the incident light path to the polarization beam splitter 222, and transmitted to the dichroic element 223 at the polarization beam splitter 222, and reflected to the light outlet at the dichroic element 223; the red laser and the green laser are reflected from the dichroic element 221 to the polarization beam splitter 222, and since the green laser is S-state polarized light, it is reflected from the polarization beam splitter 222 to the LCOS modulator 212. The red laser light is modulated by the LCOS modulator 213 into a P-state green modulated light, which is reflected along the incident light path to the polarization beam splitter 222. The light is then transmitted through the polarization beam splitter 222 to the dichroic element 223, and then transmitted through the dichroic element 223 to the light outlet. Since the red laser light is P-state polarized light, it is transmitted through the polarization beam splitter 222 to the LCOS modulator 211. The red laser light is modulated by the LCOS modulator 211 into an S-state red modulated light, which is then reflected along the incident light path to the polarization beam splitter 222. The light is then reflected through the polarization beam splitter 222 to the dichroic element 223, and then transmitted through the dichroic element 223 to the light outlet. The light emitted from the dichroic element 223 is incident on the projection lens 300. In this embodiment, the infrared light can be directly reflected by the dichroic element 223. That is, the infrared light incident through the projection lens 300 is incident on the dichroic element 223, and then reflected from the dichroic element 223 to the infrared image sensor 42.

[0081] Continue reading Figure 9The dichroic element 221 and the dichroic element 223 are located on opposite sides of the polarizing beam splitter 222, and the planes on which the surfaces of the dichroic element 221 and the dichroic element 223 lie intersecting with the plane on which the surface of the polarizing beam splitter 222 lies. Furthermore, the planes on which the surfaces of the dichroic element 221 and the dichroic element 223 lie parallel to each other. Furthermore, the dichroic element 221 and the dichroic element 223 lie in the same plane, and the angle between the plane on which the dichroic element 221 and the dichroic element 223 lie and the plane on which the polarizing beam splitter 222 lies can be acute, right, or obtuse. Furthermore, the dichroic element 221 and the dichroic element 223 can be spliced ​​with the polarizing beam splitter 222 in an X-shaped arrangement. This can further reduce the volume of the light modulation assembly and facilitate assembly of the components. Optionally, the light beam provided by the light source assembly 100 may be incident on the dichroic element 221 at a 45-degree angle. Furthermore, the dichroic element 221 and the dichroic element 223 are respectively arranged on both sides of the polarization beam splitter 222 and perpendicular to the polarization beam splitter 222 to optimize the light path.

[0082] Optionally, in Figure 7-Figure 8 In the illustrated embodiment, the infrared light emitted by the handheld interactive device 51 is polarized infrared light. The polarized infrared light passes through the projection lens 300 and is incident on the polarization beam splitter 222 of the light modulation component. The polarization beam splitter 222 can be transmitted through the polarization beam splitter 222 and then reflected by the dichroic element 41 to the infrared image sensor 42.

[0083] Figure 10-12 This is a schematic diagram of the structure of the three light source components provided in the embodiment of the present application. The lasers emitted by the red laser light source 111, the green laser light source 112, and the blue laser light source 113 are combined by the dichroic elements 121 and 122. The combined three-color lasers can also pass through the converging lens, diffuser, diffuser wheel, and uniform light components before being incident on the light modulation component. Due to the different settings of the three light sources, the light paths of the light sources and the combined light paths may also be different, such as Figure 10 In the embodiment shown, the laser beams generated by the three light sources can be combined by using the dichroic elements 121 and 122. Figure 11 In the illustrated embodiment, the laser beams generated by the three light sources are combined by a reflective element 131 and light source dichroic elements 121 and 122. The dichroic element 121 can be a dichroic mirror that transmits red and reflects green, and the dichroic element 122 can be a dichroic mirror that transmits red and green but reflects blue.

[0084] Figure 10 and Figure 11In the embodiment shown, the laser light emitted by the red laser light source 111 is in the P oscillation state, and the laser light emitted by the green laser light source 112 and the blue laser light source 113 is in the S oscillation state. In some embodiments, the laser light emitted by the red laser light source 111, the green laser light source 112, and the blue laser light source 113 have the same polarization state. In this case, the polarization state of the laser light can be changed by using components such as wave plates, such as Figure 12 As shown, a half-wave plate 171 can be set in front of the red laser light source 111 to convert the S-state red laser light it emits into a P-state, so that the red laser light in the light beam incident on the optical modulation component 200 has a different polarization state than the green laser light and the blue laser light.

[0085] In some embodiments, the infrared image sensor may also be an infrared thermal imaging detector for collecting infrared light with a wavelength of 3-6 microns or a wavelength of 7-15 microns. For example, the infrared thermal imaging detector may be a thermistor infrared detector, a pyroelectric infrared detector, a thermopile infrared detector, or a microbolometer infrared detector, etc. The processor of the projection device can obtain the temperature of the detected object based on the medium-wave infrared or long-wave infrared data collected by the infrared thermal imaging detector. In the embodiment of the present application, it is assumed that a temperature higher than or equal to T = 30°C is defined as high temperature, and a temperature lower than T is defined as low temperature. The collected infrared image can be binarized and can be used to determine whether a human body is approaching. Usually, the human body temperature is higher than 30°C. Here, the value of T can also be adjusted according to external conditions such as season and room temperature to flexibly configure the recognition accuracy.

[0086] When a human body approaches from both sides of the projection, it can be obtained through the infrared thermal imaging detector Figure 13 The image shown in (a) is then binarized to obtain Figure 13 (b) As shown in the image. Thus, when a high-temperature object is detected entering the projection area, the projector processor can execute a preset operation, such as turning off the light source. When continuous detection shows that there is no high-temperature object in the projection area, the projector processor can execute a preset operation, such as turning on the light source.

[0087] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A projection device, characterized in that: The invention comprises a light source component, a light modulation component, a first dichroic element, an infrared image sensor and a projection lens, wherein: The light source assembly is used to generate the light beam required for projection; The light modulation component is used to modulate the light beam generated by the light source component, and the modulated light beam is projected to the projection area through the projection lens; The first dichroic element is used to transmit light of a wavelength corresponding to the modulated light of at least one spatial light modulator in the light modulation assembly and reflect infrared light; The infrared image sensor is used to collect infrared light from the first dichroic element; The modulated light of at least one spatial light modulator in the light modulation assembly is transmitted to the projection lens via the first dichroic element; the infrared light in the projection area is incident on the projection device and passes through the projection lens, and the infrared light passing through the projection lens is reflected by the first dichroic element to the infrared image sensor; The light beam generated by the light source assembly includes a first laser, a second laser, and a third laser, wherein the first laser, the second laser, and the third laser are lasers having a first wavelength, a second wavelength, and a third wavelength, respectively, and the first laser has a different polarization state than the second laser and the third laser; Alternatively, the light beam generated by the light source assembly includes a first laser, the first laser has a first polarization state, or the first laser has a first polarization state and a second polarization state, and the first polarization state is different from the second polarization state.

2. A projection device according to claim 1, characterized in that: The incident light of the spatial light modulator in the light modulation component is incident vertically, and the infrared light is incident vertically into the infrared image sensor.

3. The projection device according to claim 1, wherein: The light modulation component includes a first LCOS modulator, a second LCOS modulator, a third LCOS modulator, a first polarization beam splitter and a second dichroic element, wherein: The first LCOS modulator is used to modulate the first laser into a first modulated light and reflect the first modulated light to the first polarization beam splitter; The second LCOS modulator is used to modulate the second laser into a second modulated light and reflect the second modulated light to the second dichroic element; a third LCOS modulator configured to modulate the third laser light into a third modulated light and reflect the third modulated light to the second dichroic element; The first polarization beam splitter is used to guide the first laser light in the light beam provided by the light source assembly to the first LCOS modulator, and to guide the second laser light and the third laser light in the light beam provided by the light source assembly to the second dichroic element, and to guide the first modulated light, the second modulated light, and the third modulated light to be emitted in the same direction; The second dichroic element is used to guide the second laser light to the second LCOS modulator, guide the third laser light to the third LCOS modulator, and guide the second modulated light and the third modulated light to the first polarization beam splitter; The first modulated light, the second modulated light, and the third modulated light emitted by the first polarization beam splitter are all transmitted to the projection lens through the first dichroic element, and the infrared light passing through the projection lens is directly reflected to the infrared image sensor through the first dichroic element; or, one or both of the first modulated light, the second modulated light, and the third modulated light emitted by the first polarization beam splitter are transmitted to the projection lens through the first dichroic element, and the infrared light passing through the projection lens is transmitted to the first dichroic element through the first polarization beam splitter and then reflected to the infrared image sensor by the first dichroic element; or, one of the first modulated light, the second modulated light, and the third modulated light emitted by the first polarization beam splitter is transmitted to the projection lens through the first dichroic element, and the infrared light passing through the projection lens is transmitted to the first dichroic element through the first polarization beam splitter and the second dichroic element in sequence and then reflected to the infrared image sensor by the first dichroic element.

4. The projection device according to claim 3, characterized in that: The planes where the surfaces of the first polarizing beam splitter and the second dichroic element are located are perpendicular or parallel to each other, and the planes where the surfaces of the first dichroic element and the first polarizing beam splitter are located are perpendicular or parallel to each other.

5. The projection device according to claim 1, wherein: The light modulation component includes a first LCOS modulator, a second LCOS modulator, a third LCOS modulator, a second polarization beam splitter, a third dichroic element and a fourth dichroic element, wherein: The first LCOS modulator is used to modulate the first laser into a first modulated light and reflect the first modulated light to the second polarization beam splitter; The second LCOS modulator is used to modulate the second laser into a second modulated light and reflect the second modulated light to the second polarization beam splitter; The third LCOS modulator is used to modulate the third laser into a third modulated light and reflect the third modulated light to the second polarization beam splitter; The third dichroic element is used to guide the first laser light in the light beam provided by the light source assembly to the first optical path and incident on the second polarization beam splitter, and to guide the second laser light and the third laser light in the light beam provided by the light source assembly to the second optical path and incident on the second polarization beam splitter; The second polarization beam splitter is used to guide the first laser light to the first LCOS modulator, guide the second laser light to the second LCOS modulator, guide the third laser light to the third LCOS modulator, and guide the first modulated light, the second modulated light and the third modulated light to the fourth dichroic element; The fourth dichroic element is used to guide the first modulated light, the second modulated light and the third modulated light to be emitted in the same direction; The first modulated light, the second modulated light, and the third modulated light emitted by the fourth dichroic element are all transmitted through the first dichroic element to the projection lens, and the infrared light passing through the projection lens is directly reflected through the first dichroic element to the infrared image sensor; alternatively, the first dichroic element and the fourth dichroic element are the same dichroic element, and the infrared light passing through the projection lens is reflected through the fourth dichroic element to the second polarizing beam splitter, and then reflected from the second polarizing beam splitter to the infrared image sensor.

6. The projection device according to claim 5, characterized in that: The third dichroic element and the fourth dichroic element are located in the same plane, which is perpendicular to the plane where the surface of the second polarizing beam splitter is located, and the third dichroic element and the fourth dichroic element are located on opposite sides of the second polarizing beam splitter.

7. The projection device according to claim 1, characterized in that: The light beam generated by the light source assembly is incident at an angle of 45 degrees to the element in the light modulation assembly that receives the light beam.

8. The projection device according to claim 1, wherein: The infrared light in the projection area includes infrared light of 0.75-2.5 microns.

9. The projection device according to claim 8, characterized in that: The system further includes a first image processor configured to determine the user's active position based on the acquisition result of the infrared image sensor and the projection image information.

10. The projection device according to claim 8, characterized in that: The 0.75-2.5 micron infrared light includes infrared light with a polarization state.

11. The projection device according to claim 1, characterized in that: The infrared image sensor includes an infrared thermal imaging detector, which is used to collect infrared light with a wavelength of 3-6 microns or a wavelength of 7-15 microns; The projection device also includes a second image processor, which is used to obtain the temperature of the detected object based on the acquisition results of the infrared thermal imaging detector. If the obtained temperature of the detected object is higher than or equal to a preset threshold, the projection device is controlled to perform a first preset operation.

12. The projection device according to claim 11, characterized in that: The second image processor is further configured to: If the temperature of the detected object is continuously obtained to be less than the preset threshold, the projection device is controlled to perform a second preset operation.

13. An intelligent interaction method, characterized in that: The method is applied to the projection device according to any one of claims 1 to 12, and the method comprises: Acquiring infrared light collection results, where the infrared light includes infrared light emitted by a handheld interactive device; Determining the user's active position based on the acquisition results and the projection image information; A target operation is performed according to the user's action position.

14. The intelligent interaction method according to claim 13, characterized in that: The handheld interactive device also emits visible light.

Citation Information

Patent Citations

  • Image projection apparatus

    CN102621782A

  • Projection type image display device and control method of projection type image display device

    CN107077051A