A projector and a projection method

Abstract

Embodiments of the present application provide a projector and a projection method. The projector comprises a projection assembly and a shooting assembly. The projection assembly comprises a visible light path assembly and an invisible light path assembly. The projector is configured to: emit visible projection light through the visible light path assembly, the visible projection light being used to display user picture content on a target projection surface; emit invisible projection light through the invisible light path assembly, the invisible projection light being light invisible to human eyes, and the invisible projection light being used to display a calibration pattern on the target projection surface; and shoot part or all of the target projection surface through the shooting assembly to obtain a shooting image of the calibration pattern. The embodiments achieve the purpose of obtaining the shooting content of the calibration pattern without the user perceiving the calibration pattern, and further achieve the purpose of calculating the depth information on the basis of reducing the cost of the device.

Description

Technical Field

[0001] This application relates to the field of image projection technology, and in particular to a projector and projection method. Background Technology

[0002] A projector includes a projection component that emits projection light onto a target projection surface, displaying the user-selected content on that surface. In projector applications, the image quality of the displayed content on the target projection surface heavily depends on the control and adjustment of the projection parameters of the projection light. Almost all projectors rely on detecting depth information from the target projection surface to control projection parameters and enable more intelligent functions. A common method for depth information detection is to use a Time-of-Flight (TOF) sensor to measure the depth of multiple marker points on the target projection surface. However, TOF sensors are very expensive.

[0003] An improved detection method involves using a projection component as a structured light component to emit structured light onto a target projection surface. This structured light is then used to display a structured calibration pattern on the target projection surface. A camera then captures the calibration pattern to obtain an image. Depth information is then detected based on this image. Since the cost of the camera in a projector is significantly lower than that of a TOF sensor, cost reduction is possible. However, in this detection method, as well as other detection methods requiring depth information, the user will see the calibration pattern used for detection on the target projection surface, impacting the user experience. Summary of the Invention

[0004] This application provides a projector and projection method that enables depth information detection of a target projection surface without the user's view.

[0005] To achieve the above objectives, the embodiments of this application adopt the following technical solutions:

[0006] In a first aspect, a projector is provided, comprising a projection component and a capturing component. The projection component includes a visible light path component and an invisible light path component. The projector is used to: emit visible projection light through the visible light path component, the visible projection light being used to display user screen content on a target projection surface; emit invisible projection light through the invisible light path component, the invisible projection light being light invisible to the human eye, the invisible projection light being used to display a calibration pattern on the target projection surface; and capture images of part or all of the target projection surface using the capturing component to obtain captured images of the calibration pattern.

[0007] In this embodiment, a visible light path component and an invisible light path component are integrated into the projection component. The visible light path component generates visible light to project and display the user-selected content, while the invisible light path component generates invisible light to project and display the calibration pattern required for depth information calculation. The projection component emits visible projection light based on visible light to meet the user's viewing needs. Simultaneously, the projection component emits invisible projection light based on invisible light, displaying the calibration pattern on the target projection surface based on the invisible projection light. It should be noted that this invisible projection light is limited to being invisible to the human eye, but the wavelength information of this invisible projection light can still be obtained by imaging components such as camera components to achieve imaging and display. The camera component captures the calibration pattern to obtain the captured pattern, and depth information is detected and obtained based on the captured pattern. The above implementation has the following advantages: Advantage 1: The user's naked eye is unaware of the display of the calibration pattern. While the user is normally viewing the content, the projector can complete the depth information calculation based on the captured pattern of the calibration pattern. Advantage 2: In this implementation scheme, the camera component only needs to be able to capture and image invisible light. The cost of the imaging component is lower than that of a TOF sensor. Thirdly, this solution only requires minor modifications to a small portion of the optical path components in the projection component, resulting in low modification costs, low technical difficulty, and ease of implementation. Fourthly, by emitting invisible projection light from the projection component, high-resolution calibration images can be displayed, facilitating the acquisition of higher-resolution depth information images. High-resolution depth information images are beneficial for performing more complex calculations.

[0008] In one possible implementation, the projection component further includes a display component, wherein: an invisible light path component is used to provide invisible light to the display component, and a visible light path component is used to provide visible light to the display component; the display component is used to emit invisible projection light onto a target projection surface based on the invisible light, and to emit visible projection light onto the target projection surface based on the visible light. In this embodiment, the invisible light path component is integrated into the projection component and can reuse a display component with the visible light path component. The display component is a device within the projection component used to generate projection light capable of displaying different patterns based on the light signal provided by the light path component. In this embodiment, the invisible light path component and the visible light path component reuse a display component, resulting in minimal changes to the device structure of the projection component, low modification costs, and the reuse of the display component corresponding to the visible light path component to control the imaging of the invisible light generated by the invisible light path component allows the invisible projection light to have a variety of pattern designs.

[0009] In one possible implementation, the above-mentioned emission of invisible projection light onto the target projection surface based on invisible light, and emission of visible projection light onto the target projection surface based on visible light, includes: emitting invisible projection light and visible projection light intermittently through a display component. In this embodiment, when emitting invisible and visible projection light intermittently, if the switching frequency of the interval is fast, the visible projection light will always maintain continuous imaging display in human perception, without interrupting the user's viewing. Furthermore, in the case of intermittent emission, a high-speed camera can capture the intermittently displayed user image content and calibration content, thereby ensuring that the obtained calibration content is free from interference from the user image content, thus improving the accuracy and ease of depth information calculation.

[0010] In some examples, the display component includes a display panel, an emitting lens, and a first invisible light filter. The first invisible light filter is used to control the filtering state of invisible light. The aforementioned intermittent emission of invisible and visible projection light by the display component includes: controlling the operating state of the first invisible light filter so that invisible and visible light pass through the display panel at intervals; controlling the imaging content of the display panel to obtain invisible projection light based on the passed invisible light, or to obtain visible projection light based on the passed visible light; and emitting visible and invisible projection light through the emitting lens. In this embodiment, compared to the display component in a conventional projection component, the display component in this embodiment has an additional first invisible light filter. The first invisible light filter enables control of the intermittent emission of visible and invisible projection light. When the first invisible light filter controls visible light to pass through the display panel, the display panel generates visible projection light with visible information based on the visible light and emits the visible projection light through the emitting lens. When the first invisible light filter controls the invisible light to pass through the display panel, the display panel generates invisible projection light with calibration pattern information based on the invisible light, and emits the invisible projection light through the emitting lens.

[0011] In one possible implementation, a second invisible light filter is further provided on the imaging lens of the imaging component, which is used to filter out invisible light. The aforementioned emission of invisible projection light onto the target projection surface based on invisible light, and emission of visible projection light onto the target projection surface based on visible light, includes: simultaneously emitting invisible projection light through the display component and emitting invisible projection light through the display component. In this embodiment, by providing a second invisible light filter on the imaging lens of the imaging component, and filtering out invisible light through the second invisible light filter, the imaging component can capture the calibration pattern displayed by the invisible projection light without interference from other visible light.

[0012] In one possible implementation, depending on the projector selection, the projector can have different device structures. For example, the projector can be based on a liquid crystal display (LCD), a 3LCD combined with a monochrome laser, a 3LCD combined with a lamp, a digital light processing (DLP) projector, or an LCOS projector, etc. Based on different projector selections, when improving the optical engine of the projection components of these projectors, different structural designs can be made for the visible and invisible light path components in the projection components. This allows for the provision of visible and invisible light to the display components based on different optical path structures. Several exemplary design schemes are illustrated below:

[0013] Example 1: An invisible light path assembly includes an invisible light source and an invisible light mirror group. A visible light path assembly includes a visible light source and a visible light mirror group. The invisible light source generates invisible light; the invisible light mirror group processes the invisible light generated by the invisible light source before providing it to the display component; the visible light source generates visible light; the visible light mirror group processes the visible light generated by the visible light source before providing it to the display component. In this embodiment, independent visible and invisible light paths can be provided within the projection component to provide visible and invisible light to the display component, respectively.

[0014] Example 2: A broadband light source and a first filtering light component are multiplexed in the visible light path component and the invisible light path component. The broadband light source generates broadband light, the wavelength range of which includes both the wavelengths of invisible and visible light. The first filtering light component filters the broadband light to obtain invisible and visible light respectively and provides them to the display component. In this embodiment, a broadband light source can be multiplexed in the optical path structure to provide visible and invisible light, forming independent visible and invisible light paths respectively provided to the display component.

[0015] Example 3: A broadband light source and a second filtering light component are multiplexed in the visible light path component and the invisible light path component, wherein: the broadband light source component generates broadband light, the wavelength range of which includes the wavelengths of invisible light and visible light; the second filtering light component is used to filter the broadband light to obtain a mixed light of invisible and visible light and provide it to the display component; the display component is also used to: emit invisible projection light and visible projection light according to the filtered mixed light. In this embodiment of the application, a broadband light source can be multiplexed in the optical path structure to provide visible and invisible light, and the invisible light path is mixed in a visible light path to provide the mixed light to the display component.

[0016] In one possible implementation, the projector further includes a controller configured to adjust at least one parameter among the sharpness, size, and border shape of the user's screen content based on the captured image. In this embodiment, the controller can calculate depth information of the target projection surface based on the captured image and adjust the projection parameters of the visible projection light based on the calculated depth information, thereby enabling adjustment of at least one parameter among the sharpness, size, and border shape of the user's screen content to improve image quality.

[0017] In one possible implementation, the above-mentioned emission of visible and invisible projection light via the projection component includes: emitting visible projection light via the projection component; and emitting invisible projection light via the projection component in response to a preset correction trigger condition. In this embodiment, the projection component may first emit visible projection light, and after triggering the preset correction trigger condition, perform operations such as adjusting emission parameters based on the invisible projection light. For example, the preset correction trigger condition may be that at least one of the projector and the target projection surface has undergone displacement. This displacement may be based on a judgment made using a relevant gravity acceleration sensor, or on a judgment made using acquired depth information, etc.

[0018] In one possible implementation, when emitting visible and invisible projection light through the projection component, the projector is further configured to: increase the projection brightness of the visible projection light. In this embodiment, emitting invisible projection light inevitably interferes with the emission of visible projection light, resulting in a slight decrease in the imaging quality of the visible projection light. By increasing the projection brightness of the visible projection light, the imaging quality of the user screen content displayed by the visible projection light can be compensated to some extent.

[0019] In one possible implementation, the projector is also used to: identify a human body based on a captured image when a human body appears in the emission path of both visible and invisible projection light. In this embodiment, based on a multiplexed display component, the invisible projection light can carry image information, allowing a very high-resolution calibration pattern to be displayed on the target projection surface. The marker points in this calibration pattern can be very dense, and the captured image based on this calibration pattern can acquire very high-resolution depth information. Based on this very high-resolution depth information, the identification of a human body appearing in the emission path can be achieved.

[0020] In one possible implementation, after recognizing a human body from the captured image, the projector is further used to: adjust the brightness of the visible projection light or the imaging display range according to the location of the human body; or, perform human-computer interaction operations with the human body according to its location or posture. In this embodiment, after recognizing a human body, various smart device operations can be performed based on the recognized human body. For example, the smart device operation can be: adjusting the brightness of the visible projection light or the imaging display range according to the location of the human body to prevent projection light from hitting the human eye. For example, the device operation can be: performing human-computer interaction operations with the human body according to its location and / or posture. This human-computer interaction operation can be recognizing the human body's posture to perform related control operations on the projector, or it can be based on the recognized human body's posture to perform related game interactions, etc.

[0021] In some possible implementations, the invisible projection light is infrared light. In this embodiment, the human eye cannot see infrared light or light with wavelengths exceeding that of infrared light; therefore, light with wavelengths exceeding the infrared range can be used as an invisible light signal. However, wavelengths exceeding infrared can be harmful to the human body, and the requirements for the camera increase significantly when the wavelength exceeds a certain limit. Therefore, using infrared light as the invisible light ensures both its invisibility to the human eye and its sensory acquisition capability, while also guaranteeing user safety.

[0022] Secondly, embodiments of this application also provide a projection method applied to a projector. The projector includes a projection component and a shooting component. The projection component includes a visible light path component and an invisible light path component. The projection method includes: emitting visible projection light through the visible light path component, the visible projection light being used to display user screen content on a target projection surface; emitting invisible projection light through the invisible light path component, the invisible projection light being light invisible to the human eye, the invisible projection light being used to display a calibration pattern on the target projection surface; and capturing images of part or all of the target projection surface using the shooting component to obtain a captured image of the calibration pattern.

[0023] In one possible implementation, the projection component further includes a display component, wherein: the invisible light path component is used to provide invisible light to the display component, and the visible light path component is used to provide visible light to the display component; the display component is used to emit invisible projection light to the target projection surface based on the invisible light, and to emit visible projection light to the target projection surface based on the visible light.

[0024] In one possible implementation, the above-mentioned emission of invisible projection light to the target projection surface based on invisible light and emission of visible projection light to the target projection surface based on visible light includes: emitting invisible projection light and visible projection light at intervals through the display components.

[0025] In one possible implementation, the imaging lens of the capturing component is further provided with a second invisible light filter, which is used to filter out invisible light. The aforementioned emission of invisible projection light onto the target projection surface based on invisible light, and emission of visible projection light onto the target projection surface based on visible light, includes: simultaneously emitting invisible projection light through the display component and emitting invisible projection light through the display component.

[0026] In one possible implementation, the method further includes adjusting at least one parameter among the sharpness of the user screen content, the screen size, and the border shape, based on the captured image.

[0027] In one possible implementation, the above-mentioned emission of visible and invisible projection light through the projection component includes: emitting visible projection light through the projection component; and emitting invisible projection light through the projection component in response to a preset correction trigger condition.

[0028] In one possible implementation, when emitting visible and invisible projection light through the projection component, the method further includes: increasing the projection brightness of the visible projection light.

[0029] Regarding the technical principles and beneficial effects of the second aspect mentioned above, please refer to the relevant description of the first aspect mentioned above, which will not be repeated here. Attached Figure Description

[0030] Figure 1 This is a schematic diagram of the structure of a projector provided in an embodiment of this application;

[0031] Figure 2 This is a schematic diagram of the structure of a first projector provided in an embodiment of this application;

[0032] Figure 3 This is a schematic diagram of the structure of a second projector provided in an embodiment of this application;

[0033] Figure 4 A schematic diagram of the structure of a third projector provided in this application embodiment. Figure 1 ;

[0034] Figure 5 A schematic diagram of the structure of a third projector provided in this application embodiment. Figure 2 ;

[0035] Figure 6 A schematic diagram of the structure of a third projector provided in this application embodiment. Figure 3 ;

[0036] Figure 7 A schematic diagram of the structure of a third projector provided in this application embodiment. Figure 4 ;

[0037] Figure 8 A schematic diagram of the structure of a third projector provided in this application embodiment. Figure 5 ;

[0038] Figure 9 This is a schematic diagram of the projection component of a single LCD projector provided in an embodiment of this application;

[0039] Figure 10 A schematic diagram of the projection component in a projector combining a 3LCD and a monochromatic laser, provided in an embodiment of this application;

[0040] Figure 11 A schematic diagram of the projection component in a projector that combines a 3LCD with a broadband lamp, provided as an embodiment of this application;

[0041] Figure 12 This is a schematic diagram of the structure of a projection component in a DLP projector provided in an embodiment of this application;

[0042] Figure 13 A schematic diagram of the structure of a third projector provided in this application embodiment. Figure 6 ;

[0043] Figure 14 A schematic diagram of the structure of a third projector provided in this application embodiment. Figure 7 ;

[0044] Figure 15 A schematic diagram illustrating the changes in wavelength and transmittance of visible light and invisible infrared light of different colors, provided for embodiments of this application;

[0045] Figure 16 A schematic diagram of the structure of a third projector provided in this application embodiment. Figure 8 ;

[0046] Figure 17 A flowchart illustrating a projection method provided in this application embodiment. Figure 1 ;

[0047] Figure 18 A flowchart illustrating a projection method provided in this application embodiment. Figure 2 ;

[0048] Figure 19 A flowchart illustrating a projection method provided in this application embodiment. Figure 3 . Detailed Implementation

[0049] It should be noted that the terms "first" and "second" used in the embodiments of this application are only used to distinguish features of the same type and should not be construed as indicating relative importance, quantity, order, etc.

[0050] The terms "exemplary" or "for example" used in the embodiments of this application are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in this application should not be construed as being more preferred or advantageous than other embodiments or designs. Specifically, the use of terms such as "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0051] The terms "coupling" and "connection" used in the embodiments of this application should be interpreted broadly. For example, they can refer to a physical direct connection or an indirect connection achieved through electronic devices, such as a connection achieved through resistors, inductors, capacitors or other electronic devices.

[0052] Figure 1 An exemplary projector 1000 is provided, comprising a projection component 100. The projector 1000 is used to: acquire data information of user-selected screen content; and generate and emit projection light based on the user screen content data. The projection light is emitted onto a target projection surface T to display the user screen content on the target projection surface T. In practical applications, the emission parameters of the projection light affect the image quality of the user screen content. For example, depending on the relative distance between the projector 1000 and the target projection surface T, the projection focal length of the emitted projection light needs to be adjusted to adjust the sharpness of the projected user screen content. Depending on the relative distance and relative angle between the projector 1000 and the target projection surface T, the projection imaging angle of the emitted projection light needs to be adjusted to adjust the shape of the image border of the projected user screen content, for example, adjusting from a distorted trapezoidal border to a regular rectangular or square border. Therefore, a change in the pose of at least one of the projector 1000 and the target projection surface T will affect the image quality of the projection. To ensure the quality of the projected image, the projector 1000 and the target projection surface T should typically be kept as still as possible.

[0053] In some possible implementations, when the relative orientation between the projector 1000 and the target projection surface T changes, the emission distance, emission angle, and image size of the projection light emitted by the projection component 100 of the projector 100 on the target projection surface T will all change. A change in emission distance can cause the current projection focal length to become mismatched, resulting in a blurry projection image. Simultaneously, a change in emission distance can also cause a change in image size; a larger emission distance may cause the image to exceed the range of the target projection surface T, while a smaller emission distance may cause the image to become smaller. A change in emission angle may prevent the projection light from forming a complete image on the target projection surface T; a change in emission angle may also cause distortion in the shape of the image, for example, a regular image with rectangular or square edges may become trapezoidal.

[0054] To control and adjust the projection parameters of a projector under various conditions, it is typically necessary to detect and calculate the depth information of the target projection surface T. The projection parameters are then adjusted based on the obtained depth information. The following description uses a first projector and a second projector as examples to illustrate this depth information calculation:

[0055] Figure 2 An exemplary first projector 1000A is provided, comprising a first projection component 100A and a time-of-flight (TOF) sensor 200A. The first projection component 100A emits projection light toward a target projection surface T. The projection light is used to display user content on the target projection surface T. The time-of-flight sensor 200A emits detection signals toward multiple marker points on the target projection surface T and acquires echo signals generated by the reflection of the detection signals from the marker points on the target projection surface T. Based on the time of flight of the detection signals and echo signals in space, distance information between the first projector 1000A and the multiple marker points on the target projection surface T can be obtained. This distance information can be characterized as the depth information of the target projection surface T. After acquiring the depth information, the first projector 1000A can adjust and control the projection parameters during projection to achieve high imaging quality of the projection light on the target projection surface T.

[0056] But Figure 2 In the illustrated embodiment, the depth information acquisition accuracy of the first projector 1000A is related to the marker points set on the target projection surface T. The time-of-flight sensor 200A has a high device cost, and the device cost increases significantly with the number of marker points. Many mid-to-low-priced projectors on the market do not include a time-of-flight sensor 200A based on TOF detection. Therefore, this solution is not applicable to projectors at all price points.

[0057] Figure 3 An exemplary second projector 1000B is provided, comprising a second projection component 100B and a camera 200B. The second projection component 100B serves not only as a projection component for projecting user-selected content but also as a structured light component for emitting a structured light pattern. Based on the projection structured light emitted by the second projection component 100B, a calibration pattern is displayed on a target projection surface T. The camera 200B captures an image of the calibration pattern on the target projection surface T, obtaining an imaged pattern. Based on the data information of the calibration pattern in the imaged pattern and the data information about the calibration pattern known by the second projector 1000B when emitting the projection structured light, depth information of the calibration pattern can be detected, thereby achieving depth information detection of the target projection surface T.

[0058] But Figure 3 In the illustrated implementation, the calibration pattern generated by the projected structured light is visible to the user, which can affect the user's viewing of the selected user screen content and reduce the user's viewing experience.

[0059] To achieve depth information detection and processing without interrupting the user's viewing experience while reducing device costs, embodiments of this application also provide a third projector, such as... Figure 4 As shown, the third projector 1000C includes a third projection component 100C and an imaging component 200C. The third projection component 100C includes a visible light path component 110C and an invisible light path component 120C. The third projector 1000C is used to: emit visible projection light through the visible light path component 110C, which is used to display user screen content on the target projection surface T; emit invisible projection light through the invisible light path component 120C, which is invisible to the human eye, and is used to display a calibration pattern on the target projection surface T; and capture images of part or all of the target projection surface T through the imaging component 200C to obtain an image of the calibration pattern.

[0060] In this application, Figure 4In the illustrated embodiment, a visible light path component 110C and an invisible light path component 120C are integrated into the third projection component 100C. The visible light path component 110C generates visible light to project and display the user-selected content, while the invisible light path component 120C generates invisible light to project and display the calibration pattern required for depth information calculation. The third projection component 100C emits visible projection light based on visible light to meet the user's viewing needs. Simultaneously, the third projection component 100C emits invisible projection light based on invisible light, displaying the calibration pattern on the target projection surface T based on this invisible projection light. It should be noted that this invisible projection light is limited to being invisible to the human eye; however, the wavelength information of this invisible projection light can still be acquired by imaging components such as the imaging component 200C to achieve imaging and display. The imaging component 200C captures the calibration pattern to obtain an image, and then uses this image to detect and acquire depth information. The above implementation method has the following advantages: Advantage 1: The user's naked eye is unaware of the displayed calibration pattern. While the user is normally viewing the content on the screen, the third projector 1000C can complete the depth information calculation based on the captured calibration pattern. Advantage 2: In this implementation scheme, the imaging component 200C only needs to be able to capture and image invisible light. The component cost of the imaging component 200C is lower than that of a TOF sensor. Advantage 3: This scheme only requires minor improvements to a small portion of the optical path components in the third projection component 100C, resulting in low improvement costs, low technical difficulty, and ease of implementation. Advantage 4: Based on the invisible projection light emitted by the third projection component 100C, a high-resolution calibration image can be displayed using invisible projection light, facilitating the acquisition of a higher resolution depth information image. A high-resolution depth information image is beneficial for performing more complex calculations.

[0061] It should be noted that the name of the invisible light path component 120C does not limit the structure of the component to be invisible, but rather limits the purpose of the component to generate invisible light that is invisible to the human eye and to perform optical processing on the invisible light.

[0062] In some possible implementations, such as Figure 5 As shown, the third projection component 100C further includes a display component 130C, wherein: an invisible light path component 120C is used to provide invisible light to the display component 130C, and a visible light path component 110C is used to provide visible light to the display component 130C. The display component 130C is used to emit invisible projection light to the target projection surface T based on the invisible light, and to emit visible projection light to the target projection surface T based on the visible light. In this application, as... Figure 5In the illustrated embodiment, the invisible light path component 120C is integrated into the third projection component 100C, and can share a display component 130C with the visible light path component 110C. The display component 130C is a device within the projection component used to generate projection light capable of displaying different patterns based on the light signals provided by the light path components. In this embodiment, the invisible light path component 120C and the visible light path component 110C share a display component 130C, resulting in minimal changes to the device structure of the projection component and low modification costs. Furthermore, by sharing the display component 130C corresponding to the visible light path component 110C to control the imaging of the invisible light generated by the invisible light path component 120C, the invisible projection light can have a variety of pattern designs.

[0063] For example, based on the display component 130C, the generated invisible projected light can be made to display different calibration patterns. In some examples, the calibration pattern can be a dot pattern, a line pattern, a checkerboard pattern, and a random speckle pattern, etc. The calibration pattern can also be a pattern with arbitrary graphic elements, etc.

[0064] In some possible implementations, such as Figure 6 As shown, the third projector 1000C also includes a controller 300C. The controller 300C is connected to both the third projection component 100C and the imaging component 200C. The controller 300C is used to: control the third projection component 100C to emit visible projection light through the visible light path component 110C and invisible projection light through the invisible light path component 120C; and control the imaging component 200C to capture images of part or all of the target projection surface T, obtaining images of the calibration pattern. The controller 300C calculates the depth information of the target projection surface T based on the captured images of the calibration pattern, and adjusts the emission parameters of the third projection component 100C based on the calculation results to maintain high imaging quality for the user screen content on the target projection surface T.

[0065] In some possible implementations, the controller 300C can control the display component 130C to emit visible and invisible projection light simultaneously, or it can control the display component 130C to emit visible and invisible projection light at intervals.

[0066] In some examples, when invisible and visible projection light are emitted at intervals through the display component 130C, some adaptive improvements can be made to the display component 130C of the third projection component 100C. For example... Figure 7As shown, the display assembly 130C includes a display panel 131C, an emitting lens 132C, and a first invisible light filter 133C. The first invisible light filter 133C is used to control the filtering state of invisible light. The display assembly 130C emits invisible projection light and visible projection light at intervals, including: controlling the operating state of the first invisible light filter 133C so that invisible light and visible light pass through the display panel 131C at intervals; controlling the imaging content of the display panel 131C to obtain invisible projection light based on the passed invisible light, or to obtain visible projection light based on the passed visible light; and emitting visible projection light and invisible projection light through the emitting lens 132C. In this application, as shown... Figure 7 In the illustrated embodiment, compared to the display component within a conventional projection component, the display component 130C of this application embodiment includes a first invisible light filter 133C. The first invisible light filter 133C controls the interval emission of visible and invisible projection light. When the first invisible light filter 133C controls visible light to pass through the display panel 131C, the display panel 131C generates visible projection light with visible information based on the visible light and emits the visible projection light through the emitting lens 132C. When the first invisible light filter 133C controls invisible light to pass through the display panel 131C, the display panel 131C generates invisible projection light with calibration pattern information based on the invisible light and emits the invisible projection light through the emitting lens 132C.

[0067] For example, the controller 300C can control the operating state of the first invisible light filter 133C. This application does not limit the filtering properties of the first invisible light filter 133C to filtering through invisible light or visible light, or filtering out invisible light or visible light. In practical applications, any scheme that can be designed to control the intermittent passage of both types of light is included within the scope of protection of this application.

[0068] For example, the first invisible light filter 133C can have different states, and its filtering can be controlled to pass or block a certain amount of light, or to pass or not block a certain amount of light, etc. The control method can be to adjust the first invisible light filter 133C using mechanical devices, placing it in different polarization states to achieve filtering or passing. The control method can also be voltage signal control, using different voltage signals to control changes in its state. Generally, voltage control is faster than mechanical control.

[0069] In some examples, when display component 130C emits both visible and invisible projection light simultaneously, the imaging component 200C needs to identify the calibration pattern displayed by the invisible projection light and avoid interference from the user screen content displayed by the visible projection light. In this case, such as... Figure 8 As shown, the imaging lens of the imaging component 200C is also equipped with a second invisible light filter 210C, which is used to filter out invisible light. In this application... Figure 8 In the embodiment shown, by setting a second invisible light filter 210C on the imaging acquisition lens of the imaging component 200C, the invisible light is filtered through by the second invisible light filter 210C, so that the imaging component 200C can capture the calibration pattern displayed by the invisible projection light without interference from other visible light.

[0070] In some possible implementations, the third projector 1000C can have different device structures depending on the projector selection. For example, the third projector 1000C can be a projector based on a single liquid crystal display (LCD), a projector based on 3LCD combined with a monochrome laser, a projector based on 3LCD combined with a lamp, a projector using digital light processing (DLP), or an LCOS projector, etc. Examples of different projector selections are given below:

[0071] Example 1: Using a single-LCD projector as an example, such as... Figure 9 The diagram shows a schematic of the projection assembly of a single LCD projector, which includes a visible light path assembly and a display assembly. The visible light path assembly includes a visible light source and a visible light mirror group. The single LCD projector uses a white LED lamp as the visible light source to generate visible light. The visible light mirror group includes a first total internal reflection mirror 1A. The first total internal reflection mirror reflects the visible light, allowing it to reach the display assembly. The display assembly includes a first Fresnel lens 1B, a polarizing mirror 2B, an LCD display screen 3B, a second Fresnel lens 4B, a main lens 5B, and a second total internal reflection mirror 6B. Both the first Fresnel lens 1B and the second Fresnel lens 4B are Fresnel lenses, used for light collimation and spot uniformity. The polarizing mirror 2B controls the polarization of the light signal transmitted by the first Fresnel lens to the LCD display screen 3B. The LCD display screen 3B is the display panel 131C described in the above embodiment. The main lens 5B and the second total internal reflection mirror 6B are the same as described above. Figure 7 The device included in the transmitting lens 132C described in the illustrated embodiment.

[0072] Example 2: An illustration using a 3LCD projector combined with monochrome laser technology, such as... Figure 10 As shown, a 3LCD projector combining a monochromatic laser includes a monochromatic laser source 1C, a phosphor 2C, a lens 3C, a first color separator 4C, a second color separator 5C, a first reflector 6C, a second reflector 7C, a third reflector 8C, an LCD panel 9C, and an emitting lens 10C. The monochromatic laser source 1C and the phosphor 2C serve as light sources; the monochromatic laser source 1C can be a blue laser, etc. The monochromatic laser source 1C projects light onto the phosphor 2C, causing the phosphor 2C to emit light of the corresponding wavelength. The phosphor can emit a broad spectrum of visible light, including wavelengths of visible colors such as red, green, and blue, which is transmitted to the lens 3C. The lens 3C transmits the transmitted visible light to the first color separator 4C, which separates the visible light corresponding to the wavelength of the first color and transmits it to the first reflector 6C, while transmitting the visible light corresponding to wavelengths of other colors to the second color separator 5C. The first reflector 6C transmits the received visible light corresponding to the first color to the panel corresponding to the first color on the LCD panel 9C. The second color separator 5C separates visible light of the wavelength corresponding to the second color onto the LCD panel 9C corresponding to the second color, and transmits visible light of the wavelength corresponding to the third color to the second reflector 7C. The second reflector 7C reflects the received visible light of the third color to the third reflector 8C, which then transmits the visible light of the third color to the LCD panel 9C corresponding to the third color. The LCD panel 9C controls the visible light of the corresponding color received by different panels to pass through their display panels, thus obtaining the projected light formed by the visible light, which is then emitted through the emitting lens 10C. For example, the monochromatic laser can be a blue laser. The first color of visible light can be red visible light, the second color can be green visible light, and the third color can be blue visible light. The LCD panel 9C is as described above. Figure 7 The embodiment shown describes a display panel 131C. The emitting lens 10C is the same as described above. Figure 7 The illustrated embodiment describes the transmitting lens 132C.

[0073] Example 3: An explanation using a 3LCD projector combined with a bulb, such as... Figure 11 As shown, compared to 3LCD combined with monochromatic laser, the main difference in projectors combining 3LCD with a lamp is the use of a broadband lamp 11C as the light source, producing broadband light. Its subsequent stages can employ similar... Figure 10 The 3LCD shown combines the first color separator 4C, the second color separator 5C, the first reflector 6C, the second reflector 7C, the third reflector 8C, the LCD panel 9C, and the emitting lens 10C in the monochromatic laser to generate and emit projection light. The specific principle will not be elaborated here.

[0074] Example 4: Using a DLP projector as an example, such as... Figure 12 As shown, the DLP projector includes a lamp 1D, a first lens 2D, a color wheel 3D, a second lens 4D, a digital micromirror device (DMD) chip 5D, and a projection lens assembly 6D. The lamp 1D provides a broadband visible light source. The lens 2D processes the broadband visible light and transmits it to the color wheel 3D. The color wheel 3D rapidly switches between different filters to filter the broadband visible light to obtain visible light of corresponding wavelengths and colors, which is then transmitted to the DMD chip 5D via the second lens 4D. The DMD chip 5D generates projection light based on the acquired visible light and transmits it to the projection lens assembly 6D. The projection lens assembly 6D emits the projection light. In this scheme, the projection lens assembly 6D is the emitting lens 132C described in the above embodiment, and the DMD chip 5D is the display panel 131C described in the above embodiment. The lamp 1D, lens 2D, and color wheel 3D are components within the visible light path assembly 110C mentioned in the above embodiment.

[0075] Depending on the selected projector, when improving the optical mechanism of the projection components of these projectors, different structural designs can be made for the visible light path component 110C and the invisible light path component 120C in the third projection component 100C, so as to provide visible light and invisible light to the display component 130C based on different optical path structures. The following are some exemplary design schemes for illustration:

[0076] Example 1: An independent visible light path and an invisible light path can be set up in the optical path structure. For example... Figure 13 As shown, the invisible light path assembly 120C includes an invisible light source 121C and an invisible light mirror group 122C; the visible light path assembly 110C includes a visible light source 111C and a visible light mirror group 112C. Specifically: the invisible light source 121C generates invisible light; the invisible light mirror group 122C processes the invisible light generated by the invisible light source 121C and provides it to the display assembly 130C; the visible light source 111C generates visible light; and the visible light mirror group 112C processes the visible light generated by the visible light source 111C and provides it to the display assembly 130C.

[0077] For example, taking the third projector 1000C as an example, based on the above... Figure 9 Taking a projector with a single liquid crystal display (LCD) as an example, it can be used to... Figure 9 The white LED lamp of the single LCD projector in the middle is used as Figure 13 The visible light source 111C shown will Figure 9 The first total internal reflection mirror 1A, etc., is used as a component within the visible light mirror group 112C. Then, in Figure 9 Based on the structure shown, an additional invisible light source 111C can be added to generate invisible light. Similarly, when Figure 7 The implementation shown is applied in Figure 9 In the illustrated embodiment, it is possible to Figure 9 The structure shown adds an additional layer below the LCD display 3B. Figure 7 The first invisible light filter 133C described in the embodiment.

[0078] For example, taking the third projector 1000C as an example, based on the above... Figure 12 Taking the DLP projector shown as an example, it can be used to... Figure 12 The light bulb 1D, the first lens 2D, and the color wheel 3D described are as follows: Figure 13 The device within the visible light source 111C described in the illustrated embodiment will... Figure 12 The second lens 5D described is as Figure 13 The device within the visible light mirror assembly 112C described in the illustrated embodiment. And... Figure 12 Based on the existing structure, an additional invisible light source 121C that generates an invisible light source and an invisible light mirror group 122C that processes the invisible light are added to form an invisible light path independent of the visible light path. Figure 12 The DMD chip 5D recorded is... Figure 13 The device described is located within the display component 130C.

[0079] Similarly, the above Figure 10 and Figure 11 In the illustrated embodiment, an additional invisible light source 121C and an invisible light mirror group 122C can also be provided to form Figure 13 The independent invisible light path described in the illustrated embodiment provides invisible light to the display component 130C; the specific implementation method will not be repeated here.

[0080] Example 2: In the optical path structure, a broadband light source can be reused to provide both visible and invisible light, forming independent visible and invisible light paths respectively, which are then supplied to the display component 130C. For example... Figure 14 As shown, the visible light path component 110C and the invisible light path component 120C reuse a broadband light component C1 and a first filter light component C2, wherein: the broadband light component C1 is used to generate broadband light, the wavelength range of which includes the wavelengths of invisible light and visible light. The first filter light component C2 is used to filter the broadband light to obtain invisible light and visible light respectively and provide them to the display component 130C.

[0081] In this embodiment of the application, visible light includes visible red light, visible green light, and visible blue light, and invisible light is infrared light, for example. Figure 15The image shows the transmission spectrum of the LCD color filter for each wavelength of light. Figure 15 The horizontal axis represents wavelength (in nm), and the vertical axis represents transmittance. Line ① represents the transmittance of visible blue light, line ② represents the transmittance of visible green light, line ③ represents the transmittance of visible red light, and line ④ represents the transmittance of infrared light. It is evident that to ensure the broadband optical component C1 can properly provide RGB visible light and invisible infrared light, the wavelength range of the broadband light can be between 600-1300 nm, encompassing both visible and invisible infrared light within this range. In some examples, the infrared wavelength can be 660 nm, 800 nm, 850 nm, and 940 nm, etc. Figure 14 In the illustrated embodiment, broadband light is generated based on broadband light component C1, and filtered based on first filter light component C2 to obtain discrete visible light and invisible light, which are then provided to display component 130C.

[0082] For example, to in Figure 10 Improvements are made to the implementation method to obtain Figure 14 Taking the structure shown as an example, we can... Figure 10 The monochromatic laser source 1C and phosphor 2C are used as Figure 14 In the illustrated embodiment, the broadband optical component C1, by adding fluorescence for exciting infrared light to the phosphor 2C, can generate infrared light, which is invisible light. Figure 10 The first dichroic separator 4C, the second dichroic separator 5C, the first reflector 6C, the second reflector 7C, and the third reflector 8C, etc., are used as... Figure 14 The visible light path component 110C in the illustrated embodiment. Figure 10 Based on the structure shown, an additional invisible light path assembly 120C, formed by a dichroic filter and a reflector, is added to separate infrared light from the visible light path assembly 110C formed by the first dichroic filter 4C, the second dichroic filter 5C, the first reflector 6C, the second reflector 7C, and the third reflector 8C, and to provide the infrared light to... Figure 10 At position 9C on the LCD panel. Figure 14 The first filter optical component C2 includes Figure 10 The first color separator 4C, the second color separator 5C, the first reflector 6C, the second reflector 7C, the third reflector 8C, and the newly added color separator and reflector for separating infrared light in this embodiment are described. Figure 10 The LCD panel 9C in the middle is as Figure 14 The display panel in the display component 130C shown.

[0083] For example, to in Figure 11 Improvements are made to the implementation method to obtain Figure 14 Taking the structure shown as an example, we can... Figure 11Broad-spectrum light bulbs as Figure 14 The broadband optical component C1 described in the embodiments. Regarding the... Figure 11 Improvements were made to the optical path components to obtain Figure 14 For a description of the contents of the separate visible light path component 110C and invisible light path component 120C shown above, please refer to the above description. Figure 10 Improvements were made to the optical path components to obtain Figure 14 The descriptions of the discrete visible light path component 110C and invisible light path component 120C shown will not be repeated here.

[0084] Example 3: In the optical path structure, a broadband light source can be reused to provide both visible and invisible light, and the invisible light path can be mixed into a single visible light path to provide the mixed light to the display component 130C. For example... Figure 16 As shown, the visible light path component 110C and the invisible light path component 120C reuse the broadband light component C1 and the second filtering light component C3. The broadband light component C1 generates broadband light, the wavelength range of which includes both the wavelengths of invisible and visible light. The second filtering light component C3 filters the broadband light to obtain a mixture of invisible and visible light and provides it to the display component 130C. The display component 130C is also used to emit invisible and visible projection light based on the filtered mixture. In this embodiment, the visible light path component can be reused as the invisible light path component, directly providing the mixed light to the display component 130C. The display component 130C can separate the visible and invisible light in the mixed light and then transmit visible and invisible projection light with different patterns respectively.

[0085] For example, to in Figure 10 and Figure 11 Improvements were made to the illustrated implementation to obtain Figure 16 Taking the structure shown as an example, in Figure 10 and Figure 11 The description of setting the broadband optical component C1 in the embodiments can be found in the relevant descriptions of the above embodiments, and will not be repeated here. Figure 10 and Figure 11 In the illustrated embodiment, the first dichroic filter 4C, the second dichroic filter 5C, the first reflector 6C, the second reflector 7C, and the third reflector 8C can be reused as the second filtering optical component C3. Infrared light can be mixed in... Figure 10 and Figure 11 In the illustrated embodiment, the first color of visible light can also be mixed with the second color of visible light, or mixed with the third color of visible light. In this case, Figure 16 The second filtering optical component C3 described in the embodiments may include Figure 10 and Figure 11The embodiments described include a first dichroic filter 4C, a second dichroic filter 5C, a first reflector 6C, a second reflector 7C, and a third reflector 8C. To ensure the normal transmission of the mixed light, it is only necessary to adaptively design the filtering parameters of the dichroic filters and other devices in the optical path corresponding to the mixed light.

[0086] The above application regarding Figure 9 , Figure 10 , Figure 11 , Figure 12 , Figure 13 , Figure 14 and Figure 16 The description of the embodiments shown is merely a limited number of illustrative examples of improvements to the optical engine of the third projection component 100C of the third projector 1000C, and should not be construed as limiting the implementation of this application. In practical applications, more flexible designs can be adopted based on considerations such as the availability of more device options and design choices.

[0087] In some possible implementations, based on the aforementioned third projector 1000C, the following can be achieved: Figure 17 The projection method shown includes the operations of steps S100A-S200:

[0088] S100A emits visible projection light through visible light path component 110C.

[0089] S100B emits invisible projection light through invisible light path component 120C.

[0090] In this embodiment, the order of steps S100 and S200 is not limited. In some examples, the third projector 1000C can emit visible and invisible projection light simultaneously; it can also emit one type of projection light first, followed by another; it can also emit one type of projection light first, followed by both types simultaneously; or it can emit two different types of projection light at intervals. This embodiment uses visible projection light to meet the user's viewing needs, and uses invisible projection light to display a calibration pattern for depth information calculation.

[0091] In some possible implementations, when invisible and visible projection light are emitted through the display component 130C, related control operations can be performed based on the controller 300C in the third projector 1000C. For example, the display control of the display component 130C can be implemented based on the controller 300C to control the invisible and visible projection light to display the same or different images. In this embodiment, reusing the display component 130C in the third projection component 100C to achieve imaging control allows for the generation of calibration patterns with arbitrary pattern content based on the invisible projection light. Compared to traditional depth information detection methods, the calibration pattern of this solution has higher resolution and is clearer. Simultaneously, the design of the calibration pattern is more flexible.

[0092] In some possible implementations, the emission modes of invisible and visible projection light can be controlled based on the controller 300C. For example, such as... Figure 7 As shown, the controller 300C can control the display component 130C to emit invisible projection light and visible projection light at intervals by controlling the working state of the first invisible light filter 133C.

[0093] In some possible implementations, the display component 130C can simultaneously emit invisible projection light and visible projection light. For example... Figure 8 As shown, a second invisible light filter 210C is provided on the imaging component 200C. The second invisible light filter 210C is used to filter out invisible light. By providing the second invisible light filter 210C, the imaging component 200C can avoid interference from visible light and achieve clear acquisition and imaging of the calibration pattern based on invisible light.

[0094] In some possible implementations, the third projection component 100C may first emit visible projection light, and after triggering a preset correction trigger condition, perform operations such as adjusting emission parameters based on invisible projection light. In this case, the aforementioned emission of visible and invisible projection light via the third projection component 100C includes: emitting visible projection light via the third projection component 100C; and emitting invisible projection light via the third projection component 100C in response to the preset correction trigger condition. For example, the preset correction trigger condition may be that at least one of the third projector 1000C and the target projection surface T has undergone displacement. This displacement may be based on a judgment made using a relevant gravity acceleration sensor, or on a judgment made using acquired depth information, etc.

[0095] In some possible implementations, when emitting invisible and visible projection light intermittently or simultaneously, the controller 300C is also used to control the third projection component 100C to increase the projection brightness of the visible projection light. In this embodiment, when invisible projection light is emitted, it inevitably causes some interference to the emission of visible projection light, resulting in a slight reduction in the imaging quality of the visible projection light. By increasing the projection brightness of the visible projection light, the imaging quality of the user screen content displayed by the visible projection light can be compensated to some extent.

[0096] S200: The imaging component 200C captures part or all of the target projection surface T to obtain an image of the calibration pattern.

[0097] In this embodiment, the imaging component 200C can sense invisible light, thereby enabling it to capture images of a calibration pattern displayed by invisible projected light. The captured images can then be used to calculate depth information. This implementation allows for the calculation and acquisition of depth information without interrupting the user's viewing experience, and the solution is implemented at a low cost.

[0098] In some possible implementations, the projection method further includes the following: Figure 18 The sub-operation of step S300A shown:

[0099] S300A: Based on the captured image, adjust at least one parameter among the following: the sharpness of the user's screen content, the screen size, and the border shape.

[0100] In this embodiment, the controller 300C can match the calibration pattern information within the captured image with the known data information of the calibration pattern when emitting invisible projection light, based on binocular vision matching technology, thereby obtaining depth information about the target projection surface T. The controller 300C adjusts the projection parameters of the visible projection light emitted by the third projection component 100C according to the depth information. For example, it adjusts the projection imaging angle and projection focal length. By adjusting the projection imaging angle, the size and border shape of the user's screen content can be adjusted. By adjusting the projection focal length, the clarity of the user's screen content can be adjusted.

[0101] In some possible implementations, the projection method further includes the following: Figure 19 The following steps are shown in the operation of S300B-S400B:

[0102] S300B identifies a human body based on the captured image when a human body appears in the emission path of both visible and invisible projection light.

[0103] In this embodiment, based on the reused display component 130C, invisible projection light can carry image information, enabling the display of a very high-resolution calibration pattern on the target projection surface T. The marker points in this calibration pattern can be very dense, allowing for the acquisition of very high-resolution depth information from images captured based on this pattern. Based on this very high-resolution depth information, the identification of human figures appearing along the transmission path can be achieved.

[0104] S400B: Based on the location of the human body, it performs corresponding smart device operations.

[0105] For example, the operation of the smart device can be: adjusting the brightness of the visible projection light or the imaging display range according to the location of the human body, so as to prevent the projection light from hitting the human eye.

[0106] For example, device operation can be: performing human-computer interaction operations with a human based on the human's location and / or posture. This human-computer interaction operation can be recognizing the human's posture to perform related control operations on the third projector 1000C, or it can be based on the recognized human's posture to perform related game interactions, etc.

[0107] The controller involved in the embodiments of this application can be a chip. For example, it can be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a microcontroller unit (MCU), a programmable logic device (PLD), or other integrated chips.

[0108] It should be understood that in the various embodiments of this application, the order of the above-mentioned processes does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0109] Those skilled in the art will recognize that the modules and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0110] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and modules described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0111] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices, and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative; for instance, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple modules or components may be combined or integrated into another device, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or modules may be electrical, mechanical, or other forms.

[0112] The modules described as separate components may or may not be physically separate. The components shown as modules may or may not be physical modules; that is, they may be located on one device or distributed across multiple devices. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs.

[0113] In addition, the functional modules in the various embodiments of this application can be integrated into one device, or each module can exist physically separately, or two or more modules can be integrated into one device.

[0114] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented using software programs, implementation can be, in whole or in part, in the form of a computer program product. This computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium accessible to a computer or a data storage device containing one or more servers, data centers, etc., that can be integrated with the medium. The available media can be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., DVDs), or semiconductor media (e.g., solid-state drives (SSDs)).

[0115] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A projector, characterized in that, The projector includes a projection component and a shooting component, wherein the projection component comprises a visible light path component and an invisible light path component; the projector is used for: Visible projection light is emitted through the visible light path component, and the visible projection light is used to display the user's screen content on the target projection surface; The invisible projection light is emitted through the invisible optical path component. The invisible projection light is light that is invisible to the human eye. The invisible projection light is used to display a calibration pattern on the target projection surface. The imaging component captures part or all of the target projection surface to obtain an image of the calibration pattern.

2. The projector according to claim 1, characterized in that, The projection component further includes a display component, wherein: The invisible light path component is used to provide invisible light to the display component, and the visible light path component is used to provide visible light to the display component; The display component is used to emit invisible projection light onto the target projection surface based on the invisible light, and to emit visible projection light onto the target projection surface based on visible light.

3. The projector according to claim 2, characterized in that, The step of emitting invisible projection light toward the target projection surface based on invisible light, and emitting visible projection light toward the target projection surface based on visible light, includes: The invisible projection light and the visible projection light are emitted at intervals through the display components.

4. The projector according to claim 3, characterized in that, The display component includes a display panel, an emitting lens, and a first invisible light filter; the first invisible light filter is used to control the filtering state of invisible light; the step of emitting the invisible projection light and the visible projection light at intervals through the display component includes: Control the working state of the first invisible light filter so that invisible light and visible light pass through the display panel at intervals; The imaging content of the display panel is controlled to obtain the invisible projection light based on the invisible light that passes through, or to obtain the visible projection light based on the visible light that passes through; The visible projection light and the invisible projection light are emitted through the emitting lens.

5. The projector according to claim 2, characterized in that, The imaging lens of the imaging component is further provided with a second invisible light filter, which is used to filter out invisible light; the step of emitting invisible projection light to the target projection surface based on the invisible light, and emitting visible projection light to the target projection surface based on visible light, includes: While emitting the visible projection light through the display component, the invisible projection light is also emitted through the display component.

6. The projector according to any one of claims 2-5, characterized in that, The invisible optical path assembly includes an invisible light source and an invisible light mirror group; the visible optical path assembly includes a visible light source and a visible light mirror group; wherein: The invisible light source is used to generate invisible light; the invisible light mirror group is used to process the invisible light generated by the invisible light source and then provide it to the display component; The visible light source is used to generate visible light; the visible light lens group is used to process the visible light generated by the visible light source and then provide it to the display component.

7. The projector according to any one of claims 2-5, characterized in that, The visible light path component and the invisible light path component reuse a broadband optical component and a first filter optical component, wherein: The broadband optical component is used to generate broadband light, the wavelength range of which includes the wavelengths of invisible light and visible light. The first filtering light component is used to filter invisible light and visible light from the broadband light and provide them to the display component.

8. The projector according to any one of claims 2-5, characterized in that, The visible light path component and the invisible light path component multiplex the broadband optical component and the second filtering optical component, wherein: The broadband optical component is used to generate broadband light, the wavelength range of which includes the wavelengths of invisible light and visible light. The second filtering light component is used to filter the broadband light to obtain a mixture of invisible and visible light and provide it to the display component; The display component is also used to: emit the invisible projection light and the visible projection light according to the mixed light filter.

9. The projector according to any one of claims 1-8, characterized in that, The projector also includes a controller, the controller being used for: Based on the captured image, at least one parameter among the following: the clarity of the user screen content, the screen size, and the border shape is adjusted.

10. The projector according to any one of claims 1-9, characterized in that, The emission of visible and invisible projection light through the projection component includes: The visible projection light is emitted through the projection component; In response to a preset correction trigger condition, the invisible projection light is emitted through the projection component.

11. The projector according to any one of claims 1-10, characterized in that, When emitting visible and invisible projection light through the projection assembly, the projector is also used for: Increase the projection brightness of the visible projection light.

12. The projector according to any one of claims 1-11, characterized in that, The projector is also used for: When a human body appears in the emission paths of the visible and invisible projection lights, the human body is identified based on the captured image.

13. The projector according to claim 12, characterized in that, After identifying the human body based on the captured image, the projector is further used to: Adjust the brightness of the visible projection light or the imaging display range according to the location of the human body; or, Based on the location or posture of the human body, perform human-computer interaction operations with the human body.

14. The projector according to any one of claims 1-13, characterized in that, The invisible projected light is infrared light.

15. A projection method, characterized in that, The method is applied to a projector, which includes a projection component and a capturing component, wherein the projection component includes a visible light path component and an invisible light path component; the projection method includes: Visible projection light is emitted through the visible light path component, and the visible projection light is used to display the user's screen content on the target projection surface; The invisible projection light is emitted through the invisible optical path component. The invisible projection light is light that is invisible to the human eye. The invisible projection light is used to display a calibration pattern on the target projection surface. The imaging component captures part or all of the target projection surface to obtain an image of the calibration pattern.

16. The projection method according to claim 15, characterized in that, The projection component further includes a display component, wherein: the invisible light path component is used to provide invisible light to the display component, and the visible light path component is used to provide visible light to the display component; the display component is used to emit invisible projection light to the target projection surface according to the invisible light, and to emit visible projection light to the target projection surface according to the visible light.

17. The projection method according to claim 16, characterized in that, The step of emitting invisible projection light toward the target projection surface based on invisible light, and emitting visible projection light toward the target projection surface based on visible light, includes: The invisible projection light and the visible projection light are emitted at intervals through the display components.

18. The projection method according to claim 16, characterized in that, The imaging lens of the imaging component is further provided with a second invisible light filter, which is used to filter out invisible light; the step of emitting invisible projection light to the target projection surface based on the invisible light, and emitting visible projection light to the target projection surface based on visible light, includes: While emitting the visible projection light through the display component, the invisible projection light is also emitted through the display component.

19. The projection method according to any one of claims 15-18, characterized in that, The method further includes: Based on the captured image, at least one parameter among the following: the clarity of the user screen content, the screen size, and the border shape is adjusted.

20. The projection method according to any one of claims 15-19, characterized in that, The emission of visible and invisible projection light through the projection component includes: The visible projection light is emitted through the projection component; In response to a preset correction trigger condition, the invisible projection light is emitted through the projection component.

21. The projection method according to any one of claims 15-20, characterized in that, When emitting visible and invisible projected light through the projection component, the method further includes: Increase the projection brightness of the visible projection light.

Images