Projection control method, projector and electronic equipment

By setting the camera in the projector, taking the projected image and adjusting the projection focal length according to the image clarity, the problem of complex parameters manually adjusted by the projector is solved, and fast and accurate projection parameter adjustment is achieved, and the imaging effect is improved.

CN119484787APending Publication Date: 2025-02-18HUAWEI TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202311016868.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-08-11
Publication Date
2025-02-18

AI Technical Summary

Technical Problem

In the practical application of projectors, due to the position and structure of the projection surface, projection parameters (such as projection focal length and projection angle) need to be manually adjusted to obtain the best imaging effect, but this process is complicated and difficult to ensure the best effect.

Method used

通过在投影仪中设置相机,拍摄投影成像后的图像,控制器根据图像清晰度调整投影焦距,实现自动调焦。

Benefits of technology

This method quickly adjusts the projection parameters without the need for a rangefinder, improves the quality of imaging effects and user experience, and is suitable for projector products of different costs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119484787A_ABST
    Figure CN119484787A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides a projection control method, a projector and electronic equipment, and is applied to the technical field of projection imaging. The projector comprises a projection assembly and a camera. The method comprises the steps that the projection assembly emits projection structured light based on a first data signal; the first data signal is used to indicate the first image. The projection structured light is used for forming a projection image of the first image on the projection surface. The first image comprises a user projection image and / or a calibration feature image. The camera shoots the first area to obtain a second data signal; the second data signal is used to indicate a second image. Obtaining a first control signal according to the second image. The first control signal is used for adjusting projection parameters of the projection structured light. According to the embodiment of the invention, the structured light device is formed through the projection assembly of the projector and the camera, and algorithm processing is performed according to the second image, so that the projection parameters are calculated. The scheme can be suitable for projector products with different costs to realize rapid and high-precision projection parameter automatic adjustment.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of projection imaging technology, and in particular to a projection control method, a projector and an electronic device. Background Art

[0002] With the development of imaging technology, projectors are used in more and more life and work scenes. The projector includes a controller and a projection component. The controller outputs the image to be displayed to the projection component in the form of a data signal. The projection component emits projection light based on the data signal, and images the image to be displayed on the projection surface through the projection light to complete the projection imaging. However, in actual applications, affected by the position and structure of the projection surface, it is necessary to emit projection light based on different projection parameters (such as projection focal length and / or projection angle, etc.) to obtain better imaging effects. If the projection parameters are adjusted by manual adjustment by the user, the user is usually required to perform multiple and long-term adjustment operations. In addition, manual adjustment is difficult to ensure that the imaging effect achieves the best effect in the actual application scenario.

[0003] One improvement is to set a camera in the projector and obtain a captured image by shooting the projected image with the camera. The controller adjusts the projection focal length multiple times according to the clarity of the captured image to obtain a target projection focal length with better imaging clarity. However, this solution causes a long time delay in automatic focusing. Another improvement is to set a rangefinder in the projector. The relative distance between the projector and the projection surface is measured by the rangefinder. The controller adjusts the projection focal length of the emitted projection light based on the measured relative distance. However, this method increases the device cost of the projector. Summary of the invention

[0004] The embodiments of the present application provide a projection control method, a projector and an electronic device, which can quickly adjust the projection parameters of the projector to obtain a better imaging effect without the need for a rangefinder.

[0005] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions:

[0006] In a first aspect, a projection control method is provided, which is based on a projector. The projector includes a projection component and a camera. The method includes: the projection component emits projection structured light based on a first data signal. The first data signal is used to indicate a first image. The projection structured light is used to form a projection image of the first image on a projection surface. The first image includes a user projection image and / or a calibration feature image. The camera captures a first area to obtain a second data signal. The second data signal is used to indicate a second image. The projection image is partially or entirely located within the first area. A first control signal is obtained according to the second image. The first control signal is used to adjust the projection parameters of the projection structured light.

[0007] In an embodiment of the present application, a structured light component is formed by the projection component and camera of the projector itself to implement algorithmic processing of the projection image of the first image, and generate a first control signal to adjust the projection parameters of the projected structured light. The embodiment of the present application can perform algorithmic measurement of the relative distance between the projection component and the projection surface without the need for a ranging sensor, and can adjust the projection parameters of the projected structured light to the target parameters with a single first control signal without the need to output multiple control signals. This solution can be applied to low-cost, medium-cost, and high-cost projector products, and has high adjustment accuracy and low adjustment delay.

[0008] In a possible implementation, when the first image includes the user projection image, the above-mentioned obtaining the first control signal according to the second image includes: obtaining the first control signal according to the first image and the second image based on binocular vision matching technology. In the embodiment of the present application, there is no need to use a binocular camera. Only the second image captured by the camera is combined with the first image that has been acquired when the controller generates the first data signal, and the first image and the second image are algorithmically processed using binocular vision matching technology to generate a first control signal. Compared with the traditional binocular vision matching technology that uses a binocular camera to generate multiple second images and performs binocular vision matching on multiple second images, this solution is based on the depth image obtained by binocular vision matching technology and the native common viewpoint between the first image and the second image, and feature processing can be performed without additional complex matching processing operations. In theory, the resolution of the depth image can reach the same resolution as the first image of the projector.

[0009] In a possible implementation, the obtaining of the first control signal according to the first image and the second image includes: obtaining a depth image according to the first image feature and the second image feature. The first image feature includes at least one reference image feature in the first image. The second image feature is a mapped image feature of at least one reference image feature on the second image. The depth image is used to indicate the depth coordinates of at least one reference image feature. The first control signal is obtained according to the depth coordinates of at least one reference image feature. In an embodiment of the present application, a reference image feature is extracted from the first image as a first image feature, and a corresponding second image feature is extracted from the second image, and a depth coordinate calculation is performed based on the first image feature and the second image feature to obtain a depth image.

[0010] In a possible implementation, obtaining the first control signal according to the depth coordinates of at least one reference image feature includes: obtaining a target depth distance according to the depth coordinates of at least one reference image feature. Obtaining the first control signal according to the target depth distance. In an embodiment of the present application, the target depth distance can be obtained according to the depth coordinates of the reference image feature. Determine the corresponding target projection parameters according to the target depth distance. Generate the first control signal according to the target projection parameters.

[0011] In a possible implementation, the first control signal is obtained according to the target depth distance, including: obtaining the target projection parameters according to the parameter mapping relationship and the size of the target depth distance. The parameter mapping relationship is a preset mapping relationship between depth distances of different sizes and different projection parameters. The first control signal is obtained according to the target projection parameters. In an embodiment of the present application, a preset mapping relationship between the depth distance and the projection parameter can be preset. For example, when the projection parameter is the projection focal length, the focus curve (i.e., the mapping relationship between the depth distance and the motor angle) can be preset, and the projection focal length that needs to be adjusted is determined based on the depth distance actually calculated.

[0012] In a possible implementation, the distribution density of at least one reference image feature is less than the first threshold. In the embodiment of the present application, for some projection parameters, calculation can be performed without too many reference image features. In this case, the distribution density of the reference image features can be reduced to reduce the amount of data processing, increase the processing rate, etc.

[0013] In one possible implementation, part or all of the projection surface is a three-dimensional structural surface. The distribution density of multiple reference image features on the three-dimensional structural surface is greater than a second threshold. The method also includes: obtaining structural parameters of the three-dimensional structural surface according to the depth coordinates corresponding to the three-dimensional structural surface. In an embodiment of the present application, the fixed projection surface may be a three-dimensional structural surface that is not a completely planar surface. Alternatively, during the projection process, there are moving objects or living bodies appearing in the projection area, so that part or all of the projection surface is a three-dimensional structural surface. Therefore, the distribution density of the reference image features can also be set to be larger, the structural parameters of the projection surface can be calculated using multiple reference image features, and a series of processing operations can be performed based on the acquired structural parameters.

[0014] In some possible implementations, when the first image is a calibration feature image, or the first image includes a user projection image and a calibration feature image, the controller may generate a first control signal using a structured light image processing algorithm. In this case, the feature parameters of the calibration feature image may be directly stored inside the controller. The controller directly calls the stored feature parameters and the second image for data processing to obtain the first control signal.

[0015] In some examples, when the first image is a calibration feature image, at least one reference image feature may be an image feature in the calibration feature image. The calibration feature image is used to provide some image content that is convenient for feature point extraction and calibration as reference image features to assist in the generation of depth images, etc. Exemplarily, the content of the calibration feature image (i.e., at least one reference image feature) may include one or more of calibration points, calibration lines, checkerboards, Gray codes, and resolution cards. In an embodiment of the present application, feature point extraction and feature matching between the first image and the second image can be achieved more accurately and quickly through the calibration feature image. However, in the process of adjusting the projection parameters, the projection processing of the user's projected image is not performed, and the user cannot watch the movie normally, which slightly reduces the user experience.

[0016] In some examples, when the first image includes a user projected image and a calibration image feature. Among them, a certain reference image feature of at least one reference image feature can be an image feature in the user projected image or an image feature in the calibration feature image. That is, at least one reference image feature can be all image content in the user projected image; or all projection content in the calibration image feature; or part of the image content in the user projected image, and the other part of the projection content in the calibration image feature. The embodiment of the present application can perform feature processing based on the calibration image feature and / or the user projected image, and the user can still watch the movie during the feature processing. For example, the calibration image feature is set at the edge of the user projected image, and the user can watch the movie normally. At the same time, the calibration image feature is still retained to assist in feature processing.

[0017] In some examples, when the first image is a user-projected image, at least one reference image feature is an image feature in the user-projected image. In an embodiment of the present application, the calibration image features are not projected during the adjustment of the projection parameters. The first image features in the first image are extracted. The corresponding second image features are extracted from the second image features to obtain a depth image. In an embodiment of the present application, the user can directly watch the projected content as the user's projected image, and the features in these projected contents can be used as feature content for feature extraction and calibration. The user has no perception of the reference image features, and the viewing experience is better.

[0018] In a possible implementation, the method further includes: when the first image is a user-projected image, using the first captured image as the second image. The first captured image is a captured image corresponding to the first image that displays valid image data. In an embodiment of the present application, when a user-projected image is used as the first image, there may be a situation where the user-projected image displays invalid image data, for example, the user-projected image displays a black screen (i.e., a black frame), or displays a white screen (i.e., a white frame), etc. In these cases where valid image data is not displayed, it is difficult to extract reference image features. Therefore, the captured image can be selected to use the first captured image corresponding to the first image that displays valid image data as the second image for feature processing, etc.

[0019] In a possible implementation, the method further includes: generating a second control signal based on the projection angle of the projected structured light. The second control signal is used to adjust the shooting angle of the camera. In an embodiment of the present application, a second control signal can be generated according to the current projection angle of the projection component. The shooting angle of the camera is adjusted according to the second control signal. In actual applications, in some application scenarios, in order to achieve a better projection match between the projected structured light and the projection surface, the user will adjust the installation position, projection angle, etc. of the projector. At this time, the shooting angle of the camera can be adjusted so that the camera can better capture the projected image. The higher the image quality of the projected image captured in the second image, the higher the accuracy of the feature extraction processing, so as to improve the control accuracy of the first control signal.

[0020] In a possible implementation, the projection parameters include at least one of a projection focal length and a projection angle. In an embodiment of the present application, a structured light device can be formed according to a projection component and a camera. At this time, data processing can be performed on the second image obtained by the camera to obtain a depth image. Different projection parameters can be calculated according to the depth image, such as calculating a target projection focal length and a target projection angle.

[0021] In a possible implementation, after obtaining the first control signal according to the first image and the second image, the method further includes: obtaining the imaging clarity of the projected image according to the second image. According to the imaging clarity of the projected image, at least one third control signal is obtained. At least one third control signal is used to adjust the projection focal length of the projected structured light. In an embodiment of the present application, after the projection focal length of the second image is adjusted by the first control signal, a plurality of second images can be continuously captured by the camera, and according to the imaging clarity of the projected image in the plurality of second images, the projection focal length can be finely adjusted multiple times by using the climbing method, so as to further improve the imaging quality on the basis of the first control signal.

[0022] In a second aspect, an embodiment of the present application further provides a projector, which includes a projection component, a camera, and a controller. Wherein: the projection component is used to: emit projection structured light based on a first data signal. The first data signal is used to indicate a first image. The projection structured light is used to form a projection image of the first image on a projection surface. The camera is used to: photograph a first area to obtain a second data signal. The second data signal is used to indicate a second image. The projection image is partially or entirely located within the first area. The controller is used to: output a first data signal to the projection component; input a second data signal; and output a first control signal to the projection component according to the second image. The first control signal is used to adjust the projection parameters of the projection structured light.

[0023] In a possible implementation, the controller is specifically configured to: output a first control signal to the projection component according to the first image and the second image based on a binocular vision matching technology.

[0024] In a possible implementation, the projector further includes an angle adjuster. The camera is mounted on the angle adjuster. The controller is further configured to: output a second control signal to the angle adjuster based on the projection angle of the projected structured light. The second control signal is used to adjust the shooting angle of the camera.

[0025] In a possible implementation manner, the projection parameter includes at least one of a projection focal length and a projection angle.

[0026] In a possible implementation, the controller is further used to: obtain the imaging clarity of the projection image according to the second image. According to the imaging clarity of the projection image, output at least one third control signal to the projection component. The at least one third control signal is used to adjust the projection focal length of the projection structured light.

[0027] In a third aspect, an embodiment of the present application further provides an electronic device, which includes a mounting portion and the projector described in the second aspect; the projector is disposed on the mounting portion.

[0028] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium, which includes instructions; when the instructions are executed on a processor, the processor executes the projection control method as described in the first aspect.

[0029] For the technical principles and technical effects of the second, third and fourth aspects, reference may be made to the relevant description of the first aspect above and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 A schematic diagram of the structure of a projector provided in an embodiment of the present application;

[0031] Figure 2A schematic diagram of the structure of a first projector provided in an embodiment of the present application;

[0032] Figure 3 A schematic diagram of distance conversion of a first projector provided in an embodiment of the present application;

[0033] Figure 4 A schematic diagram of the structure of a second projector provided in an embodiment of the present application;

[0034] Figure 5 A schematic diagram of the structure of a third projector provided in an embodiment of the present application;

[0035] Figure 6 A schematic diagram of a projection control method provided in an embodiment of the present application Figure 1 ;

[0036] Figure 7 A schematic diagram of feature matching between a first image and a second image provided in an embodiment of the present application;

[0037] Figure 8 A schematic diagram of another projection control method provided in an embodiment of the present application Figure 2 ;

[0038] Fig. 9 A flowchart of another projection control method provided in an embodiment of the present application Figure 3 ;

[0039] Fig.10 A schematic diagram of a focus curve of depth distance and motor angle provided in an embodiment of the present application;

[0040] Fig.11 A schematic diagram of a first image for calibrating a feature image provided in an embodiment of the present application;

[0041] Fig.12 A schematic diagram of a first image including a calibration feature image and a user projection image provided in an embodiment of the present application;

[0042] Fig.13 A schematic diagram of a first image of an image projected by a user provided in an embodiment of the present application;

[0043] Fig.14 A flowchart of another projection control method provided in an embodiment of the present application Figure 4 . DETAILED DESCRIPTION

[0044] It should be noted that the terms "first", "second", etc. involved in the embodiments of the present application are only used to distinguish features of the same type and cannot be understood as indicating relative importance, quantity, order, etc.

[0045] The terms "exemplary" or "for example" and the like in the embodiments of the present application are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of the terms "exemplary" or "for example" is intended to present the related concepts in a specific way.

[0046] The terms "coupling" and "connection" involved in the embodiments of the present application should be understood in a broad sense. For example, they may refer to a direct physical connection, or an indirect connection achieved through electronic devices, such as a connection achieved through resistors, inductors, capacitors or other electronic devices.

[0047] Autofocus, also known as autofocus (AF), is mainly used in lens adjustable systems, that is, by automatically adjusting the appropriate distance from the lens to the target surface to achieve clear imaging. Autofocus is commonly used in cameras and projectors. Generally, there are three common ways to implement autofocus, namely: Method 1, hill climbing method. The hill climbing method refers to determining the projection focal length with better imaging effect according to the imaging contrast and / or imaging clarity corresponding to multiple focusing operations through multiple focusing operations. Method 2, phase detection focus (phase-detection AF, PDAF). The phase detection focus method has a faster focusing speed, but requires customized imaging pixel parameters, etc., and is greatly affected by ambient light. Method 3, ranging focus method. In the ranging focus method, the mapping relationship between the preset distance and the imaging focal length is determined by measuring the relative distance through a distance sensor. Among them, method 2 is applied to camera autofocus. Methods 1 and 2 can be applied to projector autofocus.

[0048] With the development of imaging technology, projectors are used in more and more life and work scenes. The projector includes a controller and a projection component. The controller outputs the image to be displayed to the projection component in the form of a data signal. The projection component emits projection light based on the data signal, and images the image to be displayed on the projection surface through the projection light to complete the projection imaging. However, in actual applications, affected by the position and structure of the projection surface, it is necessary to emit projection light based on different projection parameters (such as projection focal length and / or projection angle, etc.) to obtain better imaging effects. If the projection parameters are adjusted by manual adjustment by the user, the user is usually required to perform multiple and long-term adjustment operations. In addition, manual adjustment is difficult to ensure that the imaging effect achieves the best effect in the actual application scenario.

[0049] In order to improve the imaging effect of projection and reduce the complexity of user operation, an embodiment of the present application provides an electronic device. The electronic device includes a mounting portion and a projector. The projector is arranged on the mounting portion. Figure 1 As shown, the projector 100 includes a controller 10 and a projection assembly 20. The controller 10 is used to generate a data signal according to an image for imaging as required, and output the data signal to the projection assembly 20. The projection assembly 20 emits projection light at a certain projection focal length according to the data signal to form a projection image T1 on the projection surface T. However, due to the relative distance between the projection surface and the projector 100, the projection image T1 at the projection focal length may be unclear. For this reason, it is necessary to adjust the projection focal length of the projection light.

[0050] In some possible implementations, such as Figure 1 The projector 100 shown is a first projector. The projection focal length of the projection light emitted by the first projector can be adjusted by shooting the projection image T1 to increase the focusing imaging effect of the projection image T1. Figure 2 As shown, the first projector 100A includes a first controller 10A, a first projection assembly 20A and a first camera 30A.

[0051] In some examples, Figure 2In the first projector 100A shown, based on the captured projection image T1, the climbing method can be used to automatically adjust the projection focal length. At this time, the first controller 10A is used to: generate a first data signal according to the first image to be imaged as required, and output the first data signal to the first projection component 20A. The first projection component 20A emits projection light according to the first data signal to form a projection image T1 on the projection surface. The first controller 10A is also used to: output one or more step control signals to the first projection component 20A, and adjust the projection focal length when emitting the projection light through the one or more step control signals. The first camera 30A is used to: capture the projection image T1 and output a first image data signal. The first image data signal is used to indicate the captured image of the projection image T1. The first controller 10A is also used to: output at least one first focal length control signal according to the content clarity of the projection image T1 in the captured image. The projection focal length of the first projection component 20A is adjusted by at least one first focal length control signal to improve the clarity of the projection image T1. In an embodiment of the present application, the projection focal length of the projection light emitted by the first projection assembly 20A is adjusted by one or more step control signals, and the projection image T1 is photographed multiple times by the first camera 30A to obtain multiple photographed images. The first controller 10A compares the clarity of the content of the projection image T1 in the multiple photographed images to determine the finely adjusted target focal length, and outputs the first focal length control signal according to the determined target focal length. The projection focal length of the first projection assembly 20A is adjusted multiple times by the first focal length control signal using the ramp method, and the projection focal length with the best clarity is selected to improve the projection clarity, etc. The embodiment of the present application can be applied to medium-low-cost and high-cost projector products, but the use of the ramp method to adjust the projection focal length requires multiple adjustment operations, resulting in a long time for automatic focusing. In addition, this solution cannot automatically adjust other projection parameters of the projector product.

[0052] In some examples, Figure 2 In the first projector 100A shown, based on the captured projection image T1, a relative distance conversion method can be used to automatically adjust the projection focal length. At this time, the first controller 10A is used to: generate a first data signal according to the first image to be imaged as required, and output the first data signal to the first projection component 20A. The first projection component 20A emits projection light according to the first data signal to form a projection image T1 on the projection surface. The first camera 30A is used to: capture the projection image T1 and output a second image data signal. The second image data signal is used to indicate the captured image of the projection image T1, and the image content of the projection image T1 is entirely located in the captured image. As shown in FIG. Figure 3As shown, the first controller 10A is also used to convert the relative distance according to the distance h between the first projection assembly 20A and the first camera 30A, the image center a of the captured image, and the image center b of the projection image T1 in the captured image, so as to calculate the relative distance d between the first projector 100A and the projection surface T, and output a first focal length control signal to adjust the projection focal length of the first projector 100A. The embodiment of the present application can be applied to medium-cost and high-cost projector products, and the focal length adjustment of the first projector 100A can be completed through one control operation, and the time for automatic focusing is shortened. However, in Figure 3 In the scheme, the first camera 30A needs to capture the complete projection image T1 to achieve distance conversion, which places extremely high requirements on the setting position of the first camera 30A. Therefore, the adjustment accuracy is limited by the accuracy of the distance h and the accuracy of the relative distance conversion. In addition, the calibration distance measurement method of this scheme has high limitations and a small application range. At the same time, the accuracy of the distance measurement scheme of this scheme depends on the calibration relationship between the relative distances, and this relationship is more nonlinear, and the solution of the distance is not completely unique, which may give a result with large errors. At the same time, this scheme cannot adjust other projection parameters.

[0053] In some possible implementations, such as Figure 1 The projector 100 shown is a second projector. The projection focal length of the projection light emitted by the second projector can be adjusted by the distance measurement method to increase the focusing imaging effect of the projection image T1. Figure 4 As shown, the second projector 100B includes a second controller 10B, a second projection assembly 20B and a second ranging sensor 30B. The second controller 10B is used to: generate a first data signal according to the first image to be imaged as required, and output the first data signal to the second projection assembly 20B. The second projection assembly 20B emits projection light according to the first data signal to form a projection image T1 on the projection surface. The second ranging sensor 30B is used to: obtain the relative distance between the second projector 100B and the projection surface, and output a first distance signal to the second controller 10B, and the first distance signal is used to indicate the relative distance between the second projector and the projection surface. The second controller 10B is used to: output a second focal length control signal to the second projection assembly 20B according to the first distance signal, and the second focal length control signal is used to adjust the projection focal length of the second projection assembly 20B.

[0054] For example, in Figure 4 In the second projector 100B shown in FIG. 1 , the relative distance between the projection surface and the second projector 100B (or the second projection assembly 20B of the second projector 100B) can be measured by the second distance measuring sensor 30B, and the projection focal length can be roughly adjusted according to the corresponding relationship between the preset relative distance and the projection focal length to improve the clarity of the projection. Figure 4 In the second projector 100B shown, the target focal length can be obtained by the relative distance actually measured. The focal length adjustment direction and adjustment size are determined according to the size relationship between the current focal length of the second projection assembly 20B and the target focal length. Exemplarily, the second distance measuring sensor 30B can be a TOF distance sensor, an ultrasonic distance sensor, an infrared distance sensor, etc.

[0055] For example, Figure 4 The second projector 100B shown also includes a second camera 40B, which is used to shoot the projection image T1 and output a third image data signal. The third image data signal includes a captured image, the captured image includes the projection image T1, and the number of image content pixels of the projection image T1 in the captured image is used to indicate the shooting clarity of the projection image T1. On the basis of adjusting the focal length of the second projector 100B by the second focal length control signal, the second controller 10B is also used to: perform imaging clarity comparison according to the number of image content pixels of the projection image T1 in the captured image, so as to output a third focal length control signal. The projection focal length is then set to the projection focal length corresponding to the better clarity among the multiple compared clarity through the third focal length control signal.

[0056] However, in this application Figure 4 In the embodiment shown, when the second distance measuring sensor 30B is used to achieve fast focusing, the cost of the second distance measuring sensor 30B is relatively high, and this solution is not suitable for medium- and low-cost projector products. At the same time, in the solution of measuring relative distance through depth imaging based on the TOF distance sensor, there are also high requirements for image resolution and image matching algorithm of the captured image, and a relatively high-cost projector product is also required to achieve it. Therefore, Figure 4 The embodiment shown is difficult to be applied in medium and low-cost projector products. At the same time, the solution cannot adjust other projection parameters.

[0057] In some possible implementations, in order to realize high-precision, fast and automatic adjustment of projection parameters in projector products of different costs, such as Figure 1 The projector 100 shown may be a third projector. Figure 5As shown, the third projector 100C includes a third projection component 20C, a third camera 30C and a third controller 10C. Wherein: the third projection component 20C is used to: emit projection structured light based on the first data signal. The first data signal is used to indicate the first image. The projection structured light is used to form a projection image T1 of the first image on the projection surface. The first image includes a user projection image and / or a calibration feature image. The third camera 30C is used to: shoot the first area to obtain a second data signal. The second data signal is used to indicate the second image. The projection image T1 is partially or entirely located in the first area. The third controller 10C is used to: output a first data signal to the third projection component 20C; input a second data signal; output a first control signal to the third projection component 20C according to the second image; the first control signal is used to adjust the projection parameters of the projection structured light.

[0058] In this application Figure 5 In the illustrated embodiment, the third controller 10C enables the third projector 100C to emit projection structured light through a first data signal. Then, the third camera 30C captures the first area to obtain a second image, and the first area includes part or all of the projection image T1. Feature extraction and computational processing are performed on the content of the projection image T1 in the captured second image to obtain the relative distance between the third projector 100C (or the third projection component 20C of the third projector 100C) and the projection surface, and a first control signal is output. The projection parameters of the projection structured light are adjusted by the first control signal. In the embodiment of the present application, a structured light measuring device can be formed by the third projection component 20C and the third camera 30C. Generally, cameras and controllers are provided in low-cost, medium-cost and high-cost autofocus projector products. Therefore, the existing cameras and controllers in these products can be used to implement depth imaging based on structured light to obtain the relative distance of the projection. In the example Figure 2 and Figure 4 In the embodiment of the invention, when the camera-based automatic focus adjustment adopts the hill climbing method, the camera needs to capture multiple projection images T1, and the controller analyzes the clarity of the projection image T1 to select the projection focal length with the best clarity. This method requires multiple adjustments to the focal length, resulting in a long delay. Figure 3 In the embodiment of the present invention, the solution based on the relative distance conversion of the camera only requires one adjustment operation to achieve automatic focusing, but the focusing accuracy is low. Figure 4 In the embodiment of the present invention, although the second distance measuring sensor 30B can improve the adjustment accuracy of the projection focal length and reduce the adjustment delay, the second distance measuring sensor 30B will greatly increase the cost. Figure 5In the scheme shown, a structured light device is formed based on the third camera 30C and the third projection assembly 20C. The structured light device can realize depth imaging to generate a depth map without adding an additional distance sensor or considering the registration problem between the distance sensor and the third camera 30C. It is possible to obtain the relative distance through depth map analysis and output a first control signal. At the same time, automatic focusing can be achieved with one adjustment operation through the first control signal, and this scheme can have a higher focusing accuracy. Finally, the third controller 10C can not only realize distance measurement according to the depth image, but also calculate the projection angle, etc. Therefore, the third controller 10C can adjust at least one of the projection focal length, projection angle, etc.

[0059] In some possible implementations, when the first image is a user projection image or includes a user projection image, feature matching may be performed based on a plurality of images to generate a first control signal.

[0060] In some examples, the plurality of images include a plurality of second images. Feature matching is performed based on the plurality of second images to generate a first control signal. Figure 5 In the illustrated embodiment, the third camera 30C may be a binocular camera. Based on the binocular vision matching technology, the third projection component 20C outputs a first control signal according to the second image captured by the binocular camera. In the embodiment of the present application, a plurality of second images are generated by the binocular camera. The third controller 10C performs image feature matching on the second image generated by the binocular camera based on the binocular vision matching technology to obtain a depth image of the projection image T1. The relative distance or projection angle, etc. are calculated based on the depth image, and the relevant projection parameters are adjusted.

[0061] In some examples, the plurality of images include a first image and a second image. Feature matching is performed based on the first image and the second image to generate a first control signal. Figure 5In the illustrated embodiment, a first control signal can be output to the third projection assembly 20C according to the first image and the second image based on binocular vision matching technology. In the embodiment of the present application, the third camera 30C may not be limited to a binocular camera. The projection image T1 is a projection of the first image on the projection surface. In the present embodiment, the first image can be used as a photo of one side taken by the binocular camera, and the second image can be used as a photo of the other side taken by the binocular camera. There is no need to actually use a binocular camera to collect multiple second images. Based on the binocular vision matching technology, binocular vision image feature processing is performed on the first image and the second image to obtain a depth image. And the relative distance or projection angle is calculated based on the depth image, and the relevant projection parameters are adjusted. The embodiment of the present application performs feature extraction and feature matching based on the first image and the second image to obtain a depth image. The depth image and the native common viewpoint between the second image and the first image taken by the third camera 30C do not require an additional matching algorithm. At the same time, in theory, the resolution of the obtained depth image can reach the same level as the projection resolution of the third projector.

[0062] In some possible implementations, when the first image is a calibration feature image or includes a calibration feature image, feature matching can be performed based on the second image to generate a first control signal. In this case, feature parameters can be generated based on the calibration feature image in the first image. After inputting the second image, the third controller 10C directly calls the feature parameters to perform feature matching with the second image features in the second image to generate the first control signal.

[0063] In some possible implementations, the third projector 100C further includes a first angle adjuster. The third camera 30C is mounted on the first angle adjuster. The third controller 10C is also used to: output a second control signal to the angle adjuster based on the projection angle of the projected structured light; the second control signal is used to adjust the shooting angle of the third camera 30C. Exemplarily, the angle adjuster may be a base, a rotating motor, an adjustable mechanical arm, and the like. In an embodiment of the present application, the third controller 10C may generate a second control signal according to the current projection angle of the third projection assembly 20C. The angle of the first angle adjuster is adjusted according to the second control signal to adjust the shooting angle of the third camera 30C. In actual applications, in some application scenarios, the user may adjust the installation position, projection angle, and the like of the third projector 100C in order to achieve a better projection match between the projected structured light and the projection surface. At this time, the shooting angle of the third camera 30C may be adjusted so that the third camera 30C can better capture the projection image T1. The higher the image quality of the projection image T1 captured in the second image, the higher the accuracy of the feature extraction process, so as to improve the control accuracy of the first control signal.

[0064] In some possible implementations, the third controller 10C is also used to: obtain the imaging clarity of the projection image T1 according to the second image. According to the imaging clarity of the projection image T1, output at least one third control signal to the third projection assembly 20C. At least one third control signal is used to adjust the projection focal length of the projected structured light. In an embodiment of the present application, after the projection focal length of the second image is adjusted by the first control signal, the third camera 30C can continue to capture multiple second images, and according to the imaging clarity of the projection image T1 in the multiple second images, the climbing method is used to finely adjust the projection focal length for multiple times, so as to further improve the imaging quality on the basis of the first control signal.

[0065] In some possible embodiments, the third projection assembly 20C includes a projection light group and an adjustment mechanism. The projection light group includes at least one projection light source. At least one projection light source is used to: emit projection structured light. The adjustment mechanism is used to: receive a first control signal, a third control signal, etc. Adjust the projection parameters of the projection structured light according to the first control signal or the third control signal. Exemplarily, the adjustment mechanism includes a focal length motor. The projection interaction of the projection structured light can be adjusted by controlling the focal length motor by the first control signal or the third control signal. Exemplarily, the adjustment mechanism can include a second angle adjuster. The projection angle of the projection structured light can be adjusted by the second angle adjuster.

[0066] Based on Figure 5 The third projector 100C shown can achieve the following Figure 6 The projection control method shown includes steps S100 to S300:

[0067] S100 , emitting projection structured light based on a first data signal.

[0068] For example, Figure 6 As shown, the third controller 10C generates a first data signal according to the first image to be imaged, and outputs the first data signal to the third projection component 20C. The third projection component 20C emits projection structured light according to the first data signal. The projection structured light forms a projection image T1 of the first image on the projection surface T.

[0069] S200 , photographing the projection image T1 to obtain a second image.

[0070] For example, Figure 6 As shown, the third camera 30C captures the first area and obtains a second data signal. The second data signal is used to indicate the second image; the projection image T1 is partially or completely located in the first area. In the embodiment of the present application, when the projection image T1 is partially or completely located in the first area, the image content of the projection image T1 can be partially or completely presented in the captured second image.

[0071] In some possible implementations, the projection control method further includes: generating a second control signal based on the projection angle of the projected structured light. The second control signal is used to adjust the shooting angle of the third camera 30C. In an embodiment of the present application, a second control signal can be generated according to the current projection angle of the third projection assembly 20C. The angle of the first angle adjuster is adjusted according to the second control signal to adjust the shooting angle of the third camera 30C. In actual applications, in some application scenarios, the user will adjust the installation position, projection angle, etc. of the third projector 100C in order to achieve a better projection match between the projected structured light and the projection surface. At this time, the shooting angle of the third camera 30C can be adjusted so that the third camera 30C can better capture the projection image T1. The higher the image quality of the projection image T1 captured in the second image, the higher the accuracy of the feature extraction processing, so as to improve the control accuracy of the first control signal.

[0072] S300 , outputting a first control signal according to the second image to adjust projection parameters of the projected structured light.

[0073] In some possible implementations, such as Figure 5 and Figure 6 The third camera 30C shown may be a binocular camera. In this case, binocular vision matching may be performed based on the plurality of second images captured by the binocular camera, a depth image may be obtained through operations such as feature extraction and feature matching, and projection parameters that need to be adjusted may be determined based on the depth image.

[0074] In some possible implementations, a first control signal can be output to the third projection assembly 20C according to the first image and the second image based on binocular vision matching technology. In the embodiment of the present application, the third camera 30C may not be limited to a binocular camera. The projection image T1 is a projection of the first image on the projection surface. In this embodiment, the first image can be used as a photo of one side taken by the binocular camera, and the second image can be used as a photo of the other side taken by the binocular camera. There is no need to actually use a binocular camera to collect multiple second images. Based on the binocular vision matching technology, binocular vision image feature processing is performed on the first image and the second image to obtain a depth image. And the relative distance or projection angle, etc. are calculated based on the depth image, and the relevant projection parameters are adjusted. The embodiment of the present application performs feature extraction and feature matching based on the first image and the second image to obtain a depth image. The depth image and the native common viewpoint between the second image and the first image taken by the third camera 30C do not require an additional matching algorithm. At the same time, in theory, the resolution of the obtained depth image can reach the same level as the projection resolution of the third projector.

[0075] Exemplarily, the third controller 10C knows the image content of the first image when generating the first data signal. After the third controller 10C acquires the second data signal, the content of the second image is obtained according to the second data signal. Figure 7 As shown, the first image is the image content of the projection image T1. The second image is a captured image obtained by capturing the projection image T1, and the captured image presents the image content of the projection image T1. Therefore, the first image and the second image can be regarded as binocular images captured by a binocular camera, and feature points of the first image and the second image are extracted based on binocular vision matching technology to obtain at least one reference image feature, and feature matching is performed based on at least one reference image feature to obtain a depth image. The projection parameters are calculated through the depth image.

[0076] In some possible implementations, when a first control signal is obtained according to the first image and the second image, such as Figure 8 As shown, step S300 may include the following operations S310-S320:

[0077] S310 , obtaining a depth image according to the first image feature and the second image feature.

[0078] In the embodiments of the present application, Figure 7 As shown, the first image feature includes at least one reference image feature in the first image. The second image feature is a mapped image feature of the at least one reference image feature on the second image. The depth image is used to indicate the depth coordinates of the at least one reference feature image.

[0079] S320. Obtain a first control signal according to a depth coordinate of at least one reference feature image.

[0080] Exemplarily, step S320 may include: Fig. 9 The operations of step S321-step S322 shown are:

[0081] S321. Obtain a target depth distance according to a depth coordinate of at least one reference feature image.

[0082] S322. Obtain a first control signal according to the target depth distance.

[0083] For example, in step S322, the target projection parameters can be obtained according to the parameter mapping relationship and the size of the target depth distance. The parameter mapping relationship is a preset mapping relationship between depth distances of different sizes and different projection parameters. The first control signal is obtained according to the target projection parameters. In the embodiment of the present application, the projection parameters include the projection focal length as an example. Fig.10As shown, according to different depth distances, the projection focal lengths of different motor angles can be set to generate corresponding preset mapping relationships. According to the acquired depth coordinates, the preset mapping relationship can be queried by the table lookup method to obtain the target depth distance. The target projection focal length is determined according to the target depth distance. The third projection component 20C is controlled by the first control signal to emit the projection structured light at the target projection focal length to achieve a better imaging effect.

[0084] In some possible implementations, the distribution density of at least one reference image feature is less than a first threshold. Fig.11 As shown, the first image is a calibration feature image P1. At least one reference image feature is an image feature in the calibration feature image P1. The calibration feature image P1 is used to provide some image content that is convenient for feature point extraction and calibration as reference image features to assist in the generation of depth images, etc. Exemplarily, the content of the calibration feature image P1 (i.e., at least one reference image feature) may include one or more of calibration points, calibration lines, checkerboards, Gray codes, and resolution cards. In an embodiment of the present application, feature point extraction and feature matching between the first image and the second image can be achieved more accurately and quickly through the calibration feature image P1. However, in the process of adjusting the projection parameters, the projection processing of the user projection image P2 is not performed, and the user cannot watch the movie normally, which slightly reduces the user experience. Fig.11 The calibration feature image P1 shown in FIG. 1 is a checkerboard. However, in actual applications, the calibration feature image P1 may also be lines, feature points, etc.

[0085] In some examples, such as Fig.12 As shown, the first image includes a user projected image P2 and a calibration image feature. Among them, one of the at least one reference image feature is an image feature in the user projected image P2 or an image feature in the calibration feature image P1. That is, at least one reference image feature may be all image content in the user projected image P2; or all projection content in the calibration image feature; or part of it may be image content in the user projected image P2, and the other part of it may be projection content in the calibration image feature. The embodiment of the present application may perform feature processing based on the calibration image feature and / or the user projected image P2. During the feature processing, the user can still watch the movie. For example, Fig.12 As shown, the calibration image features are set at the edge of the user projected image P2, and the user can watch the movie normally. At the same time, the calibration image features are still retained to assist feature processing.

[0086] In some examples, such as Fig.13As shown, the first image is the user projected image P2, and at least one reference image feature is an image feature in the user projected image P2. In the embodiment of the present application, the calibration image feature is not projected during the adjustment of the projection parameters. The first image feature in the first image is extracted. And the corresponding second image feature is extracted from the second image feature to obtain a depth image. In the embodiment of the present application, the user can directly watch the projected content as the user projected image P2, and the features in these projected contents can be used as feature content for feature extraction and calibration. The user has no perception of the reference image features, and the viewing experience is better.

[0087] For example, in Fig.13 In the illustrated embodiment, when the first image is a user projected image P2, the first captured image is used as the second image. The first captured image is a captured image corresponding to the first image that displays valid image data. In an embodiment of the present application, when the user projected image P2 is used as the first image, there may be a situation where the user projected image P2 displays invalid image data, for example, the user projected image P2 displays a black screen (i.e., a black frame), or displays a white screen (i.e., a white frame), etc. In these cases where valid image data is not displayed, it is difficult to extract reference image features. Therefore, the captured image can be selected to perform feature processing on the first captured image corresponding to the first image that displays valid image data as the second image.

[0088] In some examples, feature extraction may be performed on the first image to obtain first image features. Feature extraction may be performed on the second image features to obtain second image features. Based on binocular vision matching technology, the first image features and the second image features are feature matched to obtain a depth image. The embodiments of the present application may be applicable to any form of first image (e.g., a first image including a user projected image and / or a calibrated feature image).

[0089] In some examples, when the first image is a calibration feature image or the first image includes a calibration feature image, the calibration feature image can be used as a reference image feature and a corresponding feature parameter can be generated. In subsequent work, when the second image is input, the second image feature can be extracted from the second image, and the feature parameter generated in advance can be called as the first image feature, and feature matching is performed based on the first image feature and the second image feature to generate a first control signal.

[0090] Some projection parameters (such as projection focal length, etc.) can be adjusted without extracting too many reference image features. At this time, the distribution density of the reference image features can be made smaller than a certain range to reduce the number of reference image features to be extracted, thereby reducing the amount of data processing.

[0091] In some possible implementations, part or all of the projection surface is a three-dimensional structural surface. The distribution density of multiple reference image features on the three-dimensional structural surface is greater than a second threshold. The projection control method may also include: obtaining structural parameters of the three-dimensional structural surface according to the depth coordinates corresponding to the three-dimensional structural surface. In an embodiment of the present application, the fixed projection surface may be a three-dimensional structural surface that is not a completely planar surface. Alternatively, during the projection process, there are moving objects or living bodies appearing in the projection area, so that part or all of the projection surface is a three-dimensional structural surface. Therefore, the distribution density of the reference image features may also be set to be larger, the structural parameters of the projection surface are calculated by multiple reference image features, and a series of processing operations are performed according to the acquired structural parameters.

[0092] In some possible implementations, such as Fig.14 As shown, the projection control method further includes the operation of step S400:

[0093] S400 , adjusting the projection focal length according to the imaging clarity of the projection image T1 .

[0094] For example, Figure 6 The third controller 10C shown can obtain the imaging clarity of the projection image T1 according to the second image; and obtain at least one third control signal according to the imaging clarity of the projection image T1. Output at least one third control signal to the third projection component 20C to adjust the projection focal length of the projected structured light. In the embodiment of the present application, after the projection focal length of the second image is adjusted by the first control signal, the third camera 30C can continue to shoot multiple second images, and according to the imaging clarity of the projection image T1 in the multiple second images, the climbing method is used to finely adjust the projection focal length for multiple times, so as to further improve the imaging quality on the basis of the first control signal.

[0095] The embodiment of the present application proposes a projection control method, a projector and an electronic device. The projector includes a projection component and a camera. A structured light device is formed by the projection component and the camera. The projection component emits projection structured light to form a projection image T1 of a first image on a projection surface. The camera captures the projection image T1 to obtain a second image. Feature processing is performed according to the second image to obtain a depth image. The target projection parameters can be calculated according to the depth image, and a first control signal is generated. The projection structured light is emitted with the target projection parameters through the first control signal. The embodiment of the present application implements a structured light device based on the projection component and the camera, and achieves the purpose of depth ranging without adding additional hardware devices (such as ranging sensors), and realizes accurate adjustment of the projection parameters with one adjustment operation based on the first control signal. The embodiment of the present application can be used in low-cost, medium-cost and high-cost projector products. At the same time, the embodiment of the present application has a low delay in adjusting the projection parameters and maintains a high adjustment accuracy. In addition, when the first image and the second image are treated as images taken by a binocular camera for binocular visual matching processing, the depth image and the first image and the second image have native common viewpoints, which can reduce the processing of feature matching. At the same time, in theory, it is possible to achieve a resolution of the depth image that is equal to the resolution of the first image.

[0096] The present application also provides a computer-readable storage medium, which includes instructions. When the instructions are executed on a processor, the processor executes the projection control method described in the above embodiment (for example, Figure 6 , Figure 8 , Fig. 9 and Fig.14 method described).

[0097] The processor involved in the embodiments of the present application may be a chip. For example, it may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a microcontroller unit (MCU), a programmable logic device (PLD), or other integrated chips.

[0098] The memory involved in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct RAM (DR RAM). It should be noted that the memory of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0099] It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0100] Those of ordinary skill in the art will appreciate that the modules and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0101] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and modules described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0102] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules is only a logical function division. There may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or modules, which can be electrical, mechanical or other forms.

[0103] The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules, that is, they may be located in one device or distributed on multiple devices. Some or all of the modules may be selected according to actual needs to achieve the purpose of the present embodiment.

[0104] In addition, each functional module in each embodiment of the present application may be integrated into one device, or each module may exist physically separately, or two or more modules may be integrated into one device.

[0105] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using a software program, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loading and executing a computer program instruction on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, a computer, a server or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (Digital Subscriber Line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that a computer can access or may contain one or more servers, data centers and other data storage devices that can be integrated with a medium. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a DVD), or a semiconductor medium (eg, a solid state disk (SSD)).

[0106] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A projection control method, characterized in that: Projector based; The projector comprises a projection component and a camera; the method comprises: The projection component emits projection structured light based on a first data signal; the first data signal is used to indicate a first image; the projection structured light is used to form a projection image of the first image on a projection surface; the first image includes a user projection image and / or a calibration feature image; The camera photographs the first area to obtain a second data signal; the second data signal is used to indicate a second image; the projected image is partially or entirely located within the first area; A first control signal is obtained according to the second image; the first control signal is used to adjust the projection parameters of the projection structured light.

2. The projection control method according to claim 1, characterized in that: When the first image includes the user projection image, obtaining a first control signal according to the second image includes: Based on binocular vision matching technology, the first control signal is obtained according to the first image and the second image.

3. The projection control method according to claim 2, characterized in that: The obtaining the first control signal according to the first image and the second image includes: A depth image is obtained according to a first image feature and a second image feature; the first image feature includes at least one reference image feature in the first image; the second image feature is a mapped image feature of the at least one reference image feature on the second image; the depth image is used to indicate a depth coordinate of the at least one reference image feature; The first control signal is obtained according to the depth coordinate of the at least one reference image feature.

4. The projection control method according to claim 3, characterized in that: The obtaining the first control signal according to the depth coordinate of the at least one reference image feature comprises: Obtaining a target depth distance according to a depth coordinate of the at least one reference image feature; The first control signal is obtained according to the target depth distance.

5. The projection control method according to claim 4, characterized in that: The obtaining the first control signal according to the target depth distance includes: Obtaining target projection parameters according to a parameter mapping relationship and the size of the target depth distance; the parameter mapping relationship is a preset mapping relationship between depth distances of different sizes and different projection parameters; The first control signal is obtained according to the target projection parameter.

6. The projection control method according to any one of claims 3 to 5, characterized in that: The distribution density of the at least one reference image feature is less than a first threshold.

7. The projection control method according to any one of claims 3 to 5, characterized in that: Part or all of the projection surface is a three-dimensional structure surface; the distribution density of the plurality of reference image features on the three-dimensional structure surface is greater than a second threshold; the method further comprises: The structural parameters of the three-dimensional structural surface are obtained according to the depth coordinates corresponding to the three-dimensional structural surface.

8. The projection control method according to any one of claims 2 to 7, characterized in that: The method further comprises: When the first image is a user projected image, the first captured image is used as the second image; the first captured image is a captured image corresponding to the first image displaying valid image data.

9. The projection control method according to any one of claims 1 to 8, characterized in that: The method further comprises: Based on the projection angle of the projected structured light, a second control signal is generated; the second control signal is used to adjust the shooting angle of the camera.

10. The projection control method according to any one of claims 1 to 9, characterized in that: The projection parameters include at least one of a projection focal length and a projection angle.

11. The projection control method according to any one of claims 1 to 10, characterized in that: After obtaining the first control signal according to the first image and the second image, the method further includes: Obtaining imaging clarity of the projection image according to the second image; At least one third control signal is obtained according to the imaging clarity of the projection image; the at least one third control signal is used to adjust the projection focal length of the projection structured light.

12. A projector, characterized in that: The projector comprises a projection component, a camera and a controller; wherein: The projection component is used to: emit projection structured light based on a first data signal; the first data signal is used to indicate a first image; the projection structured light is used to form a projection image of the first image on a projection surface; the first image includes a user projection image and / or a calibration feature image; The camera is used to: photograph a first area to obtain a second data signal; the second data signal is used to indicate a second image; the projected image is partially or entirely located within the first area; The controller is used to: Outputting the first data signal to the projection component; and inputting the second data signal; A first control signal is output to the projection component according to the second image; the first control signal is used to adjust the projection parameters of the projection structured light.

13. The projector according to claim 12, characterized in that: When the first image includes the user projection image, the controller is specifically configured to: Based on binocular vision matching technology, a first control signal is output to the projection component according to the first image and the second image.

14. The projector according to claim 12 or 13, characterized in that: The projector further comprises an angle adjuster; the camera is mounted on the angle adjuster; and the controller is further used for: Based on the projection angle of the projected structured light, a second control signal is output to the angle adjuster; the second control signal is used to adjust the shooting angle of the camera.

15. The projector according to any one of claims 12 to 14, characterized in that: The projection parameters include at least one of a projection focal length and a projection angle.

16. The projector according to claim 15, characterized in that The controller is also used for: Obtaining imaging clarity of the projection image according to the second image; According to the imaging clarity of the projection image, at least one third control signal is output to the projection component; the at least one third control signal is used to adjust the projection focal length of the projection structured light.

17. An electronic device, characterized in that: It comprises a mounting portion and a projector as described in any one of claims 12 to 16; the projector is arranged on the mounting portion.

18. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes instructions; when the instructions are executed on a processor, the processor is enabled to execute the projection control method according to any one of claims 1 to 11.